newsguile_llama_cpp - News

 
 

guile_llama_cpp version 0.2 release

Item posted by Andy Tai <atai> on Sun 30 Jun 2024 01:57:20 AM UTC.

This is to announce the version 0.2 release of guile_llama_cpp, available at

(link to mirrored copy)
http://download.savannah.nongnu.org/releases/guile-llama-cpp/guile_llama_cpp-0.2.tar.gz

(direct link to file)
https://download-mirror.savannah.gnu.org/releases/guile-llama-cpp/guile_llama_cpp-0.2.tar.gz

This is the first release from the savannah.nongnu.org site, major changes:

   version 0.2      20240629
      * introduction of chat.scm, with more control over char parameters
      * chat scripts now output long replies from LLM

Guile_llama_cpp wraps around llama.cpp APIs so llama.cpp can be accessed from Guile scripts and programs, in a manner
similar to llama-cpp-ython allowing the use of llama.cpp in Python programs.
Currently simple Guile scripts are provided to allow simple "chat" with a LLM in gguf format.

Enjoy!

Back to the top

Powered by Savane 3.13-df36.
Corresponding source code