newsguile_llama_cpp - News


guile_llama_cpp version 0.2 release

Item posted by Andy Tai <atai> on Sun 30 Jun 2024 01:57:20 AM UTC.

This is to announce the version 0.2 release of guile_llama_cpp, available at

(link to mirrored copy)

(direct link to file)

This is the first release from the site, major changes:

   version 0.2      20240629
      * introduction of chat.scm, with more control over char parameters
      * chat scripts now output long replies from LLM

Guile_llama_cpp wraps around llama.cpp APIs so llama.cpp can be accessed from Guile scripts and programs, in a manner
similar to llama-cpp-ython allowing the use of llama.cpp in Python programs.
Currently simple Guile scripts are provided to allow simple "chat" with a LLM in gguf format.


Back to the top

Powered by Savane 3.13-b921.
Corresponding source code