guile_llama_cpp - News

Group

Main
- Main
- View members
- Search
Download
Support
- Submit new
- Browse
- Reset to open
- Digest
- Dependencies
- ~~Export~~
- Get statistics
- Search
Mailing lists
Source code
- Use Git
- Browse Git repository
Bugs
- Submit new
- Browse
- Reset to open
- Digest
- Dependencies
- ~~Export~~
- Get statistics
- Search
Tasks
- ~~Submit new~~
- Browse
- Reset to open
- Digest
- Dependencies
- ~~Export~~
- Get statistics
- Search
Patches
- ~~Submit new~~
- Browse
- Reset to open
- Digest
- Dependencies
- ~~Export~~
- Get statistics
- Search
News
- Browse
- Atom feed
- ~~Submit~~
- ~~Manage~~

guile_llama_cpp version 0.2 release

Item posted by Andy Tai <atai> on Sun 30 Jun 2024 01:57:20 AM UTC.

This is to announce the version 0.2 release of guile_llama_cpp, available at

(link to mirrored copy)
http://download.savannah.nongnu.org/releases/guile-llama-cpp/guile_llama_cpp-0.2.tar.gz

(direct link to file)
https://download-mirror.savannah.gnu.org/releases/guile-llama-cpp/guile_llama_cpp-0.2.tar.gz

This is the first release from the savannah.nongnu.org site, major changes:

   version 0.2      20240629
      * introduction of chat.scm, with more control over char parameters
      * chat scripts now output long replies from LLM

Guile_llama_cpp wraps around llama.cpp APIs so llama.cpp can be accessed from Guile scripts and programs, in a manner
similar to llama-cpp-ython allowing the use of llama.cpp in Python programs.
Currently simple Guile scripts are provided to allow simple "chat" with a LLM in gguf format.

Enjoy!