News for hackers. Stuff that matters.
Re:Kalosm 0.3: A Rust framework for local AI by Evan-Almloff on Friday August 30, 2024 @10:00AM (#41400805)
Kalosm is a library for pre-trained text, audio and visual models in Rust. It includes support for:

- Whisper for audio transcription

- Llama, phi and mistral models for text generation.

- Structured generation: You can generate text that fits your specific format by deriving a parser automatically with structured generation

- Bert for text embedding and search

The latest release adds support for deriving parsers and json schemas to use with structured text generation, real time audio transcription and a bunch of performance improvements

There are no comments on this comment yet.