rifkybujana

Re:Show HN: Open-source application to run local LLM easily on Monday February 03, 2025 @11:47PM (#42928095)

Unfortunately not for now, as i don't have the device to compile it, but there's a contributor that is working for the linux support, and there's someone that said to volunteer to make it available to macalso. But we'll get there, it's our first mvp afterall.

Show HN: Open-source application to run local LLM easily

Posted by rifkybujana on Monday February 03, 2025 @09:39AM
from the show-hn dept.

https://kolosal.ai

Kolosal is a simple desktop application to run most LLMs on both CPU and GPU. It is designed to be easy to setup, to run, and to embed, with only 30mb (extracted).It is inspired by ollama and lmstudio. While lmstudio have a very easy and beautiful interface and also very easy to setup, but i saw people are looking for an opensource alternative to it. In other hand, ollama is opensource, can be...

( Read More... | 2 comments | 3 points | on HN )