News for hackers. Stuff that matters.
Re:I Self-Hosted Llama 3.2 with Coolify on My Home Server by magicalhippo on Wednesday October 16, 2024 @06:54AM (#41857653)
Yes, gemma-2-9b-it-Q6_K_L is the one that works well for me.

I tried gemma-2-27b-it-Q4_K_L but it's not as good, despite being larger.

Using llama.cpp and models from here[1].

[1]: https://huggingface.co/bartowski

There are no comments on this comment yet.