News for hackers. Stuff that matters.
Re:Mistral 7B, the most powerful language model for its size... by jsnow119 on Saturday September 30, 2023 @04:58PM (#37719740)
How come one blog post with the torrent magnet of mistral says I need 24g vram but ollama says I only need 8g regular ram minimum?

If I wanted to experiment with working with models and finetuning offline should I just save for a 32g vram+ video card?

There are no comments on this comment yet.