News for hackers. Stuff that matters.

jsnow119

jsnow119 on Hacker News

Re:Mistral 7B, the most powerful language model for its size to date, ... on Saturday September 30, 2023 @04:58PM (#37719740)
How come one blog post with the torrent magnet of mistral says I need 24g vram but ollama says I only need 8g regular ram minimum?

If I wanted to experiment with working with models and finetuning offline should I just save for a 32g vram+ video card?