News for hackers. Stuff that matters.
Re:Ask HN: Share your "LLM screwed us over" stories? by dismalaf on Thursday January 02, 2025 @01:39PM (#42577321)
Have tried lots of open ones that I run locally (Granite, Smollm, Mistral 7b, Llama, etc...). Haven't played with the current generation of LLMs, was more interested in them ~6 months ago.

Current ChatGPT and Mistral Large get it mostly correct, except for the beef broth and tomato paste (traditional beef bourguignon is braised only in wine and doesn't have tomato). Interestingly, both give a better recipe when prompted in French...

Re:Ask HN: Share your "LLM screwed us over" stories? by breakingcups on Thursday January 02, 2025 @01:46PM (#42577380)
What kind of quantization are you running locally? I've noticed that for some areas it can affect the output quality a lot.