News for hackers. Stuff that matters.
Re:Experimenting with Local LLMs on macOS by ActorNightly on Tuesday September 09, 2025 @01:31PM (#45185381)
Smaller models require a lot more direction, a.k.a system prompt engineering, and sometimes custom wrappers . For example Gemma models are very eager to generate code even if you tell them not to.

There are no comments on this comment yet.