News for hackers. Stuff that matters.

A comment on Ask HN: What is the current (Apr. 2024) gold standard of running an LLM locally?. Parent comment

Re:Ask HN: What is the current (Apr. 2024) gold standard of ... by CuriouslyC on Monday April 01, 2024 @10:34AM (#39894572)
I wouldn't say maximalism so much, as Oobabooga was designed to emulate Automatic1111, where it's a good enough tool by itself, but then it has a strong extension ecosystem, and it can be utilized through other tools via web service. It's not great at any one thing but it's "good enough" pretty much everywhere.
[ Parent | on HN ]
Re:Ask HN: What is the current (Apr. 2024) gold standard of ... by Der_Einzige on Monday April 01, 2024 @11:00AM (#39894817)
I agree with you re:extensions. I know something of the extension ecosystem for it - I built one - https://github.com/Hellisotherpeople/llm_steer-oobabooga

Oobabooga the closest thing we have to maximalism. It has exposure for by far the largest number of parameters/settings/backends compared to all others.

My main point is that the world yearns for a proper "Photoshop for text" - and no one has even tried to make this (closest is oobabooga). All VC backed competitors are not even close to the mark on what they should be doing here.

[ Parent | on HN ]