Llamafile lets you distribute and run LLMs with a single file

Re:Llamafile lets you distribute and run LLMs with a single ... by joenot443 on Thursday November 30, 2023 @09:17AM (#38473788)

The “obsession” isn’t for developers like you or I, it’s for non-technical but curious non-engineers who would still like to play around with an LLM.

I think you’re imposing your own very specific (and solvable!) gripe onto an unrelated project and it makes for pretty clumsy commentary.

[ Parent | on HN ]

Re:Llamafile lets you distribute and run LLMs with a single ... by whstl on Thursday November 30, 2023 @10:34AM (#38474747)

Yep.

But also: It might not be for a developer like you, but it is for a developer like me.

I enjoy writing software, but I don't particularly enjoy futzing with building things outside my day-to-day work, and on systems I don't write myself. If it was up to me everything would be one click.

Things like this are like accessibility: it benefits me even though I don't particularly need it.

[ Parent | on HN ]

Re:Llamafile lets you distribute and run LLMs with a single ... by pdntspa on Thursday November 30, 2023 @01:05PM (#38476747)

It's the way things have been for god-knows-how-long, and it has worked really really well.

I am utterly amazed and perplexed that answering ONE configuration question (which is all that is needed here) is too much. How lazy have we become?

One question. That is too much for folks?!

And I have no objection to the autodownloading. Just ask me where to put it first!

[ Parent | on HN ]