News for hackers. Stuff that matters.

A comment on Ask HN: Which LLMs can run locally on most consumer computers. Parent comment

Re:Ask HN: Which LLMs can run locally on most consumer compu... by jaggs on Tuesday May 21, 2024 @06:02AM (#40426353)
Why would you get costs with a local model?
[ Parent | on HN ]
Re:Ask HN: Which LLMs can run locally on most consumer compu... by FezzikTheGiant on Tuesday May 21, 2024 @06:12AM (#40426418)
yeah that's what I'm saying - it would eliminate inference costs. What I was asking is how feasible is it to package these local llms with another standalone app. For ex. a game
[ Parent | on HN ]
Re:Ask HN: Which LLMs can run locally on most consumer compu... by jaggs on Tuesday May 21, 2024 @06:27AM (#40426522)
Oh sorry. Hm..I actually have no idea. It sounds like a neat idea though. :)
[ Parent | on HN ]