Ask HN: Which LLMs can run locally on most consumer computers

Re:Ask HN: Which LLMs can run locally on most consumer compu... by FezzikTheGiant on Tuesday May 21, 2024 @06:12AM (#40426418)

yeah that's what I'm saying - it would eliminate inference costs. What I was asking is how feasible is it to package these local llms with another standalone app. For ex. a game

[ Parent | on HN ]

Re:Ask HN: Which LLMs can run locally on most consumer compu... by jaggs on Tuesday May 21, 2024 @06:27AM (#40426522)

Oh sorry. Hm..I actually have no idea. It sounds like a neat idea though. :)

[ Parent | on HN ]