News for hackers. Stuff that matters.

A comment on Ask HN: Which LLMs can run locally on most consumer computers. Parent comment

Re:Ask HN: Which LLMs can run locally on most consumer compu... by alexvitkov on Wednesday May 22, 2024 @01:25PM (#40443589)
The biggest roadblock is not running the model on the user's machine, that's barely an issue with 7B models on a gaming PC. The difficulty is in getting the NPC to take interesting actions with a tangible effect on the game world as a result of their conversation with the player.
[ Parent | on HN ]
Re:Ask HN: Which LLMs can run locally on most consumer compu... by FezzikTheGiant on Wednesday May 22, 2024 @02:21PM (#40444244)
The generative agents paper takes a pretty decent shot at this I think
[ Parent | on HN ]