News for hackers. Stuff that matters.

A comment on Ask HN: Which LLMs can run locally on most consumer computers. Parent comment

Re:Ask HN: Which LLMs can run locally on most consumer compu... by wing-_-nuts on Wednesday May 22, 2024 @01:43PM (#40443804)
There are mods for skyrim right now that run an NPC's dialog and lore through a small 7B model outputs text dialog. Heck if you wanted you could run a 2B whisper model and get reasonably decent voice output.

It's all very exciting, if a little janky.

[ Parent | on HN ]

There are no comments on this comment yet.