News for hackers. Stuff that matters.
Re:Local LLM inference – impressive but too hard to work with by K0balt on Monday April 21, 2025 @09:00PM (#43758139)
You release the game with a variable in game experience. If the player has two 4090s chugging away, she runs everything locally. If he’s got an rx480, a barebones 1b model or a subscription for the nicer AI NPCs, which can open up AI driven side quests (adding minor content within having to write it). Include a “free” month when you register the game.

There are no comments on this comment yet.