I'm making LLMs work on small and old devices

Re:I'm making LLMs work on small and old devices by mrashad74 on Friday November 13, 2026 @02:46AM (#50479787)

a cluster of vapes running an LLM would be insane. a single vape of these though may run a small LLM like few hundred thousand parameters, worth tinkering with.

[ Parent | on HN ]

Re:I'm making LLMs work on small and old devices by pcthrowaway on Friday November 13, 2026 @06:57AM (#50482241)

Vapes typically have less than 100KB of RAM, though I haven't been able to find specs for the Rifbars yet. But I assumed even if they're 1MB that's still not enough to run any kind of LLM right?

[ Parent | on HN ]

Re:I'm making LLMs work on small and old devices by mrashad74 on Friday November 13, 2026 @07:35AM (#50482635)

not usable ones tho, but something like Karapathy's LLM may run

[ Parent | on HN ]