Re:I'm making LLMs work on small and old devices
by mrashad74 on Thursday November 12, 2026 @11:35AM
(#50470088)
challenge accepted.
Re:I'm making LLMs work on small and old devices
by pcthrowaway on Friday November 13, 2026 @02:01AM
(#50479432)
I have about 12 of these Rifbar Mixpads saved up: https://rifbar.com/product-mixpro
They have a color LCD display that looks unnecessarily good considering what it does. You can see an example of one of the animations at the 52s mark in this video https://www.youtube.com/watch?v=peNyiLt5SKk&t=52s
I've got no idea what's inside of it yet but I'm open to tinkering if someone can walk me through it
I doubt any vape is powerful enough to run any LLM on its own, but idk if it's possible to run one on a cluster of vapes.
Re:I'm making LLMs work on small and old devices
by mrashad74 on Friday November 13, 2026 @02:46AM
(#50479787)
a cluster of vapes running an LLM would be insane. a single vape of these though may run a small LLM like few hundred thousand parameters, worth tinkering with.
Re:I'm making LLMs work on small and old devices
by pcthrowaway on Friday November 13, 2026 @06:57AM
(#50482241)
Vapes typically have less than 100KB of RAM, though I haven't been able to find specs for the Rifbars yet. But I assumed even if they're 1MB that's still not enough to run any kind of LLM right?
Re:I'm making LLMs work on small and old devices
by mrashad74 on Friday November 13, 2026 @07:35AM
(#50482635)
not usable ones tho, but something like Karapathy's LLM may run
Re:I'm making LLMs work on small and old devices
by gunsle on Friday November 13, 2026 @11:39AM
(#50486025)
A cluster of vapes, lmao
Re:I'm making LLMs work on small and old devices
by NooneAtAll5 on Thursday November 12, 2026 @01:33PM
(#50471960)
literal vaporware?
One of those vapes with a screen on it.