I'm making LLMs work on small and old devices

Re:I'm making LLMs work on small and old devices by mrashad74 on Thursday November 12, 2026 @12:55PM (#50471339)

Raspberry Pis in general are too easy for this task they don't even need modifications, older iphones seem more interesting due to some work on comptability.

[ Parent | on HN ]

Re:I'm making LLMs work on small and old devices by saturn8601 on Thursday November 12, 2026 @05:03PM (#50474964)

Machines with unified ram work better? whats the bare minimum Ram you need? Maybe those old SGI or Sun machines could have a second life. SGI boxes made the Terminator come to life on the big screen so now their second act could be to help bring the real terminator to life :P

[ Parent | on HN ]

Re:I'm making LLMs work on small and old devices by aa-jv on Friday November 13, 2026 @05:12AM (#50481129)

Yes please, my Indy, O2 and Octane2 are all sitting there waiting for some hot Terminator LLM action.

[ Parent | on HN ]

Re:I'm making LLMs work on small and old devices by tslmy on Friday November 13, 2026 @01:21PM (#50487556)

Try an iPod Touch 4th gen? IIRC it's the last model that doesn't support anything higher than iOS 6, so it would be fun to have a local LLM running in a native app that speaks skeuomorphism.

[ Parent | on HN ]