I'm making LLMs work on small and old devices

Re:I'm making LLMs work on small and old devices by pcwalton on Thursday November 12, 2026 @03:55PM (#50474140)

This would be fascinating. I've sometimes wondered how computing would have been different if we'd known how to build modern LLMs in the 2000s, despite the much poorer hardware (leaving aside how you could possibly train such a thing back then).

[ Parent | on HN ]

Re:I'm making LLMs work on small and old devices by saturn8601 on Thursday November 12, 2026 @05:04PM (#50474974)

Wonder if its possible to solder on more RAM to the PS2 like you can with the Xbox.

[ Parent | on HN ]

Re:I'm making LLMs work on small and old devices by WhiteDawn on Thursday November 12, 2026 @07:46PM (#50476636)

Already done. Ofc you’ll be streaming the weights off the optical drive ;)

https://github.com/xaskasdf/ps2-llm

[ Parent | on HN ]

Re:I'm making LLMs work on small and old devices by mrashad74 on Friday November 13, 2026 @01:05AM (#50478994)

streaming weights of the CD drive should be top 10 blessed engineering hacks I've seen in the past 2 weeks.

[ Parent | on HN ]