News for hackers. Stuff that matters.

A comment on Touching the Elephant – TPUs. Parent comment

Re:Touching the Elephant – TPUs by Workaccount2 on Saturday December 06, 2025 @11:59AM (#46174776)
IIRC people have gotten LLMs to run on '80s hardware. Inference isn't overly compute heavy.

The killer really is training, which is insanely compute intensive and really only recently hardware practical on the scale needed.

[ Parent | on HN ]
Re:Touching the Elephant – TPUs by adgjlsfhk1 on Saturday December 06, 2025 @03:57PM (#46176541)
you could probably train a gpt 2 sized model with sota architecture on a 2008 supercomputer. it would take a while though.
[ Parent | on HN ]