News for hackers. Stuff that matters.
Re:ChatGPT for SNES by kqr on Friday November 20, 2026 @02:13AM (#50571191)
As someone else pointed out, training something like this requires much more hardware than running it.

It's similar with other forms of machine learning, too. A logistic regression can make calibrated decisions in complex situations with nearly no compute at all, but training it on lots of data to give it good weights is more expensive. And even if we could submit a training batch job on 1990s hardware and wait a few years for it to complete, there's a level of interactivity required at the start to explore one's way to the right parameters and tokenisation etc. that probably wouldn't have been economically feasible at the time.

In a wider sense, a general purpose computer is a general purpose computer. Hypothetically, we "could have" run transformers in the 1940s on vacuum tubes. It just would have (a) required much space, (b) produced much heat, and (c) required tube replacements all the time. We "could have" run transformers on human computers in the late 1800s or early 1900s – all the maths was there, I think? – but it would have been even slower!

Re:ChatGPT for SNES by anthk on Friday November 20, 2026 @03:16AM (#50571662)
The difference between 1992 hardware and 1998 was really huge. High end Sparc servers on 1998 (or double CPU based Xeons) could create something usable.
Re:ChatGPT for SNES by handoflixue on Friday November 20, 2026 @06:00AM (#50572993)
> We "could have" run transformers on human computers in the late 1800s

I love the idea of using humans to train an auto-complete model that produces human-like text. I think those are called authors ;)