News for hackers. Stuff that matters.
Re:Show HN: A decent text-to-image model trained for ~$20K (... by andai on Friday November 06, 2026 @01:49AM (#50389020)
Well done. $20k? That's insane. I remember tinyllama back in the day (2023) was trained on $40k and could barely form coherent sentences.

Are pictures easier than English, or did the methods advance so much?

Re:Show HN: A decent text-to-image model trained for ~$20K (... by wongarsu on Friday November 06, 2026 @07:27AM (#50391558)
Over the last 3 years we made a lot of progress in efficient training methods. On text models, you can now train GPT-2 levels of coherent English from scratch for about $50 (e.g. using Karpathy's nanochat [1])

1: https://github.com/karpathy/nanochat

Re:Show HN: A decent text-to-image model trained for ~$20K (... by andai on Friday November 06, 2026 @10:19AM (#50393378)
That's insane. How does that work? Does it take so much less data now, or smaller models, or what? Apparently GPT-2 cost ~$40,000 to train when it came out.