News for hackers. Stuff that matters.
Re:OpenAI: GPT 5.6 Sol price reduction (until at least Nov 21) by giwook on Monday August 24, 2026 @05:31PM (#49426123)
They'd still have strong models without distillation, but strong enough to challenge frontier models and to claim the meaningful market share that they have? Probably not.
Re:OpenAI: GPT 5.6 Sol price reduction (until at least Nov 21) by truncate on Monday August 24, 2026 @09:49PM (#49428174)
Or, they can figure out something else out? I recall couple years ago when China didn't have enough GPUs (still don't?), DeepSeek team figured out how to train with less computing. IIRC they made Mixture of Experts mainstream and made really optimized kernels and clever use of PTX instruction set.
Re:OpenAI: GPT 5.6 Sol price reduction (until at least Nov 21) by ACCount37 on Tuesday August 25, 2026 @04:18AM (#49430584)
"China does it in a cave with a box of scraps" is a myth. Chinese labs play the shell game to get their hands on a lot of compute outside China.

Tricks like distillation save compute in the RL leg of the process - where a lot of the frontier labs puts their own training run compute.

Re:OpenAI: GPT 5.6 Sol price reduction (until at least Nov 21) by truncate on Tuesday August 25, 2026 @05:54PM (#49441216)
I'm sure they do, but its not 0 or 1 thing.