News for hackers. Stuff that matters.
Re:Why is Gemini 4 Carbon taking so long? by tibbar on Wednesday November 18, 2026 @07:00AM (#50545234)
Internet data is only good for some parts of model training. That is why there is now a huge cottage industry that creates custom datasets, RL envs, etc.

Incidentally, Google is often considered to be extremely good at pretraining, which is just the thing internet data is good for.

Re:Why is Gemini 4 Carbon taking so long? by andy_ppp on Wednesday November 18, 2026 @08:29AM (#50546085)
Yes I'm very much talking about data used in the RL section, I'm sure Google are indeed very good at pre-training.