News for hackers. Stuff that matters.
Re:Olmo 3: Charting a path through the model flow to lead op... by weregiraffe on Friday November 21, 2025 @11:18AM (#46005853)
Is the training data open-source? And can you validate that the model was trained on the claimed training data alone? Without this, all benchmarks are useless.
Re:Olmo 3: Charting a path through the model flow to lead op... by comp_raccoon on Friday November 21, 2025 @11:25AM (#46005929)
Olmo author here! we release all training data and all our training scripts, plus intermediate checkpoints, so you could take a checkpoint, reproduce a few steps on the training data, and check if loss matches.

it’s no cryptography proof, and you can’t get perfect determinism on nvidia GPUs, but it’s pretty close.