Re:Rich Sutton on AI creativity and discovery
by visarga on Wednesday June 10, 2026 @11:38AM
(#48478012)
The ad hoc heuristics are the domain knowledge baked into the model by human experts, like features, architecture and loss function.
"Evaluation" means environments or datasets, the model is supposed to discover its representations from scaled up experience. That was the bitter lesson - more data and compute beat heuristics.
"Evaluation" means environments or datasets, the model is supposed to discover its representations from scaled up experience. That was the bitter lesson - more data and compute beat heuristics.