News for hackers. Stuff that matters.
Re:NanoGPT Slowrun: 10x Data Efficiency with Infinite Compute by sdpmas on Thursday March 19, 2026 @08:21PM (#47448517)
i think evolution meta-learns the architecture, hyperparams. some domain knowledge too (for ex, we all perceive the world as 3d) but not much. if you compare the text consumed by human vs AI (and i think this is fair b/c even with evolution text is a pretty recent invention for humans), the gap is many orders of magnitude.
Re:NanoGPT Slowrun: 10x Data Efficiency with Infinite Compute by throwaway894345 on Thursday March 19, 2026 @09:29PM (#47449205)
Tangentially, some scientists think humans may have hardwiring for detecting snakes https://en.wikipedia.org/wiki/Snake_detection_theory