Humans fail because they cant review the entirety of test prep, can’t remember very much, and have a much smaller amount of “parameters” to store info in.
I would say LLMs store parameters that are quite superficial and don’t really get at the underlying concepts but given enough of those parameters, you can kind of cargo-cult your to an approximation of understanding.
It is like reconstructing the Mandelbrot set at every zoom level from deep learning. Try it!
It's not the same as the Nvidia driver having code that says "if benchmark, cheat and don't render anything behind you because no one's looking".