> I remember the exact point in my life when I realized how much difference rote memorization makes.

I suspect this might have something to do with neurological development. At least in my experience. Something about memory and recollection "clicked" (not a skill but more a capacity) at a really adult age for me.

Almost similar to being taught calculus after not knowing how most physics formula are derived and then looking back in confusion how you struggled with a straightforward thing.