Although I imagine that requires contact with actual reality? i.e. I would expect a higher degree of such insights to come from RLVR.
Then again maybe the philosophy department has a different opinion :)
Then again maybe the philosophy department has a different opinion :)
—Albert Einstein
Quoted in Using Spaced Repetition Systems to See Through a Piece of Mathematics,
https://news.ycombinator.com/item?id=18895613
which describes the author's experience that if you approach a field obsessively enough, eventually you begin to understand it at a level deeper than language.
If an LLM is big enough, I imagine something similar is happening.