It's been attempted with real data: https://github.com/haykgrigo3/TimeCapsuleLLM

However, it is necessarily a tiny model because of the limited training data.

All machine learning is extremely data-intensive compared to organic brains, it's nowhere near good enough to generate novel (relative to the training cut-off) maths or scientific hypotheses.