The thing I find most surprising about this is that the content is in a completely new medium/language compared to what it’s trained on. It’s trained on natural language and code and equations and DNNA sequences. I guess this is just finding the generalization between that and many layers of learned features in high dimensional spaces.