This has been my intuition with these models since close to the beginning.

Any framework you build around the model is just behaviour that can be trained into the model itself