Shameless plug for my essay [1] that discusses some similar ideas to this article. I focus more in-depth on what the consequences of compositional grammar are for ML-based NLP and why we should be looking to theories of psycholinguistics and philosophy of language for inspiration as a research community.

[1] https://rohan.bearblog.dev/humans-spoke-vectors/