After digging in a little further, it appears the primary source for the anecdote is this book, in a chapter called "The cognition hypothesis of language acquisition". Book:

Cromer, R.F. 1991. "Language and thought in normal and handicapped children." Cambridge, MA: Blackwell

https://www.amazon.com/Language-Handicapped-Children-Cogniti...