Jerry Fodor used to write of mentalese. It’s a fair criticism. And yet generative AI is showing that the models can be creative in ways that look like thinking outside of language.