It's kind of like saying that when you dive down to the network layer, video doesn't exist. It's up to the application running the network to assemble all the packets to turn it into video.
Thoughts are constructed from the stream of physical experiences that get formed into words, not the other way around. It's perfectly possible for the brain to still operate without thoughts the way we experience them, in fact, deaf people think visually rather than auditorially like most of us do.
You can think visually and procedurally (imagining actions) without putting things into words. IIRC Broca's area (which is responsible for grammar) may be related to the temporal planning of non-verbal actions though, so the above may be limited to Wernike's aphasia.
I have had a very hard time explaining to people that I just think thoughts, like flashes of... thinking, without words or actions or images. It's like when speaking or typing, you already know what you're going to say or type or write before you put it into words, but some people have trouble relating to that.
I'm in the same boat, actually. While I can't read without vocalizing mentally, I have speechless thoughts especially when it comes to math/logic stuff, and I sometimes find it painful to have to wait for my mouth to serialize what I have in mind.
We know this is wrong though. Memory of a chair is distinct from memory of the word "chair". If this wasn't true, then it would be difficult or impossible to speak multiple languages fluently. Also, animals wouldn't be able to understand the world around them, because they don't have language like we have language.
We are steering our evolution as a species outside of biology, in large part, via social and cultural institutions. What other species does that?
None. Sometimes I wonder if they know something we don't.
I do take it seriously - it's utterly fascinating. I'm really excited to read Manzotti's new book.
"When we say we are thinking, what we are actually doing is rearranging causal relations with past events, objects that we have encountered before, to see what happens when we combine them. We don’t need a mental sofa to put next to a mental armchair. We allow the sofas and armchairs encountered in our past to exert an effect in the present, in various combinations."