I think words themselves are kept somewhat stable due to being in overlapping memories, and thus protected from the brain cleanup process.
That seems too simple to be correct. How would you explain inventions? New ideas? Science fiction?
Imagine you are completely blind. The concept of colours would exist in your mind because you have access to literature mentioning it. You would know it's a thing, it exist, and yet, because you haven't been exposed to colors, you would have no memories of them of your own.
Now imagine if everybody in society was blind. Because nobody would have been exposed to colours, there would be no memories of them. It wouldn't be a thing as an idea in people's mind. As a result, there would be no way of thinking about the color red, or blue. It wouldn't be part of language either. Why describe something that we don't know that exist?
If you are from some uncontacted tribe in the Amazon that were never exposed to any modern technology, you cannot think about computers, skyscrapers or microwave ovens because you would not have the memories of these things.
So it's seems to me that memory is the scaffold of the mind.