Helen Keller wrote about having memories of being something like a stimulus-response automata before language enabled her to be conscious and think. I think that example is actually in favour of language being required for thought, because she remembers a state of being before language where she wasn't really conscious and didn't really think. I don't see any particular reason why language would be required for memory formation, though.