It absolutely matters for cognitive ability. You might be reading the equivalent of children's books, but if you can't understand the deeper message, you're going to have a very hard time telling right from wrong.

The analogy I use for software developers is that the difference between a jr and sr developer is that a sr can evaluate 5 different database technologies and choose the right one based on the current use case. A jr developer chooses whatever is trending on hackernews.