I have a similar experience. When browsing articles and blog posts online, I definitely don't hear a voice unless the author uses a noticeable conversational tone in their writing. Especially if I'm familiar with the writer's speaking voice.

In narrative fiction, I often hear the words spoken by distinct voices, though this too wanes as I focus on reading quickly or become tired.