It's quite logical actually - LLMs replicate the texts they were trained on, so they also "learned" that, for example, one needs to put more attention at the sentences with exclamation marks or CAPITALIZED WORDS.