Objectively, you are forgoing most of the complexity. It's sort of like playing baseball without trying to hit the ball because you like watching the pitcher throw baseballs.

Subjectively, of course there's nothing wrong with playing a solitary game however you like. I definitely play GTA as a giant murder sandbox, without bothering with the story or missions. =)