Is it possible you just got a not fun Google team ;)
I was on the Adwords Campaign Management team (responsible for http://adwords.google.com). In a way, you can tell it would've sucked, as you can see their interface is still the same crap, backward, half-assed garbage it was when it launched in 2009.
Even separate from the nature of the team (most didn't really seem happy), it seems I was further singled out in some way. I don't know why, but they seemed very serious about ensuring I was miserable, harassed, annoyed, and stalled out (unable to do anything). And then, as I walked around each day, many looked miserable (depressed or anxious and on edge (worried about sounding stupid?)), and there seemed to be a general mood of dissatisfaction.
If you read reviews on Glassdoor, Quora, or anywhere else online, you'll probably start hearing the same themes. That is, even if I wasn't explicitly singled out, I still would've probably not enjoyed my time there; it just wouldn't have been as severe.
It was annoying, as the place I'm referring to is the almighty Google. This was many years ago, but I still remember very clearly the huge gap between what was advertised and what they actually were.
The previous job was at an old world company (rated as one of the 50 worst places to work by Glassdoor while I was there) and the idiot manager I had was on an entirely different level.