I think the point where Apple goes too far is the perception that too much is never enough. They're already the most successful business in history - do they really need to use lawsuits to ensure they have no competitors?

The fact that they use these frivolous patents to do so is just icing on the righteous indignation cake.