Its entirely consistent to hold the view that Islamic terrorists are a problem for the world without also believing that the majority of Muslims are terrorists. This seems similar to saying that I can't consider people being hit by cars a problem without also saying that the vast majority of car journeys result in someone being hit.

A vocal and deplorable minority of Muslims are actively attempted to split the world into Us and Them, I don't see that playing into their hand and deciding that I'm going to declare all Muslims want me dead is really going to help matters.