Oh yeah. More likely they'd come based on you going to an event they don't like, or having a hobby they don't like. And they probably won't be interested in any claims that you weren't there or didn't do that or aren't who they're looking for.

Actual police mostly have better procedures for this sort of thing, but still sometimes get the wrong guy or go to the wrong address. Somehow I doubt such groups will do better than them.