That's just a politicisation of the message to create further division among people who are not racist. Same thing as calling people nazi (so you can feel entitled to punch them).

I think that philosophically most people agree that all lives matter and behave accordingly. Who doesn't is definitely a problem, albeit they're a minority.