Yes, in a hypothetical platonic code-only way you can separate Yarvin from his work to some degree. But you're underestimating the impact of the word "personal" here- some people avoid communities like this not as a boycott, but for their personal safety or emotional well-being. That's the point where they go from the excluder to the one being excluded.