The whole point of federated activitypub servers is the opposite of segregation - everyone gets to use whatever server they want and they can still interact with anyone else. Servers blacklisting each other (or defederating) is possible of course, but nothing's stopping you from just joining another server, and twitter at this point is just a large defederated mastodon instance anyway.