Broadly speaking, there's (at least) two forms of net neutrality:
1) Different classes of traffic will be treated identically and not throttled indiscriminately (VOIP vs web content vs bittorrent etc.)
2) Content cannot be arbitrarily restricted by a technical provider.
If there was substantial abuse with their platform based upon technical reasons in case 1, I could see that as cause for termination.
Their arguments against denying service to 8chan are based upon case 2. Given where Cloudflare sits in the internet infrastructure layer, their supporting a pro-net neutrality position enforced upon ISPs while not applying that standard to themselves strikes me as more than a tad hypocritical.
Not everything has to be so black and white.
Making the choice twice now calls into question hundreds of other properties they work with, and may open the floodgates for all that criticism they have shielded against so far.