Unfortunately, the people abusing these are very persistent and adding more checks will just increase the sophistication of such attacks which works against the interests of the target.

This stops disgusting yourself as a legitimate service.

Charge for the service. How much spam do you get from Fastmail?

If they did that you’d decry censorship.

Allowing basically ~whatever, but proving the sender address is an obviously good approach to me.