> If I have public key authentication set up for ssh, should I even bother with fail2ban

If someone's bruteforcing their way in via ssh it's probably worthwhile blocking them before they start trying other services.