You can just take the Auth server, run it yourself with an AWS RDS instance for example, keep up with updates and be good to go.

Yes you get a good UI with Supabase, and even much of that can be hosted yourself.