It's such a loaded question because any simple answer implies you acknowledge that 5pm is early. Gross. I hope you told them you value a healthy work life balance and left anyways. If a place fires you for that, you're better off not working there, barring exceptional circumstances.