I struggle to see an ethical argument one could make to force rigid in-office work for anything but the smallest of companies (when the work could be done remotely). Eventually (and it won't take long) you'll hire someone that would benefit in many ways from flexible work and the only detriment will be that you would have to utilize your flexibility to satisfy your own personality traits the same as everyone else, rather than have rigid, harmful rules, that cater only to your preferences.