My dad worked the latter half of his career this way. He came in late and left early. But he was good enough / indispensable enough that he got away with it.