You don't have to go to the pub. You can just say something like, "I better go home now and get ahead of the traffic, have a good time!" then proceed to find a new job if they actually give you flak from that.