I've had this happen at two jobs. Both times I immediately voiced that that was in poor taste, and next time they joke about it they'd best just let me go, because I don't want to work for someone who doesn't respect my livelihood. At the first job I was reprimanded for being "confrontational", which led to the second job where the manager apologized and took it to heart; we have a great working relationship now. It's the manager's responsibility to be the champion of good communication.