If the person chiding you was a co-worker and not your manager then you can just tell them that you feel like they are harassing you and that you would like them to stop. If they don't stop then go complain to HR.