The point is that you are on paternity leave, taking care of a child on a company sanctioned policy. It's like being told you didn't work hard enough on your vacation - it doesn't make sense to set "work" expectations for a period in which one is absent from work.