It's not inappropriate to be apologetic or sympathetic. But saying "this is hard on me" is basically asking for sympathy from the person you are putting in a very stressful situation.