I don’t think the notion of self-worth is rejected by Buddha. I think the expectation of achieving it through actions is rejected. The expected results are the problem not self-worth or actions.