Physics has an aim: to provide a rigorous description of reality on such a way that predictions about future experiments can be made. Physicists found that by altering certain quantities they got rid of the divergences and obtained a theory of remarkable experimental accuracy. That's all that matters.

Fortunately, of course, for our understanding, more people came along soon after to elucidate this mechanism.