IIRC Feynman was also concerned about the infinities as well, but ultimately pragmatic. The infinities bother me as well. But, on reflection classical point particles produce forces that approach infinity as they become close, so the quantatization reflecting this seems reasonable. Please see my other comments.