I forget the name of the other famous physicist (not Dyson) who said it, but the quote was: "I've seen more [persons] destroyed by Physics than by drugs".

I don't regret my Ph.D., but I still remember the monotone voice in which I defended my dissertation. Listen to advice here. Powerlessness is quite something to experience when one is (has been) locked in for years.