This is pretty much exactly what Descript.com does with its “overdub” feature. You can even choose the emotion and intonation of the generated audio. It works freakishly well.