Already exists, in some form:
http://talkobamato.me/synthesize.py?speech_key=77ff00cb8af50...
Someone actually did make soundbanks based on syllables/morae from Trump and Sanders speeches, for the freeware (sadly not open-source) version of Vocaloid [1]. While it is technically extremely difficult to use this technology to approximate English speech (which has a much wider array of possible phonemes than Japanese), the soundbanks can already "cover" some of the more famous Japanese Vocaloid songs [2].
[1] https://en.wikipedia.org/wiki/Utau - which incidentally was the software that created the voice for that erstwhile Nyan Cat meme
[2] http://store.vocallective.net/album/trumploid-vs-sanderpoid-...
It gets even better when combined with Face2Face, a live-editing software that can transfer facial expressions including lip movements from actors to e.g. politicians on TV: https://www.youtube.com/watch?v=ohmajJTcpNk
Coming to you 2020: president candidate X may or may not have said that he hates women, kicks babies, love hitler, and plans to nuke Wales. You don't even care any more because your airwaves have been saturated with both candidates (and their Vocaloids) saying all kinds of crazy shit in disinformation and counter-disinformation and counter-counter-information campaigns and everybody's desensitized.