Love this! My take on this same idea was to train GPT-2 on a bunch of D&D adventures and then pipe the output to speech synthesis. I ended up just publishing the output as a podcast. The app also creates its own static site. You can read about the AWS workflow I used to create it.

AIDM: Artificially Intelligent Dungeon Master http://iws.mx/aidm/