I don't think DM'ing is necessarily fun though. Most everyone I know who DMs sometimes, including me, finds it to be pretty stressful and a lot of work. The real value to me, is that a really good DM knows when to break the rules to enhance the game experience, and how to do it without making people angry. They create scenarios that specifically challenge the characters that are playing, not just for combat, but for role-playing purposes. Ie, a Lawful wizard is tempted to steal a scroll that would contain the knowledge he seeks the most, or a cleric who must decide whether to uphold her team's plan to ally with an unscrupulous NPC, or to go rogue in the name of their ethical code and deliver justice to said NPC. Good storytelling and cooperative play is just something that comes very naturally to some people, and having a human in the loop to respond to events in the context of an overarching narrative and party experience is really hard ot beat.
I agree about having a human in the loop. My idea though was that maybe you could have the best of both worlds with a computer to help the DM. The trick would be making the sandbox rich and responsive enough that the DM and characters would really have freedom in the moment. Maybe the DM could have tools that easily allow him to rez and customize appropriate objects and NPCs in the visualization.
The primary tool used for the show is tabletop simulator[2], which is a game designed for any tabletop games: cards, dices, chess etc. and can be customized quite a bit. It's mostly a low-tech solution, replicating physical acts of throwing dices, moving pieces and shuffling cards on a virtual table. In addition, the creators of URealm also invested in other custom softwares and artwork. However, the show is a for-profit project seeks to provide entertainment value for an audience rather than purely for the enjoyment of participants.
[1] https://www.urealms.com/ [2] https://store.steampowered.com/app/286160/Tabletop_Simulator...
I use Index cards and have all my spells, special abilities and my various attack sequences (for combat classes) written out long hand.
I also use an A6 notebook per campaign to keep a record of each session.
In a way it does a good job of showing both the current strengths and weaknesses of computers. Managing the rules and stats by hand can be fun, but I have seen many recorded sessions where it is obviously a burden that a computer would be perfectly suited for.
On the other hand, aspects of D&D like face-to-face interaction and language-based free creativity are things the computer can't handle well. Although video chat is a thing. Computers can't understand language at this point so they can't manage everything for you. Of course DMing is the most fun for many people so they wouldn't want a computer to DM.
I wonder if there would be a way to translate the freedom that you get as a DM or player in terms of world creation, scenario management, and freedom of action, to an interactive video-game type experience. Maybe in VR?