I also work in ML/DL. I'd use a different word than "surprised". "Appalled" is more appropriate. If the video proves anything, it's that everything they do is a hack. There is no principled way to do anything. There is something seriously wrong when they have to resort to oversampling to deal with catastrophic forgetting, aka, learning instability. Yet I'm supposed to trust my life with this thing? Today's DNN are still incredibly crude. There are fundamental problems that need to be solved before we can deploy them in anything other than toys.