Re:Few-Shot Video-to-Video Synthesis
by Mathnerd314 on Tuesday November 05, 2019 @01:30AM
(#21450186)
It seems to do motion transfer alright but the legs in the dancing video get warped instead of moving so there's some frames where they have triangle legs vanishing at the knee. https://youtu.be/8AZBuyEuDqc?t=34
Maybe if you scale up the training data the model is going to learn some better warping, but I think to really get better photorealism there has to be a 3D component, some kind of distance/movement estimation like in https://arxiv.org/pdf/1704.07804.pdf and a shape inference/transfer step.
Maybe if you scale up the training data the model is going to learn some better warping, but I think to really get better photorealism there has to be a 3D component, some kind of distance/movement estimation like in https://arxiv.org/pdf/1704.07804.pdf and a shape inference/transfer step.