1. This post shows how GANs were used to replicate the Princess Leia scene in Rogue One. The scene in the movie required a team of special effects artists, whereas this required access to lots of images of Carrie Fischer, a GPU, and this technology: https://io9.gizmodo.com/this-video-uses-the-power-of-deepfak...
2. I wrote this popular post on this topic (first page on Google for "deepfakes") that explains how it works, and where it can go for commercial applications: https://hackernoon.com/exploring-deepfakes-20c9947c22d9
3. If you prefer video, I gave a humorous talk on the same recently. It is designed for lay people, and has lots of examples: https://www.youtube.com/watch?v=wajS0XHzfpU&feature=youtu.be...
Also, it's important to consider control when talking about CGI or other creative endeavors. Generating a perfectly realistic scene is useless without being able to control the details of the scene. So the completely end-to-end magic demos aren't nearly as useful as things that generate off of armatures or performance transfer.
[1] https://www.theverge.com/2018/12/3/18121198/ai-generated-vid...
> Keep in mind that these are stills. Once the motion starts, humans detect the not-quite-realness easily. Even the 2D video creations by AI aren’t stitched correctly, let alone getting all the details of an animated 3D person right.
I agree this isn't end to end video synthesis but the end results are still very impressive and realistic. I can easily imagine this type of technology being a problem, because video evidence will be devalued and mean nothing.
They basically just animate Obama's lips using a RNN and then composite the output onto a target video of Obama to change the appearance of what he is saying. Yes they aren't generating all of Obama's head yet but this result in itself is impressive. Also I can't wait to see where GAN's take us 10-20 years down the road. Don't forget they are still in their infancy relatively speaking.
The main problem with this tech is that the quality can not be reliably controlled. Whatever it generates has to be passed through a human checker/curator pretty much. You can't just serve up generations to the audience without checking what they are. So, imo, this tech would be very useful for the concert art stage of the creative process, being able to just create new things, or mixup existing things, but only to create an intermediate artifact, which would then be used as inspiration for the artists to create the final art.
This is also devoid of any form of higher-level reasoning. It doesn't know concepts a human artist would know, such as object permanence, intuitive physics, etc. Something as simple as a ball falling down should squish a certain way, and when hit the ground should squash another way. It also doesn't have artistic sensibilities like anticipation, etc., that have been laid out in the 12 rules of animation, and even more, there's almost no way to communicate it to these models, short of just creating a huge dataset which has those 12 rules, and just hoping, rather praying, it learns it.
[1] https://twitter.com/ericfaccer/status/1077463342761951232
Take the Reuters feed, render as Fox News, then apply a Wes Anderson style transfer. Maybe exploring all those permutations will be more interesting than creating deceptive fakes?
"Research at NVIDIA: The First Interactive AI Rendered Virtual World " - https://www.youtube.com/watch?v=ayPqjPekn7g
Or, a bit earlier (star wars?), not-dead versions of themselves.
Performance art itself is about to be upturned.
AI can already string bad poetry together, surely in not long it can do a 5 act play, vary the characters a bit, jumble up the situations, create 3D realistic models, and put the whole thing together into your very own Breaking Bad that caters to your particular biases.
It can then take your feedback and do spinoffs, parodies, and so forth forever. You'll never be able to get up.
Someone is gonna glue those pieces together and make it a business.
Does modern CGI make use of machine learning like this? If not, what does it have in common aside from significant use of GPUs? What are the computational intensive parts of CGI, and what are the heavily manual and labor intensive parts of the CGI development workflow?