Understood. This is an area of image research I have an interest and some experience in (image segmentation, background inpainting, etc., through machine learning.)

I think your results are wonderful. I was just pointing out that from my background (a television producer - most recently Shark Week, etc.) that the Ken Burns effect and parallax effects are considered two different concepts (that can be combined, but mean different things.)

I did not mean to shoot you down or anything, I in fact greatly appreciate your feedback! I unfortunately do not have a television / movie producer background but wish to learn more to better understand and support the workflow of professionals in this area. On a different note, I have recently not had time to watch television and hence just looked Shark Week up. It looks popular, congrats!

The grantparent is right when it comes to terms:

- Ken Burns effect -> zoom and pan around the image.

The Ken Burns effect is a type of panning and zooming effect used in video production from still imagery. The name derives from extensive use of the technique by American documentarian Ken Burns. (Wikipedia)

- 2.5D parallax effect -> what we see in the link

https://blog.pond5.com/16853-create-2-5d-parallax-effect-ima...

https://www.youtube.com/watch?v=WcSdhtxId2o

Note that these two can (and frequently are) be combined, and Ken Burns himself does so occasionally.

I would like to add that our method estimates the scene in full 3D space. Have a look at the additional results, there are a few results that exemplify this when the geometry is a little more complex: http://sniklaus.com/papers/kenburns-results

I'd like add that, naming aside, your algorithm results looks amazing, and you could even have a business (or a successful app) here.

I know a few online services that do manual (cutting in photoshop, setting on a 3D plane, etc) still photo to 2.5D parallax, e.g.:

https://sundstedt.se/blog/services/2-5d-parallax-3d-effect-a...

there are Fiverr gigs doing it, and tons of filmmakers (me included when I dabble with that), do it ourselves too (which takes time in Photoshop, Premiere, etc) from time to time (for news, documentaries, and such).

In fact I am about to pay a good 100-200 to have 4-5 photos done this way for a project...

Since I have done the work while interning at Adobe, I am afraid that I will not be able to commercialize it myself due to patenting. I agree with you that it has great potential, there are still quite a few failure cases though and it is a little hit and miss.

My special was “Andrew Mayne: Ghost Diver” where I built a suit to fool great white senses. Not shown in the special was the work we did trying to understand how sharks process visual data differently than humans. One interesting note is that they don’t seem to do image segmentation like we do (people in a shark cage are just a noisy box-thing and not discreet objects.)

Again, your project is great. I’ve been trying to find a simple workflow to do something like this (currently it’s remove.bg and OpenCV - with a lot of tinkering.)

I just watched the trailer to that special, really interesting insights into the vision of sharks. And kudos on the nifty special effects to illustrate it!

> Not shown in the special was the work we did trying to understand how sharks process visual data differently than humans.

I would absolutely love to read that paper if it existed. Also, congratulations on the special!

I think OP meant for the 3D to be a qualifier of the Ken Burns effect. Meaning he added parallax to the Ken Burns effect to produce a "3D Ken Burns Effect".

I don't have any experience in any of it but I'm just offering another explanation of the discussion.

Here's the page and video explaining it: http://sniklaus.com/papers/kenburns

It might be a nice side result to use your tech to identify foreground elements automatically to generate the camera motion, without using the 2.5D layering. Then you’d have a more traditional Ken Burns effect. It might not work at picking a specific face out of a crowd, but it would work for a lot of scenarios.

I find Apple’s automatic Ken Burns effect to be way too noisy and almost useless because it zooms in/out from random places in the pictures. When I manually edit a Ken Burns effect myself, there’s a lot less movement, and the movement is so much more meaningful and relevant to the video.

Thank you for your feedback! I highly value the opinion of working professionals like you and am taking notes. :)

Yes. This is amazing technology and looks fantastic.

No it is not what is generally referred to as a ‘Ken Burns’ effect, which I think is a distraction in the title.

Because this is awesome!

Also how can I use this for a project I am literally doing production on right now??

Edit: People usually just call this parallax.