News for hackers. Stuff that matters.
Re:3D Ken Burns Effect from a Single Image by amayne on Sunday September 15, 2019 @01:51PM (#20978459)
Understood. This is an area of image research I have an interest and some experience in (image segmentation, background inpainting, etc., through machine learning.)

I think your results are wonderful. I was just pointing out that from my background (a television producer - most recently Shark Week, etc.) that the Ken Burns effect and parallax effects are considered two different concepts (that can be combined, but mean different things.)

Re:3D Ken Burns Effect from a Single Image by sniklaus on Sunday September 15, 2019 @02:02PM (#20978531)
I did not mean to shoot you down or anything, I in fact greatly appreciate your feedback! I unfortunately do not have a television / movie producer background but wish to learn more to better understand and support the workflow of professionals in this area. On a different note, I have recently not had time to watch television and hence just looked Shark Week up. It looks popular, congrats!
Re:3D Ken Burns Effect from a Single Image by coldtea on Sunday September 15, 2019 @02:16PM (#20978621)
The grantparent is right when it comes to terms:

- Ken Burns effect -> zoom and pan around the image.

The Ken Burns effect is a type of panning and zooming effect used in video production from still imagery. The name derives from extensive use of the technique by American documentarian Ken Burns. (Wikipedia)

- 2.5D parallax effect -> what we see in the link

https://blog.pond5.com/16853-create-2-5d-parallax-effect-ima...

https://www.youtube.com/watch?v=WcSdhtxId2o

Note that these two can (and frequently are) be combined, and Ken Burns himself does so occasionally.

Re:3D Ken Burns Effect from a Single Image by sniklaus on Sunday September 15, 2019 @02:40PM (#20978753)
I would like to add that our method estimates the scene in full 3D space. Have a look at the additional results, there are a few results that exemplify this when the geometry is a little more complex: http://sniklaus.com/papers/kenburns-results
Re:3D Ken Burns Effect from a Single Image by coldtea on Sunday September 15, 2019 @05:36PM (#20979628)
I'd like add that, naming aside, your algorithm results looks amazing, and you could even have a business (or a successful app) here.

I know a few online services that do manual (cutting in photoshop, setting on a 3D plane, etc) still photo to 2.5D parallax, e.g.:

https://sundstedt.se/blog/services/2-5d-parallax-3d-effect-a...

there are Fiverr gigs doing it, and tons of filmmakers (me included when I dabble with that), do it ourselves too (which takes time in Photoshop, Premiere, etc) from time to time (for news, documentaries, and such).

In fact I am about to pay a good 100-200 to have 4-5 photos done this way for a project...

Re:3D Ken Burns Effect from a Single Image by sniklaus on Sunday September 15, 2019 @05:51PM (#20979689)
Since I have done the work while interning at Adobe, I am afraid that I will not be able to commercialize it myself due to patenting. I agree with you that it has great potential, there are still quite a few failure cases though and it is a little hit and miss.
Re:3D Ken Burns Effect from a Single Image by amayne on Sunday September 15, 2019 @02:18PM (#20978632)
My special was “Andrew Mayne: Ghost Diver” where I built a suit to fool great white senses. Not shown in the special was the work we did trying to understand how sharks process visual data differently than humans. One interesting note is that they don’t seem to do image segmentation like we do (people in a shark cage are just a noisy box-thing and not discreet objects.)

Again, your project is great. I’ve been trying to find a simple workflow to do something like this (currently it’s remove.bg and OpenCV - with a lot of tinkering.)

Re:3D Ken Burns Effect from a Single Image by sniklaus on Sunday September 15, 2019 @03:56PM (#20979167)
I just watched the trailer to that special, really interesting insights into the vision of sharks. And kudos on the nifty special effects to illustrate it!
Re:3D Ken Burns Effect from a Single Image by tomcam on Sunday September 15, 2019 @03:25PM (#20979006)
> Not shown in the special was the work we did trying to understand how sharks process visual data differently than humans.

I would absolutely love to read that paper if it existed. Also, congratulations on the special!

Re:3D Ken Burns Effect from a Single Image by frogpelt on Sunday September 15, 2019 @03:22PM (#20978992)
I think OP meant for the 3D to be a qualifier of the Ken Burns effect. Meaning he added parallax to the Ken Burns effect to produce a "3D Ken Burns Effect".

I don't have any experience in any of it but I'm just offering another explanation of the discussion.

Here's the page and video explaining it: http://sniklaus.com/papers/kenburns