Re:3D Ken Burns Effect from a Single Image
by sniklaus on Sunday September 15, 2019 @02:11PM
(#20978594)
Estimating the scene geometry from a single image is highly challenging and remains an unsolved problem. As such, you can find subtle artifacts like this in most of the results. The artifact that you are referring to stems from a geometry adjustment step in which we make sure that salient objects like humans or animals are on a plane in the 3D space. This requires image segmentation which is also highly challenging and may lead to parts of the background being assigned to the segmented foreground object and vice versa.
[ Parent
| on HN ]
Re:3D Ken Burns Effect from a Single Image
by anon1m0us on Sunday September 15, 2019 @03:37PM
(#20979069)
Could you not use something like the "magic wand" selection tool in image editing programs? Doesn't the dramatic color difference indicate it's not part of the same object?
I thought maybe it grabbed it because it was the same color as the bouquet she is holding, but that is entirely within the white of her dress.
Re:3D Ken Burns Effect from a Single Image
by sniklaus on Sunday September 15, 2019 @05:09PM
(#20979505)
There definitely is room for improvement. Our proposed framework uses Mask R-CNN for object segmentation. However, Mask R-CNN only as a resolution of 28x28 pixels for the object masks if I remember correctly (which is then resized to the actual resolution of the object in the image). So there are a lot of limitations from that alone.
if you haven't already seen it, https://github.com/dbolya/yolact generates very sharp instance masks very quickly, may be of interest