Re:There oughta be a bullet time video booth
by estebank on Friday May 26, 2023 @03:24PM
(#36088523)
The project already used frame interpolation (through DaVinci Resolve) to double the number of frames in the video. Plus a low-tech "inside the wall" panned and blurred frame. Given the set-up, fancier scene reconstruction to build a 3D model of the environment could be combined with texture reprojection to improve the interpolation and allow the "inside the wall" frame to be perspective corrected, but that would be much more involved on the software side than what was done here (and beyond what I could do too).
The tech to look out for in this space is called NeRF (Neural Radiance Fields).
Just do a quick search on that term and you will find a whole bunch of videos that reconstruct 3d scenes using digital stills. I just saw a paper a couple of days ago showing advances in reconstructing human expressions that change over time using advanced techniques.
Re:There oughta be a bullet time video booth
by riotnrrd on Friday May 26, 2023 @03:33PM
(#36088601)
Yeah, the Frugal Man's Bullet-time is a DSLR, Instant NGP from NVIDIA, and COLMAP.
Re:There oughta be a bullet time video booth
by 7373737373 on Saturday May 27, 2023 @02:40PM
(#36097114)
I want to show the creator this specific video on DAIN (Depth-Aware Video Frame Interpolation) https://youtu.be/sFN9dzw0qH8 !
[0]: https://www.youtube.com/watch?v=_KRb_qV9P4g