fbriggs
* It trains a NeRF for each frame of video, then compresses it to our format 'ldi3', which enables real-time playback on Quest or Vision Pro in WebXR, Unity or Unreal (open source players are available for all of these).
* We provide a paper explaining how to bake NeRFs into layered depth images for real time rendering.
LMK your questions...
Volurama by Lifecast (YC W22) – Easy to Use NeRF for Windows and Mac
* It can output 2D videos where a virtual camera flys along a smooth path, or VR180 and Looking Glass portrait holograms.
* If I'm not mistaken this is the first NeRF-based VR stitching engine.
* Unlike NeRF Studio, Volurama does not require command line tools to install.
* Unlike Luma.ai, Volurama is a Windows/Mac application, which means you process your data locally rather than uploading it to the cloud.
* This is a custom/from scratch NeRF and structure-from-motion engine written in C++. It doesn't depend on COLMAP or NVidia's tinycudann. It incorporates ideas from several recent publications, as well as a few proprietary tricks developed at Lifecast.
* This is a 1.0 alpha release, and there are bound to be some bugs.
* Try it out and LMK what you think!
Lifecast (YCW22) - Volumetric video with layered depth images and AI-art
Today Lifecast unveils text-to-full 3D immersive environments that can be viewed in VR (e.g., Quest 2) or on 2D screens. We are doing this with a combination of Stable Diffusion and several other neural nets to make it 3D, combined with Lifecast's format for 6DOF VR photos and video. It's free to try and we do the processing in the cloud. Check it out and tell us what you think! This is version 1.0 and we are iterating quickly, so expect improvements in the future.
Stable Diffusion to 3D/WebVR, in the cloud, available now
https://lifecastvr.com/hubner4.html https://lifecastvr.com/dancewiththewind.html https://lifecastvr.com/trickshot.html
Please LMK if that works for you. Thanks.
In contrast, we do one view with 2 layers, and we composite them with no blending. This rendering/encoding is optimized to work with the limits of Quest 2.
The tool to create the videos right now is only available on Mac and Windows. We have an internal Linux build, but we aren't releasing it yet.
Launch HN: Lifecast (YC W22) – 3D video for VR
Hi HN, I’m Forrest of Lifecast (https://www.lifecastvr.com), with my co-founder Mateusz. We make software to create 3D video for VR, robotics simulation, and virtual production. We convert any VR180 video or photo into our 6DOF VR video format, or into meshes compatible with Unreal Engine. Our 3D reconstruction is based on computer vision for dual fisheye lenses and deep learning.VR video can...