News for hackers. Stuff that matters.
Re:Skybox AI: Use AI to generate 3D worlds by mdorazio on Friday June 02, 2023 @12:11PM (#36167010)
I was hoping someone had found a better way than radiance fields to generate actual 3D models. This is creating 360 panoramic images, which are not "3D" unless I'm missing something. Still impressive tech, though.
Re:Skybox AI: Use AI to generate 3D worlds by dorkwood on Friday June 02, 2023 @12:16PM (#36167073)
It looks like the final image is rendered as a cubemap in the shader. Cubes are technically 3D.
Re:Skybox AI: Use AI to generate 3D worlds by sidewndr46 on Friday June 02, 2023 @01:08PM (#36167851)
is there a way to export it to geometry with textures?
Re:Skybox AI: Use AI to generate 3D worlds by jdiff on Friday June 02, 2023 @02:39PM (#36169050)
If a cube or sphere are acceptable geometry, sure.
Re:Skybox AI: Use AI to generate 3D worlds by all2 on Friday June 02, 2023 @12:16PM (#36167074)
It is called "skybox" AI, a reference to sky boxes from video games.
Re:Skybox AI: Use AI to generate 3D worlds by mefarza123 on Friday June 02, 2023 @01:08PM (#36167854)
I found some papers with propose alternative methods (source: https://MirrorThink.ai):

1. Point-NeRF: Point-based Neural Radiance Fields - 2022: This paper presents Point-NeRF, a localized neural representation that combines volumetric radiance fields with point clouds to model complex local scene geometry and appearance. It achieves better rendering quality than NeRF and is more efficient in reconstructing complex and large-scale scenes.

2. TensoRF: Tensorial Radiance Fields - 2022: TensoRF proposes a tensorial radiance field representation that can achieve fast reconstruction and high rendering quality. It is significantly faster than NeRF and many previous methods.

3. GazeNeRF: 3D-Aware Gaze Redirection with Neural Radiance Fields - 2022: GazeNeRF incorporates 3D awareness with gaze redirection by applying a rotation matrix to the disentangled eyeball feature maps. It represents a static scene with multi-layer perceptrons and maps the 3D positions and viewing directions to a density and radiance for generating novel views with volume rendering.

[1] https://arxiv.org/abs/2212.04823

[2] https://arxiv.org/abs/2203.09517

[3] https://arxiv.org/abs/2201.08845

Re:Skybox AI: Use AI to generate 3D worlds by underanalyzer on Friday June 02, 2023 @02:00PM (#36168582)
@dang this account appears to be low effort ai generated spam presumably to promote MirrorThink.ai (look at the past comments)

Regardless this answer does not responded to the parent comment's question at all since all of these papers are about radiance fields.

Re:Skybox AI: Use AI to generate 3D worlds by com2kid on Friday June 02, 2023 @01:24PM (#36168091)
If you check out their Discord they have tools in (closed I think) beta that generative full 3d scenes. Lots of really cool demos get posted their daily. I'd actually say that as someone using it purely for panorama generation that I'm in the minority of use cases.
Re:Skybox AI: Use AI to generate 3D worlds by jahewson on Friday June 02, 2023 @01:30PM (#36168165)
Check out https://nerf.studio it can do some mind-bending stuff.
Re:Skybox AI: Use AI to generate 3D worlds by underanalyzer on Friday June 02, 2023 @02:02PM (#36168618)
while nerf.studio is impressive, the parent comment is asking about radiance field free methods. NeRF stands for Neural Radiance Fields and all of the algorithms in that repo use radiance fields
Re:Skybox AI: Use AI to generate 3D worlds by gumballindie on Friday June 02, 2023 @02:20PM (#36168843)
I do it with heightmaps. It can generate human faces, rocks, planets, terrains, all at high detail. There is no need for attempting to generate 3d models for everything, when you can create “blueprints”.
Re:Skybox AI: Use AI to generate 3D worlds by anonzzzies on Saturday June 03, 2023 @03:20AM (#36174451)
Can I make these my office in VR? On the Quest 2?