Stable Video Diffusion

Re:Stable Video Diffusion by mikebelanger on Tuesday November 21, 2023 @09:58PM (#38374178)

Yeah I'd imagine that's the best way. Lots of LLMs can generate workable Python code too, so code that jives with Blender's Python API doesn't seem like too much of a leap.

The only trick is that there has to be enough Blender Python code to train the LLM on.

[ Parent | on HN ]

Re:Stable Video Diffusion by arcticbull on Tuesday November 21, 2023 @10:42PM (#38374499)

Maybe something like OpenSCAD is a good middle ground. Procedural code-like format for specifying 3D objects that can then be converted and imported in Blender.

[ Parent | on HN ]

Re:Stable Video Diffusion by lightedman on Wednesday November 22, 2023 @12:56AM (#38375201)

I tried all the AI stuff that I could on OpenSCAD.

While it generates a lot of code that initially makes sense, when you use the code, you get a jumbled block.

[ Parent | on HN ]

Re:Stable Video Diffusion by regularfry on Wednesday November 22, 2023 @03:32AM (#38376564)

This. I think problem is that the LLMs really struggle with 3d scene understanding, so what you would need to do is generate code that generates code.

But also I suspect there just isn't that much openscad code in the training data, and the semantics are different enough to python or any of the other languages that are well-represented that it struggles.

[ Parent | on HN ]