News for hackers. Stuff that matters.
Re:Stable Video Diffusion by p1esk on Tuesday November 21, 2023 @02:56PM (#38369162)
Are you working on all that?
Re:Stable Video Diffusion by cptaj on Tuesday November 21, 2023 @03:24PM (#38369544)
Probably not. But there does seem to be a clear path to it.

The main issue is going to be having the right dataset. You basically need to record user actions in something like blender (ie: moving a model of a bike to the left of a scene), match it to a text description of the action (ie; "move bike to the left") and match those to before/after snapshots of the resulting file format.

You need a whole metric fuckton of these.

After that, you train your model to produce those 3d scene files instead of image bitmaps.

You can do this for a lot of other tasks. These general purpose models can learn anything that you can usefully represent in data.

I can imagine AGI being, at least in part, a large set of these purpose trained models. Heck, maybe our brains work this way. When we learn to throw a ball, we train a model in a subset of our brain to do just this and then this model is called on by our general consciousness when needed.

Sorry, I'm just rambling here but its very exciting stuff.

Re:Stable Video Diffusion by sterlind on Tuesday November 21, 2023 @05:18PM (#38371197)
The hard part of AGI is the self-training and few examples. Your parents didn't attach strings to your body and puppeteer you through a few hundred thousand games of baseball. And the humans that invented baseball had zero training data to go on.
Re:Stable Video Diffusion by p1esk on Tuesday November 21, 2023 @07:55PM (#38373082)
Your body is a result of a billion year old evolutionary optimization process. GPT-4 was trained from scratch in a few months.
Re:Stable Video Diffusion by filipezf on Tuesday November 21, 2023 @06:40PM (#38372249)
I have for some time planning to do a 'Wikipedia for AI' (even bought a domain), where people could contribute all sorts of these skills ( not only 3d video, but also manual skills, or anything). Given the current climate of 'AI will save/doom us', and that users would in some sense be training their own replacements, I don't know how much love such site would have, though.