Re:Sora: Creating video from text
by theLiminator on Thursday February 15, 2024 @03:42PM
(#39388495)
I suspect given equal effort into prompting both, Sora probably provides superior results.
Re:Sora: Creating video from text
by dragonwriter on Thursday February 15, 2024 @05:11PM
(#39389849)
> I suspect given equal effort into prompting both, Sora probably provides superior results
Strictly to prompting, probably, just as that is the case with Dall-E 3 vs, say, SDXL.
The thing is, there’s a lot more that you can do than just tweaking prompting with open models, compared to hosted models that offer limited interaction options.
Re:Sora: Creating video from text
by karmasimida on Thursday February 15, 2024 @03:37PM
(#39388419)
Generate stock video bits I think.
Sure, for people who want detailed control with AI-generated video, workflows built around SD + AnimateDiff, Stable Video Diffusion, MotionDiff, etc., are still going to beat Sora for the immediate future, and OpenAI's approach structurally isn't as friendly to developing a broad ecosystem adding power on top of the base models.
OTOH, the basic simple prompt-to-video capacity of Sora now is good enough for some uses, and where detailed control is not essential that space is going to keep expanding -- one question is how much their plans for safety checking (which they state will apply both to the prompt and every frame of output) will cripple this versus alternatives, and how much the regulatory environment will or won't make it possible to compete with that.