News for hackers. Stuff that matters.

A comment on Sora is here. Parent comment

Re:Sora is here by letmevoteplease on Monday December 09, 2024 @05:12PM (#42371124)
Shane Carruth (Primer) released interesting scripts for "A Topiary" and "The Modern Ocean" which now have no hope of being filmed. I hope AI can bring them to life someday. If we get tools like ControlNet for video, maybe Carruth could even "direct" them himself.
[ Parent | on HN ]
Re:Sora is here by spoaceman7777 on Tuesday December 10, 2024 @12:33AM (#42374075)
This exists already actually. Kling AI 1.5. Saw the demo on twitter two days ago, which shows a photo-to-video transformation on an image of three women standing on a beach, and the video transformation simulates the camera rotating, with the women moving naturally. Just involves a segment-anything style selection of the women, and drawing a basic movement vector.

https://x.com/minchoi/status/1862975323433795726

[ Parent | on HN ]
Re:Sora is here by Der_Einzige on Tuesday December 10, 2024 @09:01AM (#42376882)
Controlnet for video is just controlnet but ran frame by frame resulting in AI Rotoscoping.
[ Parent | on HN ]