News for hackers. Stuff that matters.

mvoodarla

mvoodarla on Hacker News

Re:Correct eye contact in videos by redirecting the eyes to look at th... on Wednesday October 16, 2024 @12:55AM (#41855746)
Original dev here. Unable to replicate this on my end, try refreshing?
Re:Correct eye contact in videos by redirecting the eyes to look at th... on Wednesday October 16, 2024 @12:51AM (#41855731)
Original dev here. Unable to replicate this on my end, try refreshing?
Re:Correct eye contact in videos by redirecting the eyes to look at th... on Wednesday October 16, 2024 @12:20AM (#41855574)
Original dev here. I tend to agree for this particular demo video as I'm reading a book and I don't blink in the original.

The model tries to copy the blinks of the original video so it's possible that in other conditions, you'd notice less of this.

Fun to see this feedback though, definitely something worth improving :)

Re:Correct eye contact in videos by redirecting the eyes to look at th... on Wednesday October 16, 2024 @12:18AM (#41855561)
Original dev here. That's right, NVIDIA has a version available which we reference in our blog.

https://www.sievedata.com/blog/eye-contact-correction-gaze-c...

Newer models have come out that allow the same thing to be done and control even more than the eyes.

See here: https://github.com/KwaiVGI/LivePortrait/blob/main/assets/doc...

For web-conferencing, local use is great so NVIDIA's tools are what we recommend in that case.

Re:Correct eye contact in videos by redirecting the eyes to look at th... on Wednesday October 16, 2024 @12:16AM (#41855549)
This is an interesting idea. We are a little farther off from being able to do this but agree it would look really cool.
Re:Correct eye contact in videos by redirecting the eyes to look at th... on Wednesday October 16, 2024 @12:15AM (#41855542)
Original dev here. Agree this video looks like uncanny valley but it's likely because the lighting of the original video is off + I baggy eyes (I was sleep deprived).

Would recommend trying it on other videos, it is surprisingly good. Although there definitely are areas to improve.

Re:Show HN: Revideo – Create Videos with Code on Tuesday June 11, 2024 @04:55PM (#40651355)
Congrats on the launch! I work at Sieve (https://www.sievedata.com/). We do a bunch of stuff with AI and video. Excited to check this out :)
Re:Describe Beta: The most descriptive audiovisual summaries for videos on Friday March 15, 2024 @02:32PM (#39719128)
Hey folks! We just built a cost-effective, lightweight way to generate audiovisual summaries for videos.

* Process videos up to 12x faster than realtime * Costs <$0.01 / min of video * Combines visual and audial components

The goal here is not to build a single E2E model but something that could actually be used in production while preserving relatively high quality.

You can try it out yourself here: https://www.sievedata.com/functions/sieve/describe How we built it: https://www.sievedata.com/blog/describe-video-summary-beta-l... The code: https://github.com/sieve-community/describe

Older »