News for hackers. Stuff that matters.
Re:Runway – Create impossible video by fxtentacle on Thursday July 08, 2021 @03:45AM (#27769282)
Forgive my ignorance, but that looks like someone created a GUI for the TensorFlow Hub, which is a public collection of pretrained AI models.

AI Masking: check

AI Depth estimation: check

AI Flow estimation: check

Flicker artifacts just like the public AI models: check

EDIT: Also, this isn't actually new anymore? A quick check found two very similar startups: unscreen.com vfx.comixify.ai And AI rotoscoping has been part of DaVinci Resolve 17 since Februrary: https://www.blackmagicdesign.com/products/davinciresolve/wha...

Re:Runway – Create impossible video by endymi0n on Thursday July 08, 2021 @03:59AM (#27769355)
None of what Dropbox did was impossible before either (cue famous comment: https://news.ycombinator.com/item?id=9224 ).

Us nerds often forget that possibility and usability are not nearly the same.

Usage happens when non-technical people like editors are able to get their hands onto the technology.

Re:Runway – Create impossible video by rikroots on Thursday July 08, 2021 @01:13PM (#27774977)
Creating a GUI fort TensorFlow (or MediaPipe) is not a bad thing in itself, yes? For one thing, we need more After-Effects-like tools - particularly if they can be browser based and cheap/free to use.

The ML people don't make it easy to work with the output their models produce. I was playing with TensorFlow/MediaPipe last month, to see if I could get them to play nicely with my canvas library. The results were quite promising[1][2][3]. Still, I think making it easier for devs to use these ML models in various ways needs to be prioritized.

CodePen links (all request access to the device camera):

[1] - TensorFlow body-pix model - hide the background in various ways - https://codepen.io/kaliedarik/pen/ZEeoZaP

[2] - MediaPipe Selfie Segmentation model - hide the background in various ways - https://codepen.io/kaliedarik/pen/PopBxBM

[3] - MediaPipe Facemesh - draw on the face in real time - https://codepen.io/kaliedarik/pen/VwpGrVG