News for hackers. Stuff that matters.
Re:Hyper-realistic digital humans in Unity by dylan604 on Tuesday March 22, 2022 @04:56PM (#30771427)
>achieve this level of fidelity using a deep learning-based compression

what does that mean? To me, they might have just as well said middle out compression.

Re:Hyper-realistic digital humans in Unity by greysphere on Tuesday March 22, 2022 @05:28PM (#30771800)
I'd guess a 4d version of: https://paperswithcode.com/method/nerf
Re:Hyper-realistic digital humans in Unity by teddykoker on Thursday March 24, 2022 @10:00AM (#30789860)
This might be what you’re looking for: https://gafniguy.github.io/4D-Facial-Avatars/
Re:Hyper-realistic digital humans in Unity by lagrange77 on Tuesday March 22, 2022 @05:06PM (#30771547)
I guess this means dimensionality reduction for example with the use of a convolutional autoencoder.
Re:Hyper-realistic digital humans in Unity by pistachiopro on Tuesday March 22, 2022 @05:02PM (#30771505)
Unity recently acquired Ziva, which specializes in the detailed animation of humans and other animals. They were known for their (not realtime) physics-based solutions, but now they have an ML model for faces, apparently. As far as I know, it's still in beta and not widely available. Unity says they will re-release this demo with the Ziva face in a matter of weeks and the quality will be even higher. And possibly allowing interactivity as well?? I guess we'll see in a few weeks.
Re:Hyper-realistic digital humans in Unity by motoboi on Tuesday March 22, 2022 @05:31PM (#30771835)
Superresolution. You have a lower resolution animation (less pixels = less calculations) and then use superresolution to turn that into a 4K image. This is reality right now for NVIDIA GPUs ( I think it’s called DMSS)
Re:Hyper-realistic digital humans in Unity by cma on Tuesday March 22, 2022 @06:24PM (#30772386)
They are talking about compressed geometry, not pixels. This is more similar to alembic and other geometry streaming tech https://en.wikipedia.org/wiki/Alembic_(computer_graphics)

There is one out there from 5 years ago or so that is similar to Google's Seurat but for animated stuff, I think pre-baking triangle culling for different views within a limited volume. I can't remember the name of it, from the details I remember (there was a realistic orangutan or something like that rendered with fur) I should be able to find it on Google, but Google search has become degraded recently.

Re:Hyper-realistic digital humans in Unity by pistachiopro on Tuesday March 22, 2022 @05:43PM (#30771968)
Nvidia DLSS is an important part of how they achieved 30Hz at 4k resolution, but that's more of a shading assist and doesn't affect the animation. The facial animation will be compressed with Ziva's ML solution.
Re:Hyper-realistic digital humans in Unity by subpixel on Tuesday March 22, 2022 @05:55PM (#30772066)