Re:The Tech of Pixar: Piper (2017)
by Animats on Friday November 08, 2019 @01:35AM
(#21480374)
The approach is straightforward. "Every shot in Piper is composed of millions of grains of sand, each one of them around 5000 polygons." With enough compute power, you don't have to fake as much.
Re:The Tech of Pixar: Piper (2017)
by Joeboy on Friday November 08, 2019 @04:38AM
(#21480962)
Unless you're looking at it very, very closely, does 5k polygon sand look any different from 500 polygon sand, or even 50 polygon sand? Even the very close ups in the article look like they'd be much the same with a lot fewer polygons.
Re:The Tech of Pixar: Piper (2017)
by BubRoss on Friday November 08, 2019 @12:19PM
(#21484378)
No, it does not. 5000 polygons condensed into a fraction of a pixels becomes a matter of statistical distributions. Effects like displacement and bump mapping have different looks if you filter them to get one value per pixel. The illumination changes because you get one averaged normal instead of distribution of normals that would occur naturally.
To have this much detail is a brute force and overkill way to get the distribution of samples that you really want on a sub pixel level, but sometimes these things are done in film because with a lot of pain you can make it work.
In this case if they did actually do that, it is through instancing, which in a sense could be thought of as a lookup with polygons to ultimately get that distribution. Usually a huge amount of samples are needed to deal with aliasing as well.
Re:The Tech of Pixar: Piper (2017)
by Joeboy on Friday November 08, 2019 @05:02AM
(#21481043)
Also says:
> Every shot in Piper is composed of millions of grains of
> sand, each one of them around 5000 polygons.
I'm guessing the article is just confused. The important point, I think, is about using real geometry for sand particles rather than the beach being a surface with a displacement map.
Re:The Tech of Pixar: Piper (2017)
by jobigoud on Friday November 08, 2019 @07:29AM
(#21481622)
But with instancing. So they could have a few dozens of grain types 5K tris each and the total number is from instances, no need to load 5 billion triangles into memory.
Re:The Tech of Pixar: Piper (2017)
by mschaef on Friday November 08, 2019 @08:47AM
(#21482080)
What does that look like from a data structure perspective? Each grain has a bounding box and you only look at the geometry for that grain if a ray crosses the box? (I'm way, way out of my wheelhouse here, if it's not already obvious.)
Re:The Tech of Pixar: Piper (2017)
by w0utert on Friday November 08, 2019 @10:47AM
(#21483257)
Reduced ad absurdum I thinks that is pretty much how it works. There is an acceleration structure that is traversed for each ray, to reduce the search space for ray-geometry intersections (probably a bounding volume hierarchy of some sorts), and using instancing only a very small subset of the total of all grains of sand actually need to be stored and processed. I imagine the sand is modeled using some particle system where each particle is actually a small scene of sand grain models in itself, with its own BVH etc, and the raytracer somehow reuses whatever happens inside them for every other particle that has the same lighting conditions.
It’s probably way way more complicated than that though. Extremely interesting stuff.
Re:The Tech of Pixar: Piper (2017)
by wmertens on Friday November 08, 2019 @03:21AM
(#21480683)
This was a fascinating and humbling read, and only after reading did I realize this was almost 3 years old… What are they animating now? Snowstorms with individual unique flakes?
Re:The Tech of Pixar: Piper (2017)
by knolan on Friday November 08, 2019 @07:01AM
(#21481495)
The article makes the point that it became inefficient to use displacement maps due to their size ballooning beyond '36 times' what they would normally use. So this means that the ground displacement map was just not detailed enough and pushing it to higher resolutions didn't scale. Instead they used Houdini to generate sand grains, I presume Houdini used some sort of displacement map per grain? The final result is a mesh nevertheless.
They also mention that, "this result was driven by a combination of culling techniques including camera frustum, facing angles and distance, creating a variance of dense to coarse patches of sand for optimum efficiency."
So while they had grains each of ~5000 polygons available to them and positions that they could occupy, they cut down on that polygon count using a combination of techniques (many common in games too) to make it all work. So the polygons of any grains outside the camera frustum were ignored. The faces of the grains point away from, I presume, any light source and therefor not contributing to the path tracer were ignored and also some soft of LOD to reduce polygon count as distance.
Re:The Tech of Pixar: Piper (2017)
by willis936 on Friday November 08, 2019 @07:57AM
(#21481774)
Doesn’t aggressive culling present issues with ray traced lighting? If you remove an umbrella that’s behind the frustum then a shadow in the scene is missing. Even harder is if you cull a second layer of sand grains then you don’t get the light that reflects off of them (assuming partial transparency of grains).
Re:The Tech of Pixar: Piper (2017)
by berkut on Friday November 08, 2019 @12:43AM
(#21480208)
Indeed. And rumour is they've stopped doing them now.
On the VFX side of the industry we were often jealous of Pixar and Dreamworks being able to do shorts, in terms of having the scope and ability to test out new tech / pipelines.
Re:The Tech of Pixar: Piper (2017)
by mlyle on Friday November 08, 2019 @02:39AM
(#21480563)
They're still doing them, but they may not be featured before pictures anymore. They've found different distribution channels (YouTube, Disney+, Disney Channel, etc).
https://imgur.com/a/IZLxQyZ
and this is 520 triangles:
https://imgur.com/a/EGxKsV5
To have this much detail is a brute force and overkill way to get the distribution of samples that you really want on a sub pixel level, but sometimes these things are done in film because with a lot of pain you can make it work.
In this case if they did actually do that, it is through instancing, which in a sense could be thought of as a lookup with polygons to ultimately get that distribution. Usually a huge amount of samples are needed to deal with aliasing as well.
> Every shot in Piper is composed of millions of grains of
> sand, each one of them around 5000 polygons.
I'm guessing the article is just confused. The important point, I think, is about using real geometry for sand particles rather than the beach being a surface with a displacement map.
It’s probably way way more complicated than that though. Extremely interesting stuff.
I'm not ashamed to admit I teared up a bit at how good it was.
[0] https://www.youtube.com/watch?v=LKFuXETZUsI
https://en.wikipedia.org/wiki/Frozen_(2013_film)#Technology_...
They also mention that, "this result was driven by a combination of culling techniques including camera frustum, facing angles and distance, creating a variance of dense to coarse patches of sand for optimum efficiency."
So while they had grains each of ~5000 polygons available to them and positions that they could occupy, they cut down on that polygon count using a combination of techniques (many common in games too) to make it all work. So the polygons of any grains outside the camera frustum were ignored. The faces of the grains point away from, I presume, any light source and therefor not contributing to the path tracer were ignored and also some soft of LOD to reduce polygon count as distance.
As an amateur blender user I'm reminded of microdisplacement as a way for us mere mortals to achieve something in this space: https://www.blenderguru.com/tutorials/introduction-microdisp...
Didn’t understand most of it, but it is a jaw-droppingly beautiful short, and the stills in the article are well worth the skim.
On the VFX side of the industry we were often jealous of Pixar and Dreamworks being able to do shorts, in terms of having the scope and ability to test out new tech / pipelines.
Pixar was the last holdout for maya, they only converted in the last few years
https://www.fxguide.com/fxfeatured/the-tech-of-pixar-part-2-...