>Imagine trying to scan a diamond-plate floor panel. The diamond design pattern would be perceived as noise, and the optimizations would attempt to normalize the data to be a flat surface.

I bet you could get around this somewhat if you matched the 3D data up with a normal 2D image, processing it to figure out textures and subtle features.