Re:Where we see shapes, AI sees textures
by joe_the_user on Monday July 08, 2019 @06:34PM
(#20387384)
The "bag of features" work seems plausible but I recall from a reddit discussion that "just as well" might be stretching it. I recall it worked OK for a fairly small set but not for a larger set. Still, some references would be nice.
I think MNIST is too simple to have much bearing on the problem. MNIST shapes are two-dimensional; actual object classification requires 3D shapes (and all possible projections thereof), which is a much harder problem.
Since this is just a message board discussion, my wild conjecture would be that the model has no idea about the existence of the third dimension, or basic physical concepts like lighting and distance. And without that larger world model in which to situate things, texture is maybe the easiest thing to cling to.