You make a good point, though different people perceive optical illusions differently. Remember the black/blue/gold/white dress? What colour should an AI call the dress when humans can't even decide? So it's actually even more complex than you might think.

This question also applies to audio illusions, such as the (in)famous Laurel/Yanny clip.