I have a moderate colour vision deficiency and I sometimes experience something very similar with colours.

I'll see a bunch of things, all the same colour. Then I'll realise it's supposed to be colour coded and they'll start swapping colours until they settle down. Sometimes correctly, sometimes not.

I had this a lot in school with red and green on the whiteboard.