Part of the issue is the natural binary focus. If all states only have a positive / negative interaction with each other, then there can be no prime states other than 2. Silly Fry, 2's don't exist, only 1 and 0.

From a computer perspective, those are avoided kind of like how all games only want texture in 2 powers, because all other sizes are inconvenient. So everything that's ingested from media like video games is always arriving in a power of 2 format.