If someone is colorblind, and another isn't, does that entail a change in perception? Sure. It means the colorblind guy can't discern things that people with normal vision can.
A person born blind can't see anything and never has. They don't even imagine visual images (only images informed by the remaining senses). Their perception is unimaginable to me and mine to them.
So if women can discern more colors than men, it follows that they experience more colors which seems like a matter of perception. Have you never argued with a woman about the color of a sweater?
Red, Brown, Blue, Gray, Blue, Green, Yellow, green, Gray, Blue. Those linear color spectrums never made sense to me as a color blind person.
Technically I only see blue and green, but since people call different shades of green so many different things I start to call them stuff like red and brown. So dark green is brown, then as you go brighter it becomes red, orange, green and brightest green is yellow. White is blue + green, and since red is green pink is just white with less intensity, so gray.
Edit: Anyway, most men are one chromosome color better than me. Most women are two chromosomes better at distinguishing color than me. Makes sense then that women are way better at telling them apart.
So yeah, that's a thing
Also, what you are describing is called Qualia, and that is intangible qualities of how the brain processes data, such as the "yellowness of a lemon", or the "foot pain of stepping on unexpected rock shoeless"
Qualia can't be verbalized or compared between people because it is an inherent "brainfeel", you just need to expect others to have "at least similar-ish" qualias