You can maybe retain 99.9% of the color information humans can perceive, but that is a very small part of what's in the visible spectrum signal.

Maybe this example will clarify: Our eyes can not tell the difference between monochromatic green light (540nm) and a mix of blue (470nm) and yellow (580nm) light.