You do raise a good point, but for certain applications like photography, microscopy, telescopy this can be avoided by putting the analogue chip before the digital conversion happens, so that you receive an image with layers, one containing color data, another containing edge data.

I'm fairly sure that modern cameras already have multiple layers for depth and color.