(iirc) color and favor are the 'original' english spellings, which are more alike to latin. the additional U is a result of french influence, specifically via the norman conquest of england.