Yes he did say that one line in one speech. But if you review the totality of his writing, it is very clear that total colorblindness in the face of inequality was not his goal. The "I Have A Dream" does not represent some shift away from an earlier opinion. It simply doesn't represent the opinion that a lot of reactionaries think it does.