It is somewhat absurd to pretend we don't see colour at all, and equally absurd - not to mention dangerous - to make colour into the dominant defining characteristic of a person.
As so often, the correct path is surely through a middle ground: to see colour but not place undue importance on it.
Of course, it's also worth noting that we probably "see" some colours more than others. I encounter quite a lot of south Asians in everyday life (I live in England) but I hardly ever meet a native American, so the colour of the latter is likely to be more "visible" to me when I do.
Still, of course I am not completely oblivious of anyone's colour - just as I'm not completely unaware of their age, gender, or a dozen other things.