Exactly what I've been saying for a while! The connotations of the word "privilege" for many people distract from the point that the concept of "white privilege" is trying to get across, leading to endless rather futile arguments about whether people are or are not "privileged".
(Apart from anything else, "privilege" seems to me to imply something that is relatively rare and special...and white privilege, of course, is neither. It's commonplace.)
Having said that, it's the word we're stuck with; I don't see it changing.