I fully agree with many of your points, but the requirement for power isn't inherent to the usual definition of racism.

People can speak of "racism" and simply mean what you call "prejudice". They're not wrong to use the word (though I certainly agree it would be pretty difficult to argue there is *systemic* racism against white people).