depends on the cultural context,its not always on the basis of skin color; class boundaries also play a major part in it. Mostly its because we always need someone to look down on,don't know why but that tendency always exists in our minds, I'm sure there are a host of other factors ,just putting in my two cents.