Well, to be fair, majority of the population in Poland is white/caucasian. I spent last summer there with my Polish boyfriend and we made a game out of the number of people giving me "looks" as we went from one city to another, more out of curiousity than hostility though. From what I can recall, big known cities such as Warszawa & Kraków weren't as bad as, say, Poznań. Though it must be said, I did receive friendly smiles and gestures in spite of my uncommon ethnicity (the immigration officer said my Bruneian passport was the first he has seenin 12 years) and the language barrier.
I suppose being there for 2 weeks or so, I've gotten immune to it. All in all, it was a great holiday for me!