Cats often seem to care about their owners. Not talking about you, but I think sometimes they sense when stuff is off about someone and get an "arrogant" expression. And if ppl are mean to the cat somehow, even if they don't realize they're being mean. People are mean to cats all the time, shoving them off of them bc they're getting fur everywhere. Which of course most ppl don't want fur on them, I've been known to push cats away as well, but cats are effected by it. Sometimes ppl wonder why cats act a certain way, like snobbish, but really it's like a mirroring of how the person treated the cat. It's true that sometimes cats just stare at someone thinking they're an idiot. Pets are also known to be easily effected by abuse. So it's not always the person, there may be a history if the cat is skittish and doesn't like being pet.