Would you remain friends with someone who talk bad about you around their close family?

I found out my best friend talks recalling bad about me around his close family. Brothers, sisters mom dad and girl friend. Hes says nice things about me around everyone else like friends and coworkers or cousins.

I know that saying what other people think about you is none of your business. Is that that case here?