Don't take it to heart, he is protecting himself. To better explain this, he has probably learn or witnessed how cruel women have destroyed the lives of men by accusations alone, and how the #metoo movement and radical feminism have created this stigma that all men are potential rapists and are automatically guilty for evening making a woman feel uncomfortable without an explanation as to how. This isn't to shame you or most women, but there are women out there creating more problems in the workforce, resulting in the men at work or public events to be less inclined to interact with them. I still interact with women, because I personally haven't experienced what I'm explaining, however I am still careful with what I say, what I do, and how I look when I glare at a woman for longer than 1.5 seconds lol.
You've done nothing wrong, so I assure sure you that this is all in harmless consideration. He may just be protecting himself, because of the stigma that our western society has placed against men. If you're not in countries like America, Australia, or the UK, then I basically commented for no reason lol. Also, you might not want to stare at him, that could actually be the only thing that's keeping him from interacting with you.
Hope I Helped ^_^