Why is it disrespectfull/ rude to wear a hat at the dinner table?

We've established that it is disrespectful/rude (same thing really). But what is the logical reason as to how/why? How does one wearing a hat to the table show disrespect/how is it rude?
6 answers 6