Cultural Nuance

I thought to tell this man that he was dressed like a woman.  But then thought better of it since he might tell me that I’m dressed like a man.