Did you start the conversation telling him the strict dress code or did you mentioned that later after exchanging several messages?
Did he ask you to come to his place instead?
Considering it's NYC I'm sure there plenty of other choices and I'm surprised THIS request was an issue to him. I guess you don't want to tell us his name, but did you search on here to find out if we've talked about him before?