Incalls aren't an option? Most folks in big cities live in apartments/condominiums and see escorts and other visitors in their place all the time. No big deal!
You're 31 y/o! I'm sure you also will have hookups coming to your place.
meet him downstairs at the street door and use your key card for him to get into the building with you.
you can also go to his place if you want even more privacy.