Give him a chance, wait 15 mins. He was visiting and maybe he was trying to squeeze someone who either arrived late or called him at the same minute. It's a business and that practices is understandable, busy and boring days do happen.
For the record, even if the elevator requires a key I want to know his room number before I get there.