I'm a client, and my partner used to be an escort. We've both had our fair share of creeps and rude people (from clients sending him on false outcalls, to escorts rushing me when they had arrived late).
The ratio is obviously worse for the escorts because he will always meet more people than the client, but clients have also had their time wasted.
On the other hand - take it from an old dinosaur that you've never had it so good. My partner who is nearly the same age, had no Internet, no phone and no police support when he started escorting decades ago.