From what you've posted, I do think that it appears you are more bothered by the downsides of the profession than most.
I'm not saying these "clients" aren't flakes; I'm saying it's something that's not likely to change and you probably need to find a strategy to slough it off because always being pissed off, regardless of justification, is likely to have negative spillover effects on both the business you do get and your everyday life.