Some guys don't like it. End of story. There's nothing to do but respect that.
And I do think it is something of an acquired taste. Long ago, I had a FB and the only thing he seemed to like was beating off while I rimmed him. Initially it seemed like a one-sided arrangement, but I began to notice that the more I did it, the more I liked it, so after a while, I was perfectly happy licking his ass while he stroked.