He may truly want to develop a long lasting friendship with you and that may be the reason why he doesn't want to have sex with you. He knows that his sexual encounters are one and done and haven't led to anything meaningful. So he doesn't want that kind of connection with you. Just think if you develop a good connection over time and enjoy being with each other which may eventually lead to sex, what a deeper, meaningful sexual connection that could be.