Why do we have a sexual relationship and he pulls away to end it, then comes back to what he had?

Say no to sex and see if he changes the game he's playing.