I don't know what type of relationship you and your partner have, but if he is not happy and you care about him, then you should discuss the status of your relationship.
You should not have to change for him, and he should not have to change for you.