Its easier to ask him why he feels that way, than take it personally and forever be worrying about it. Unless he has input, he cannot know how he makes you feel.
Usually when someone cannot accept certain things about you, they aren't looking at you as a person, but what they expect you to be. That's not good or healthy, unless you can understand the why of how he feels, and know what he wants to do about it. Its up to him to adjust his thinking, and you to decide if his feelings are reasonable to you, or not.