If this happened to me and my fiancé, hell I'd be happy with the stuff that is going on... Not to make light of your situation, but this is not a deal breaker problem IMO... It is hard to say it to someone you care about... You fear that you will be looked down on or simply ignored... But you have to do it... You've got to get that nerve up to tell him... Make him listen.. If he doesn't want to listen then enjoy being single a bit and see what happends...