Life's too short to put up with his behavior. Sounds to me like he's spending way too much time and putting way too much effort into the other woman.