Guess what, most of us do it-and often! With a response you gave to him, I am not surprised he wanted some time for HIMSELF. Lighten up, perhaps if you do so-he would want to be with you a bit more often.
Perhaps you could have offered to do it for him, join in or just let him be. I don't know, just back off with the "disgust and shock" so much.