I think this is the best outcome that everyone was looking for.
I'm really glad about your post, its clear and really covers the issues at hand. This is the exact type of insight you needed to help make a decision that is right for you.
"What isn't fine with me is that he never asked me to go to anything again. He never gave me a chance to say yes or no." I've personally experienced this and know the frustration you feel. When it came down to it and as time moved on, I learned that people who make the decision for you to not go, based on one event, turn out to not really be the type of friend or lover you want in your life.