This is actually what has happened. You were not ready to give up the teachings of your family - therefore I don't think you were willing to give it all up for him.
After his two attempts of 'emancipating' himself from his family's teachings, he gave up and will live his live accordingly.
I sincerely hope you find someone who your family approves of and that you will get your share of love and happiness.
http://smileys.smileycentral.com/cat/15/15_9_16.gif And your memories will be what you make of them. We have no control over anyone else's memories, so don't worry about him.