Basically, it was all my fault and I accepted that.
No, his choice to have an affair was
not your fault. People do what they want to do. No one makes other people do something they don't want to do. You are not at fault for his affair. If there were problems in the marriage, he should have come to you and talked them out, not jumped into bed with another woman.
Now, he is saying he doesn't trust me.
He has no right to not trust you. You gave him the benefit of the doubt, stayed to heal your marriage, and still he doesn't trust you? Honestly, this man is not trustworthy.
Trust is earned, not given. When someone breaks your trust, you can forgive, yes, but there is a period in which that person should try to rekindle the trust that you once had. He is taking advantage of your trust.
Then I told him I wouldn't go and would spend the weekend with him and I got told that just makes me look even more guilty.
He's a jerk. I'm sorry, but he's a jerk.
When someone loses a father (I know, I lost mine), they
need their friends and family. It is not an option. You need to be there for her.
He is using you to satisfy his own guilt.
I love him, I truly do, I can not imaging life without him, but I don't know how much more of this I can take.
I seriously suggest marriage counseling. Separate
and together. He has issues that need to be dealt with - issues that a counselor will be able to address.
Honestly? I wouldn't put up with that behavior.