I think you both should leave. Why commit yourself to a miserable life? If there are no children then go - go and try to find someone who you don't have to try so damn hard with. Life is hard...