You have gotten you into a situation that will never turn out well for anyone. Salvage what dignity you have and cut all ties with this man. You will not ever have a healthy relationship with this man.
2 choices...
1. Continue to date a married man. WHICH WOULD BE COMPLETELY STUPID!!!
2. Have a life that is going somewhere. Take some time off to get your head on straight. Then think about starting a healthy relationship that has a future.
BUT NEVER PUT YOURSELF IN A POSITION TO GET INVOLVED WITH A MARRIED MAN!! No one wins.