My boyfriend is a convicted felon from 12 years ago

I was married to a man who used me for money, cared nothing for our children, and was verbally abusive. Months after filing for divorce and separating from my husband, I ran into an old friend from high school and we began dating. Over 12 years ago, my boyfriend had a felony conviction. Nothing current, as I would never allow anyone doing anything illegal or harmful around myself or my children. Although I specifically told my attorney that I would not agree to anything saying that this man could not be around my children, she signed a temporary agreement saying that my children were not allowed around a convicted felon and gave me a copy only after it had been sent to the judge. (I later found that my ex's attorney is a former partner of my first attorney)

My second attorney said that she could file a request to amend the temporary agreement, but would prefer to just settle the divorce within a month and have the felon language removed from the final paperwork. Not knowing the law, I trusted her advice and we did not file the amendment request.

Although the children were around my boyfriend a few times, my husband cancelled the first court date that he set to Modify Custody when I lost my job and there was no money in it for him. Once I became employed again and thousands were up for grabs, he took me to court and the judge found me in contempt and gave him temporary custody. At no point during the hearing did anyone say anything to suggest that my children had ever been in danger or that I had been anything less than a doting mother. My ex had taken the children to counseling and he even admitted in court that the counselor found nothing of concern and that he (my ex) had no concerns as to me caring for the children.

My children are now showing severe signs of suffering from the lack of attention and nurturing and I desperately need to regain custody. Please offer any advice that you feel may help.