My ex-husband has been in and out of prison. He has drug charges and domestic violence charges against him already. Right now he is under investigation for child molestation against a 5 year old girl. If he gets this charge can I take away his rights without him signing them over to me? I have been told by his family no, since he never hurt our son. I have been told by many others yes I can.