I would like to know if my kids real dad signs over rights do I have to have my new husband adopt them? He is going to sign over all rights to them.

Well he can sign over his rights if he wants to, that does not really mean a lot, only he can't visit. If your husband wants to adopt, he has to sign all of his rights over with permission to adopt.