If the mother is remarried and the new husband wants to adopt, he may give up his rights to allow the adoption.

That is about the only way he can give up his rights.

There are even tight restrictions on the mother taking them away, normally for long prison term or a seroius danger to the kids. In GA even not paying support and not seeing the child can be used to take rights away.