My ex already lost rights to one child... I underst and why... he has never seen him and only talked to for twp that I was pregnant with my son... I'm just trying to protect my child...

Depends on where you are at. And what is in place now. Is there a child support order in place, is there a child custody order in place. What type of visits has the court given him.

Seldom unless he is a danger to the child will they take rights away, Here in GA for example, merely not paying child support and not visiting the child is not enough to take away their rights as a parent.

Generally, involuntary termination of parental rights requires that the parent be a clear and present danger to the child.