My ex husband and the father of my children has moved out of state barely calls the children and refuses to pay child support and it is affecting the children's phycological well
Fare my question is can his parental rights be taken from him if so how?

The short answer is no.