My step son-in-law says he is going to give up complete rights to his children. The mother would have sole responsibility. Can he do that in Mississippi?

Sure he can do that, but it does not mean he is giving up his financial responsibility, only the responsibility to make legal and medical decisions regarding the children. He will still be responsible for them financially.