In New Jersey, how do I go about petitioning the court to change mediators in a family court case?

You can simply file for it. Has the other party also agreed to the change? What is the circumstance that you want the change for ?

For a mediator, I agree with the earlier post. You can usually simply request a new mediator, however, I would be ready to have actual legal basis why, not just I don't like them.