Time to return to court and file a Rule to Show Cause.

You aren't going to amicably come to an agreement. Return to court and have the rights enforced that are on paper.

And your husband needs to stand up to both his mother and his ex-wife for you. This isn't your battle, it's his.