He refuses to go we cannot make him we have tried and tried causing us stress. He won't give straight answers to why he won't go there seem to be many.

What is a contact order?

How old is the child? You need to go back to Court, have an advocate appointed, get the visitation order (if that's what you are talking about) changed. If the child refuses you can be held in contempt of Court as it stands now.