I think I am going to show up in court just to make sure.

Is a "stipulation of settlement and vacating default judgement" something that the court can deny? I see no reason because both parties are agreeing to it. The letter states that the Clerk may vacate default judgement against me at any time without further notice to any party.

No, it sounds exactly like what you want. You just need to make sure its submitted.