I have a signed and notarized purchase agreement. The buyer gave me $5,000.00 down, the balance is 45,000. If he backs out of the deal, do I get to keep the $5000.00?

What does the purchase agreement say?

That's normally how an earnest money agreement works. As ma0641 asked, what does it say?