You'll need to refinance in your name only and buy your ex out of his half.

The only way is for him to sign and execute a quit claim deed signing over his interest in the property to you. However, this has to be approved by your lender as most mortgages have a due on sale clause that could be triggered by such an action. That's where the refinance comes in.