If you are "common law" although most places never reconise it any longer.

If if you are, yes you will have to get a divorce to get married again.