When emergency heat is engaged it doesn't shut off at the set point. But when the outside unit is running it is fine.

With that minimal info all I can say is since the thermostat controls both the inside unit and outside unit it seems that the thermostat might be defective or there is a short in the thermostat wiring.