With the therostat not connected the baseboard heaters stay on. Can only turn off using the breaker.

The heat you are observing could just be from convection, meaning it is hot water from within the boiler traveling to higher places. This happens if there aren't any zone valves on the system. Now on the otherhand, if your system is actually cycling that is a whole different story... could you please specify, thank you