My unit is staying on 65 and does stay on more than 1 minute. It is very cold in the house and I have changed the filter and the batteries for the thermostat. So what is wrong with the unit?

We have no idea what kind of unit you have. Brand and exact model migh help us to figure out where to start.