I have a Comfortmaker furnace that quite often fails to cycle off. I've changed thermostats three times and I still incur the same problem.

Next time this happens tap the gas valve and see if it shuts off.