The blower unit won't shut off. Is there a part I can buy that allow the blower(fan) to go off and on as it use too?

Something that old should have a manual set point fan on and off switch box on the plenum. As to whether you're can get parts is another story. Certainly something newer would be much more efficient. Is this a wall or central heater?