I have a Rhem Hot water heater which nis cycling on and off when it is trying to heat up. Eventually it gets up to temperature but it takes a while as it cyckes on and off. Controler, Thermostat?

Yep... thermostats go bad... in just about everything. Be careful you get an EXACT replacement.