Won't stay lit when I move it from set to pilot.

I'm not for sure what your saying? If you move the gas valve button to pilot--set and light the pilot and let off the button after the pilot is lit and the pilot goes out you have a weak pilot flame or a bad thermocouple.