Replace the thermalcopling but pilot will not stay lit when I turn knob to on after lighting the pilot

Does pilot lit stay lit after you release the button and before you turn to "ON"?