Or are there pull chains? If you have neither find the breaker controlling this circuit and shut it down. Then open the canopy and disconnect the wires. Your issue is not with the power supply but...