Should I turn off my furnace if the blower fan is not working?

Yes or it will overheat and trip or damage other component parts e.g. high temp switch.