Do you turn the car off for it to cool, or leave it on?

Turn it off

In some cases you can drive and it will get cool... but that's when its overheating sitting in traffic etc.. But if you are moving and its overheating, pull over.