Is the fan suppose to stay on the on position instead of automatic?

Typically not, but you can. It tends to give you more equal temp distribution but runs up your electric bill.