Is it OK to keep my furnace off until I need it for hot water (during the summer months), to save on oil?

Thank you

Yes but I would just install a electric water heater since the cost of oil is so high. If you turn off the boiler depending upon how it is set up it could take some time to heat the water.