Well actually since comfort is a combination of temperture and humidity and season, ther is reason to have different temperatures.
The highest and lowest temperature you and/or guests feel comfortable at for summer and winter respectively saves the most energy.
With programmable thermostats, you can save even more energy by making it slightly warmer or cooler when your not home. Like upstairs is occupied at night only. Downstairs is occupied in the evening assuming you work during the day.
Heat pump systems may require more time to recover.