It's not always happy, no.
Sometimes I remember how badly my first boyfriend treated me when I see someone else in a similar situation, then realize how happy I am with my husband.
Sometimes it's just an event, a moment. Like sitting in the hot tub at a ski resort, or canoeing down a river, or seeing a specific band in concert together.