Many couples have open marriages. If both couples are okay with it, I see no problem with it. It's not for everyone though, and I'm not entirely convinced it's for you.

Why do you feel guilt? ...