It's one thing not to be sexually attracted to your partner. Maybe age and hormones are slowing down your sex drive.

It's another thing to not be sexually attracted to your partner, but be sexually attracted to someone else. That would be a problem. Your desires will interfere with your current relationship.