If this man is just a friend than you wouldn't be keeping it a secret from your husband.

So, do you still love your ex? Is he more than a friend and you're just fooling yourself into thinking that he's not? That's what it sounds like to me.

Either tell your husband that you're friends with your ex, or tell your ex that you can't be friends with him because you're married and you're lying to your husband.