Nope. Despite what you think about the possible bio father's potential as a parent that's not up to you to decide. The fact is that you have been willfully denying him his rights as a father. And the court is likely to take note of that.
The ball is in his court, if he wants to challenge paternity he can. You can then fight it by bringing up his history and the fact that your husband has established his relationship with your son.
