If he is the bio dad, then he has just as many rights as you do; the bottom line is get a lawyer and get it settled. I doubt if you will lose custody; if he can't prove he has a means of support to...