My 5 year olds sons dad is a drug addict and when ever I let him see my son he does not care for the child and also he has never supported the child or does not make a real effort to be in him life. The same man caused me to be involved in a court case involving the state of Florida for over 4 yrs in doing this I had to prove to them that I was not using drugs, I ultimately got my daughter back but I do not want the same thing for my son! What do I have to do to revoke this mans rights to my son? He is a very bad influence on this child and I am getting married and my future husband wants to adopt my son and raise him as his own. I am afraid that my sons dad will find out where I live and try and take my son from me... He is a very violent and dishonest person who does not need to be around my kids

...when ever I let him see my son he does not care for the child ...
I am afraid that my sons dad will find out where I live and try and take my son from me ...

What proof does he have that he is the father?

Were you married to the man?
Is he on the birth certificate?
He has at least some proof: you let him be with the child, and expected him to care for the child, as though he were the father.

As the (apparently) acknowledged father, and without a court order in place, he arguably has as much right to the child as you do. You need to obtain a court order giving you exclusive custody.