My daughter's father has seen her for over 2 years, he lives in the same city as his daughter. I have tried to contact him to get a signature for passport and he won't return my calls. I wan't his parental rights to be removed so that his signature and/or consent is not require when it comes to all things pertaining his daughter.

In a word - impossible. You cannot force a parent to be an active parent OR take an interest OR not upset you. You CAN take him to Court for support. I presume you have.

READ THIS FIRST is posted at the top of this forum - did you read it?

https://www.askmehelpdesk.com/family-law/child-abandonment-read-first-364259.html

If you MUST have a passport for your daughter take him back to Court and request that he be ordered to sign.

It varies a little bit by State but he has not abandoned his child. You cannot force him to relinquish his rights.