If the mother of my husbands son signs her rights over so I can adopt him, how much will it cost to adopt him?

That depends on a LOT of things.

Your best bet is to contact a family law attorney in your area to get the ball rolling.