I am trying to get the stick on house numbers off the vinyl siding on my house so I can replace them. Any suggestions?

Use a hair dryer to heat the vinyl letters and carefully peel the letters off. You can use mineral spirits together off adhesive residue. Do not use excessive heat!!