Scenario: The perfect storm; temp. outside zero or below, blowing wind, frost building up inside the exhaust pipe and furnice will not kick on! I have to go outside and remove frost buildup before furnace willl start. What do I need to do with pipe/pipes to prevent buildup?

I would try heat tape and insulation around pipe.

Does that exhaust pipe terminate pointing down? If not add and elbow to point it down