My oil furnace only blows out cool air, what do I need to do to fix this problem

Unless you know how to service a oil burner I would leave it to the professionals.

Now if you can find the reset button and you know for sure you have oil you can press the reset one time to see if it will come on and burn. If not call for on site professional help.