My well went dry and I would like to know how to prime my water pump which is located in my cellar

Assuming you have checked the breaker to make sure you have power to the pump, then you need to find a plug (might be a pressure gauge)on top of the impeller housing. Remove it and fill until full.