Without a visual inspection identifing the wasp or bee species is not posible with what you have posted.

Take a dead sample to your nearest dept of agriculture office in your state.

Useing aesol can spray from your hardware store will contain kerosine as a carrier agent. (unless you can find a water based product) unless you are on a city water supply on their are no wells within a minimum of 1500 ft of the area you are treating you will contaminate your water supply and damage your septic system. If your on a well have it tested weekly for next 6 months for contamination.

Use a water base or make your own in a hand sprayer containing permthrin, cypermethirn. Make sure the lable allows for application to wasps

Post area you no one walks into treated area for at least 48 hours.

Since you most likley used and oil based product do not use or consume any produce grown next to treated area for a minimum of 8 to 12 weeks to allow natural bacteria to decompose the kerosine.