They go in through a little hole in the side of the house since the cement is chipped and the hole there just hoes straight down

Are they bumble bees or yellow jackets? Mix up some Sevin dust in water and squirt it in the hole with a syringe or baster, do it at night. Sevin is very toxic for bees. When they get the mix on them they will try to clean themselves and BINGO.