This is a male non-biting midge - a type of fly in the family Chironomidae that resembles mosquitos. It is
NOT a horntail wasp. I base my ID on the hump-backed thorax, the feathery antennae, and the swarms you found around your house. This swarming is also known as lekking and is to increase the chance of mating - a nightclub for insects, if you will.
Males frequently collect in large swarms in late afternoon or evening near streams, ponds, and lakes with mating occurring after females enter the swarm. They are often attracted to outdoor lights of houses close to these swarming sites. Ninety percent of the swarming activity will occur within 45 minutes of sunset.
Midges breed chiefly in water, but some develop in decaying vegetation, manure, or under the bark of trees. Because larvae occur in huge numbers in water, they are an important source of food for many species of fish. Midges overwinter in the larval stage. Some species larvae are known as bloodworms, because of their red color due to the presence of hemoglobin.
Adults emerge in the spring, frequently in large numbers, and are an important food source for birds and fish. Adults do not eat and have a short life span of five to ten days.
The general public should not attempt to control them since streams, ponds and lakes should not be treated with insecticides by inexperienced applicators. Fogging for adults is not practical. I would condone homeowner application of insecticides only if a pond is wholly contained on the homeowner's property.
Larvae of some species breed in brackish water or slow-moving water with lots of algae or choked with vegetation. Depending on your situation and the species, emptying ponds or the water source or otherwise speeding the flow or cleaning up the water is a control method that might be available to a homeowner.
Maintain and close your window screens and screen doors. Turn off your porch and driveway lights during dusk to lessen the nuisance. Switch to yellow, non-attractant, lights. They are attracted to bug zappers, but these should be placed as far from your house as practical, as they can attract more midges than they zap.
Non-biting midges are primarily a nuisance pest. They are seasonal and short-lived. They and the ponds and streams they live in are mostly beneficial. I would tolerate them.
BugGuide.Net - Chironomidae
North Carolina CoopExt - Non-Biting Midges
Missouri Extension - Chironomids