I have 4 cats and the 3 that are under a year old have been going to the bathroom( Both ways) in my house. I have a litter box that is cleaned out every other day. How can I get them to stop going in my house?

It is perfectly normal for cats to use a litter box; they are very clean. Possibly I don't understand your question but you would have to let them out when they want to go out to do their business if you take the litter box away.

Is this your question?

Do you mean that they are inappropriately using the bathroom on the floors and carpets?
Are they neutered and spayed?
Have you taken them to the vet to rule out medical issues like urinary tract infection?