My wife have an affair with someone.now we want a Divorce but we have four kids.I love my kids but I don't want to break them apart so I decided to leave them with her.will the judge make me pay the majority of the child support even she did wrong?

You will pay all of the child support if they are your children, not a "majority" the reason for the divorce does not matter, as for as child support, it is under the state law in the US>

So in general, it takes into consideration how much you make, how much mother makes and then how many kids.

If you don't want to pay support then you need to take or try to take custody of the kids and you raise them.

I do not understand why you mean by break them apart ? Do the kids have different dads ? If so, you will pay support for your kids.

...
So in general, it takes into consideration how much you make, how much mother makes and then how many kids.
....

Also, what portion of the time each parent has physical custody.