Infidelity has nothing to do with the issue of who should get custody.

It will have little to do with custody, he could run off with new girl friend and still get joing custody.

Assuming that neither one of you are a threat to the children both can expect to get joint custody if they want it. Women still get custody more than men, but it is changing more and more esp for older kids.