You can but it would be silly and probably futile since he is not your problem, your wife is. That's who should be sued, and if you can forgive her, then forgive him too. Are you still together?