The movie I am trying to name is about: four kids who got sent to a kids jail and were sexually abused by a guard. Years later after they grow up, a couple of them go back and kill the man who hurt them. Anyone know the movie I'm referring to?

I believe you are looking for the film, "Sleepers".

Kevin Bacon was the lead and Robert De Niro played a Priest.

You beat me to it... yes, sounds like Sleepers. I watched it a few months ago. :o)

The book is MUCH better than the movie.