All good suggestions from the other posters.
Look into this site,
Setting Personal Boundaries - protecting self
IF you feel the need to talk to him,, make up your mind on how far you are willing to let things go, set a boundary, for your protection,and your daughters.
It seems he has visitation with her?If so,you are going to have to deal with him at one point or another.Having a line drawn in the sand will make a clear picture for him to see, not allowing him to cross that line without repercussions, that's up to you(and a protection order,harassment judgment,etc)
Read that site, see where it says when we set a boundary,we make a statement, but have NO EXPECTATIONS of the outcome.This isn't manipulation,it's a healthy way to express our bounds only.
I hope you write back about this, you have a few people here a little concerned and we would like to hear your success.