You make a professional decision based on the circumstances and possible outcomes,that's all you can do.
Although I know its hard to reconsille yourself to difficult decisions,from my own experience its better to leave it there and pick up the baton for the next one that needs you.