Of course its hard, and it hurts, that's the way its supposed to be because it shows you cared. Don't forget that. You are reacting like a caring human who hurts. That's not a bad thing, just painful.
When you feel nothing is when you should be really worried.