My grandson screams and cries when I return him to his mother. It is quite upsetting. I have him about twice a week, and he has no problem when he is taken from my house to his father's but screams when I take him to his mums (they are not together). Please help me! I am getting worried. He is one year old.