Your take on this makes sense.

If this is something that's become a problem I suggest a psychiatrist. Sadly all you'll get online is a guess. But your guess sounds accurate to me.