Hey dont be scared this are only hormons and unbalanced energy,
It is not seldom what u are describing. When i was in high school i have seen boys looking at me like "i was a girl" and i am NOT kidding. lol (i only noticed that becasue i was observent)
I think this normaly starts when u get of the main stream of puberty, around 16. When u start searching your identity.
PS: U mentioned u have aspergus symdrome, that means u are probably good at numbers

Do have an emotion for every number u imagine, do you feel anything when u imagine numbers. I hope i am not to direct.
Thanks