I have this thing on the inside of my pinky toe, I honestly cant remember how long it's been there.

It's not so much a spot as just a small patch of brown coloured skin. All the my Google attempts is just throwing out results about cancer? Should I be worried or could it be something else?

No One can answer that without examining it and maybe some tests like a doctor? Walk in clinic or family physician?