At first it was a bump then I realized it was a pimple I suppose.
A tried squeezing it and puss came out just like a pimple.
Should I be worried here?

Pimples happen. I wouldn't recommend squeezing it, that can introduce infection. Leave it alone and it should go away on its own. Or, see your doctor to have it properly treated. :)