This is reviewed on a case by case basis, depends what you did and how long ago, check the link below, you would have to apply and see what they decide
Passport questions and answers
I am assuming your in the US, if not, other countries may have different methods of deciding.