Well here is a list with all the states.
SBA: WHERE TO OBTAIN BUSINESS LICENSES
You have to get a TIN -Tax Identification Number and they will tell you what all you have to apply for and do. If you want a name for your business other than your name you have to pay for a fictitious name search and permit.
You might want to check with your local Small Business Assoc. and they should go through everything with you and tell you insurances and everything you will need.