Where go I go to apply for a Business License

In the US from your state.gov, and a permit from your town if you will have customers come to your door.
For taxes, if you are a sole proprietor, you don't need an EIN (employer Id No) and can just use your SS# and your name with a dba if you will have a business name.

Each state may have its own. In Georgia if you live in city limits normally you will get your license from the city, there will be a business license department. If you live outside you will get it from the county government.