My battery light came on a day prior to me testing and replacing the battery. The light is now indecisive of whether to stay on or off. Also my RPM fluxuates more so than it has in the past. It will either idle at apx. 1300rpm or 500rpm... My guess is this is the alternator... any suggestions?

The battery light is on, due to the low rpm. I suspect erratic rpm is a function of Ignition Control Module (ICM) failure. Here's what it looks like and costs:

While we find your parts, please enter your ZIP Code at PartsAmerica.com (http://www.partsamerica.com/ProductList.aspx?PartType=194&PTSet=A)

Here's how to replace it yourself:

https://www.askmehelpdesk.com/cars-trucks/faq-how-troubleshoot-repair-maintain-hondas-46563-4.html#post265896

If you prefer, AutoZone will test your old ICM for free.