I'm getting divorce through online divorce kit. If we have agreed on everything, can we both go to a notary public and sign all paper work and then file to speed up the process.

Yes, and keep in mind that you will get what you pay for. Attorneys are trained to locate issues. If you have a simple case (no kids, no property, no debt), then OK. Otherwise, the plaintiff should have an attorney review his/her particular fact situation. Actually, they both should because the case does not "look" the same from both perspectives, ever. Good luck.