I accepted a job offer from a company, received a company email and I am completing their training modules prior to starting in 3 weeks. But, I haven’t signed anything with the company yet. Should I quit with my current employer or should I wait?

As you have accepted and starting training, then YES, you need to hand in your notice with your previous employer.

Thanks for your help!