Is there any over the counter medicine or type of bath that I can take if my lochia had a foul oder?

You should jusst bathe frequently. Take sitz baths in warm water. I would not recommend any medication, even if there were some, in your postpartum period without the doctors written prescription.