My vagina is swollen and itchy at times, its even painfull to have sex, what could be wrong?

Any number of things.
This really requires an examination from your own medical practitioner.

STD, infections, other medical illnesses, you need to have a medical exam and esp before you have sex again.