The best way to get rid of welts is eliminate the problem that causes them.
Yogurt applied to your skin might help. Also take 1000 mg vitamin C a day.
There is some mixture using vinegar that is suppose to work too.
I don't know if calamine lotion would work or not.