Are you thinking you can get it back to the original state/look? Probably not going to look like new because some paint will stick in the mortar but you can use a paste or jel paint stripper. Go "green" if you can. Franmar Chemical - Environmentally Friendly Cleaners and Removers