The white stuff around your piercing is probably what is called lymph. It is the white blood cells in your body trying to patch the hole in your tongue. It is your body's natural defense mechanism.
Use a wet Q-tip or a SOFT bristled toothbrush to remove it. It should stop appearing in about a week, but don't be alarmed if it takes 2 weeks as everyone's bodies heal differently.