How do you paint pvc pipe?

Nowadays they have decent paint designed for plastics; available at paint stores, Lowes/Home Depot, etc...

I'd recommend, though, using sandpaper to rough it up a bit first.

Yeah, sand it first. If you use regular paint, it will scratch and chip.