I just capped off a pipe for cold water. I'm wondering how long I need to let the cement sit before I turn the water back on?

I would read the instruction on the can.

But generally: glue will hold household pressure within 15 minutes. It will reach full strength in 30 minutes.