Can anyone tell me if pepper (as in the red / green / yellow / orange variety) seeds are poisonous?

I've been told it by a couple of people but I'm not sure whether to believe them or not!