Are you sure it was a cactus and not this plant?

http://forums.botanicalgarden.ubc.ca/data/attachments/36/36033-294fc29673c89f0080fd3f82d19316fd.jpg

This is an African milk tree and often...