Please clarify your question.

The shelves have an end on each side that goes into a hole in the wall. There appears to be no way to make one side go in so you can remove the shelf

A Picture would be nice,
If not, I would try side to side, pushing, pulling, lifting, may be a little trick, A picture(s), model number would be great.