I have a cable with white, black, red and green wires. I am installing a chandilier where a ceiling fan had been. It has black white and green wires. I connected the black to the black, white to the white and green to the green and did not connect the red wire. When I turned on the breaker the chandilier lights worked. But I could not turn it off from the wall switch. I am thinking that I need to connect the red wire to the black on the chandilier so that the switch works. But then what do I do with the black cable from the source?

Just cap it off safely in the box.