I have two lights in a room controlled by a dimmer three way switch and an on/off three way switch. I want to use the one on/off to control just one of the lights and the other dimmer switch to control the other light.

The 3 way switch and dimmer will need to be changed to single pole devices.

Depending on the wiring will depned on how you connect or splice through so one switch controls one light.