When I connect the y adaptor to the video output jacks red/wht there is still sound coming out of the televisions' speakers. The original purpose was not to disturb others when watching late night TV.

How about decreasing the volume on the TV to zero?
Shouldn't affect headphone volume. At least- mine doesn't.