I just purchased a few LED screw-in light bulbs. Now when ever I turn off the wall switch, the LED light is dimmed but not off. In these same fixtures with an incandescent bulb, the light goes completely off. How do I solve this problem?

The house was built in 1979 with 3-wire 12 gage.

Do they eventually go off.