Only comes out if I disconnect the battery.

Sounds like the ignition interlock solenoid mounted to the ignition housing.
Pulling down the left lower dash panel will reveal it. It's a 1" square box with a short wire harness coming off it.
If you disconnect it, It may get you by until repairs can be made.