The switch has always been dedicated to this jbox. It's a new condo so there was just a canopy covering the hole in the ceiling before I connected the new lights.
Yeah I haven't seen anything like it at all in any of the guides I've read. Without it being attached to anything, current is always running and keeping the lights lit, regardless of the position of the switch.