So the diverter spout stick thing broke off our tub faucet so now the water won't be diverted from the faucet to the shower. I do believe it's a slip on faucet, but it looks like the set screw has been grouted over for some stupid reason, so I can't even access it. Is there any way for me to get that off? No it's not caulk, it's grout or cement... no clue why...

If it's grout, pick it out with a flat blade screwdriver and an awl.