I realized recently that my California employer was deducting Ca SDI from my check. I do not reside or work in California. Do I owe this sdi and if not can I get it back from the state?

You do not owe CA SDI if you don't work there. Your employer will have to get the money refunded to you, so talk to your payroll department about it.