I live NYC but work in MASS most of the time. Do I have to have Mass taxes withheld?

Yes, plus you need to have NYC taxes withheld as well.

You are liable for Massachusetts state income tax because you work in Massachusetts. You are also liable for NYC and NY state income taxes because that is where you live, but NY state will give you a credit for the Massachusetts taxes paid.

No credit on the NYC income tax, though.