If you are in a Western office, I would not recommend you wear a sarri to the office at all. While sarees are very beautiful as you say, you will be making yourself the focal point of your office instead of being there to help direct the focus to the mission of your employer's company.
If you are from India, wearing Indian clothing may give an incorrect image of you as not being fully assimilated into American Culture for example, and therefore not being a person who can navigate that culture for business purposes. If you are not Indian and just like the look of a saree, you will look like you're in a costume. And you have to consider as well that there are a lot of very ignorant people, and some may improperly associate your saree with clothing from other eastern cultures that are not as advanced as India, and with which America has poor relations.
Please don't misunderstand my point - I'm not expressing any intolerance for sarees or other cultures, but acknowleging rather that in order to thrive in a culture, you need to fit into that culture and not make yourself a target of attention and criticism (for not looking the part).