In actual practice this is dangerous and the "other woman" can very well have OP arrested for stalking.
Facial expressions are not legal grounds so, again, if the question is proving infidelity for a Court proceeding you need more than following people and seeing if they appear startled to see you.