I think it is totally understandable that you had feelings of jealousy when you saw him with the other workers only because you know in his mind he is going to reward their behavior,it doesn't sound like he has anyone really giving in yet.
I had a idea not sure if it would help if you have a hunky boyfriend show up to take you to lunch introduce him make sure he gives him the look,you know the mess with my woman I will take you out,spread rumours he's CONNECTED (ala tony Saprano)intimidation works if anything it's a good fantasy..