I am working under a G1 visa, could I work as a consultant for another international organization in the US?

My current employer allows me to have another job, but I am wondering if my G1 visa would allow me (or restrict me from) to work for another international organization that normally grants G4 visas (such as the World Bank).

Any clues will be greatly appreciated,

Bob