It is generally thought to be OK and plenty of women dye their hair while pregnant.

If you wanted to error on the side of caution, use one that is not permanent, that is only on for about 10 minutes, or wait until after baby is born.

Should be fine. Many do dye their hair while pregnant. Just try to find a hair dye that is ammonia free. Or wear a mask so you don't breath it in.