I am bringing a new puppy into my house with two cats. Should I not let them out while puppy is in.

If you are concerned that they may become upset and stay away - then do keep them inside. Cats do well with re-assurance - and they may need to know how much you love them - especially if you are bringing a new pet into the family.