When I turn it on the noise begins almost immeditaly afterwards. And the noise only stops when we slow the amount of water coming through the shower head.

Remove the shower head. Does the noise stop? If so the there's a neoprene washer with holes around the rim just inside. This is a water saver. Pry it out and toss it. Reassemble and test. Noise all gone now? Good luck, Tom