I was wondering if by handling/trimming weed you could fail a urine and/or a hair test?

Nope. Only by ingesting it.