Do I have to turn off water supply to house to replace the hose bibb handle?

No. Just make sure to hold the stem when removing the screw.

ma0641 is correct. Just keep the valve shut off and the stem in a closed position when you remove the screw. Good luck, Tom