I live in the US & recently opened a saving account & noticed on my statements that federal taxes are being withheld. Is it normal for these taxes to be withheld. I've had savings accounts in the past & never had taxes taken out, only interest paid on the money in the account.

When you opened the account they should have had you fill out and sign a W-9 form, on which you certify to the bank that they are not required to withhold taxes on your savings interest income. From IRS Pub 550 (see Publication 550 (2010), Investment Income and Expenses ):

Certification. For new accounts paying interest or dividends, you must certify under penalties of perjury that your SSN is correct and that you are not subject to backup withholding. Your payer will give you a Form W-9, Request for Taxpayer Identification Number and Certification, or similar form, to make this certification. If you fail to make this certification, backup withholding may begin immediately on your new account or investment.

You should contact the bank and ask for the form.