If I get this right, F1 students in US are not taxed on the interest they earn from Savings account/Certificate of Deposits. Is that correct?

Should the interest be reported while filing taxes?

Thanks!

Yes, it is not taxable. You do not need to report it. You can file From 1040NR-EZ.
Read: Your U.S. Tax Return: U.S. Tax Filing Requirements for Non-Residents