Do I have to file a 1099-int form with my taxes or is it just for my records?

You claim it on Schedule B

You do not need to include a copy of 1099-INT with your return - keep it for your records. Be aware that the bank that sent you the 1099-INT has also given this data to the IRS, so be sure you include this income properly.

If money was withhed from your saving account, then the Form 1099-INT needs to be attached to your tax return.

Otherwise, you just keep it for your records.