I am trying to do an estimate of our tax return on H & R Block.

My question is for the Federal Income Tax withheld, do I need to add Federal Income Tax plus the FICA? Because there was about 3000 held in each of those?

No - you enter only the income tax withheld. This amount should be in box 2 of your W-2. Do not include FICA (which are social security and medicaire taxes in boxes, and are shown in boxes 4 and 6).