How will it effect my credit if I gave a vacant lot back to the bank.

If you are defaulting on a loan, then it will have an adverse effect on your credit.