Replace that nut and the beveled washer inside it. I'd suggest taking that entire piece, nut , washer an all to the hardware store and ask for an exact replacement.