I want to get rid of my tenant (New York state) because he is very nasty person.
We have no lease what so ever. Can you advise how?

Ask them to sign a lease that's favorable to you - raise rent, have changes that are not tenant friendly ? Or try to buy them off - leave now and I'll give you X dollars.