I have a tenant that is living in my house. Our verbal agreement is that he woould live in the house for a couple of months. We don't have a contract, but now he will not pay and I want him to get out ane he won't!

What state?

You have to give him written notice on the door or by hand and a certified letter with your states time frame (3 days, 15 days, 30 days,. ). Also send it certified and keep a copy.

Then if he doesn't leave after the specified time, go to the district court and they will serve an official eviction notice for the same amount of time. Then a constable or somebody will come to escort him out.
If he pays up you have to let him stay and start the process all over when he quits paying again.

He is your tenant, you have to formally evict him according to your local laws.

You generally start with a pay or quit notice in which he has x days (usually 3-10) to pay or vacate. If he hasn't then you go to court for an eviction order. After the hearing, he has a few days to leave. If he still hasn't done so, you hire a sheriff to physically remove him.