Evict him.

Break up with him first.

I agree but think if you do #2 post you will accomplish #3 post. He is a resident and must be treated like a tenant so eviction is the route to take. How long has has he lived with you?

Ask him to leave. If he refuses, evict him.