With a record like his it would be quite unusual for the visits to be more often.
However, I believe it may benefit you to go through the court because of his record. The court then would assign a custodian to watch over the visitations so that nothing inappropriate will happen while he is with your son.
If he continues to insist on the visits then I suggest that you insist on him going to your mom's house. You can play the same game he is. If he does not visit but continues to insist then you can pull your trump card and tell him that it will be decided in court.
Just out of curiosity, nothing more, but you mention his drug problem and you call yourself MissMeth18. Makes one think of either Methamphetamine or Methodone. Please do not answer that here, as that is not our business, but, if he finds this nickname out he may try to use it against you.
I know some will disagree with my last comment, but I am used to men who try and play games. I am just trying to help you CYA.
I am just trying to think of anything he could use against you if he were that kind of person.