Can I get marriage without rings at the courthouse

Rings are just a symbol, not a necessity. If you don't want rings then don't have rings. It's the marriage certificate that's important.