You don't have to be OK with a particular issue to respect your s/o. It's never good to put any boundaries on a person, you are there to uplift and love and grow together, not hinder.
That's not a silly thing to question, it's a perfectly logical line of reasoning. My 2 cents would be that if it didn't work before, stop with the limits and have some faith in each other. It's not much of a second chance if you don't start over like you'd have wanted in the first place.