Yes exactly. If a big enough percentage of the population is immoral your "freedom" is going to be a walled compound with you working your ass off to grow your own food. Freedom baby!
But without government these mostly useless, intrusive regulations are costly to implement. Who wants to actually pay (their own money) to prevent others from petty action?
