Yes exactly. If a big enough percentage of the population is immoral your "freedom" is going to be a walled compound with you working your ass off to grow your own food. Freedom baby!
Many great divisions between people have been reduced. It used to be people mostly interacted with others of the same religion, class, race, and government.