This is my main qualm with the ancaps - they think that freedom necessarily brings out the best in people. Go live on the south side of Chicago! There are no cops! Ancap paradise!
What is missing there and in your own understanding of liberty is that natural law exists and consequences follow breaking natural law. So in order to achieve harmony with liberty:duty