There's no such thing as free speech or the right to defend yourself in an anarchy - only power. If you want no government whatsoever you want tyranny.
No rulers does not mean no rules. If we stop obeying the mafia, the mafia will disappear. However, if you are so obsessed with being ruled, you can also be governed voluntarily