Sanctuary is only those who defy any authority of violence. Consider, for example, refugee floods: Most do not repudiate authorities [State,religious,etc] which can call for violence, randomly.