Sidenote: all or nothing immigration is not sensible, the question will always be: how much immigration of which kind of immigration. It is of course a balance thing.
I actually think nations should not be allowed to stop people moving over any border, or regulate who lives where.
There can not be any nation without it having some sort of borders and criteria for who gets citizenship, nations and the rule of law is there to regulate people within nation states.