That freedom of movement I figure would need to come from a global constitution restricting nations right to force people to stay, or come.
An alternative would be smaller competing states. & because (actual) free trade allows open societies to out compete closed off societies the world would become more open.