You are right, it needs to be figured out. You could still maintain pseudonymity with the right process of generating addresses/distributing the ballots, which would be good enough.
I am not going to pretend I have a good-enough grasp of cryptography and bitcoin to design such process :p
