You could simply discard or discount votes from people you don't follow.
I think algorithms based on your own circle of trust is going to be the way forward. There could be a market for the most useful memo algorithms as well as human selected follow lists.
Yes, with greater adoption, curation algorithms will be a necessity and likely become a lucrative industry
