In fact, you could decide that if 1 or more of those you follow blocks someone, they're blocked for you too. If downvoting happens, it could work same way. Not censored, but filtered.
I've been thinking of that too. Knowing what users are the most muted ones might be a very useful information.