"Fuck them" is not helpful a response (to the self and others). It's clear that the so-called victims of racism often hold similar tribal/racist tendencies. It's more important to examine why.
The argument is not against collective punishments/rewards but how those punishments and rewards should be distributed to right past injustices. (I am against that view myself).