Declaring something hate speech is Literally hate speech, and should be the first form of hate speech banned if a ban ever does occur, to prevent damage to freedom of speech: verbal self-defense, this is.
To diminish freedom of speech is to diminish the very right that minorities used to make their voices heard in the fight for progress.
