When a man's mind can't distinguish right from wrong, he can't comprehend the concept of "rights" or "wrongs". That is all the word rights refers to. The set of things/actions classifiable as right and not wrong. Simple.