I know how it works. The front-end application can hide any actions they want, for example you don't Likes are toggled off by default. Actions can be hidden on the platform itself.
What you described would give users a false impression that votes are private when they can't be. Anyone can find out all your votes. What is point of pretend hiding them?