So there is risk but it's very temporary. POS whales are permanent oligarchs who don't need to spend a dime to control the coin forever. Huge difference.
It depends on how the POS is set up though. When there is an inverse voting system in place then everyone has a voice and everyone is rewarded for contributing to the network.