Good point. This is probably a reason why so many oppose the idea of cryptocurrencies, since replacing fiat would leave them jobless.
"What do we do with the gatekeepers, when we have smart gates?" It's the same automation/replacement issue plaguing other industries: Banking's horse is just extra high and shaky.