In order to be worried, I'd have to believe that there is an entire class of human beings who are so worthless, that they would be easily replaced by robots. Then the middle class would become the lower class, and the lower class would become -- what -- homeless, I guess.
That would make me a snob and a misanthrope.