Que sera, sera
Recently, there have been some very positive announcements about fusion power. And a lot of major corporations take quantum computing seriously enough to invest in it.
This, however, is not to say that Ron Rivest is wrong. Fusion has been ten or twenty years away before. And the challenges of keeping a quantum system isolated from the classical world rise exponentially with its size.
My opinion is that it's not safe to assume quantum computing will work, and it's also not safe to assume quantum computing will not work. Prepare for the worst in both directions.