Re: I don't understand.
Here's my personal theory . Call it "Magical Thinking" if you like. Biological neurons are kept at the very edge of firing by the brain, such that sometimes a single ion may be the difference between it reaching its action potential and firing, or not reaching it and not firing. Therefore I think it's possible that the brain could act as an amplifier for quantum-mechanical effects, such as was that ion really there or not. But I only took one Neuroscience module as part of a Cybernetics degree. I'm not a Neuroscientist, much less a Quantum Physicist.
I wouldn't attribute "intelligence", never mind "general intelligence", "understanding" or "consciousness" to a language model. As I said in my other post- all it does is predict what a piece of "probably human-generated data" might do in a given context. It may be very good at imitating the data that we humans produce via our keyboards, but only because it has a vast pile of statistics about that. It has none of the machinery underneath that humans use to generate that data in the first place - it's using a completely different method, i.e. using statistics to predict only the output, based on past inputs and outputs. It's a "black-box" model, in that sense. The "understanding" behind human text is hidden from it.
And of course, going back to the "magic" of my earlier point, if the brain were a quantum-mechanical system, then it's not possible to perfectly emulate a human, because it's not possible to model and predict such a system even if you know all of its previous states.
(and i'll repeat: the language model doesn't even come close to modelling the 'state' of a human. All it "knows" about is the data we give it, like the output layer of an ANN. Google and Microsoft don't have access to my "hidden layers" yet. Not until they start making us all wear EEG hats at least)
That said, I don't disagree that this technology changes / has changed the world. It's a new arms race, and a bloody dangerous one. There will be no cuddly sequel to this Terminator.