I'm convinced that real intelligence comes from the fact that we are physical entities interacting with the physical environment around us. We start out, newly born with millions of sensory receptors - rods and cones, taste buds, olfactory receptors, those cells in the cochlea, touch, heat, pain receptors, proprioceptors all feeding into a growing brain and spend the first months correlating those inputs to start building a mental model of the world around us, the perceived world. We have a sense of self stemming from our connection to the world.
As we refine it we can use it to understand that external world, plan and carry out our interactions with it to do and get what we need and want. Most o our vertebrate brethren do the same. That's the core of our intelligence.
What we humans have evolved is the extra capacity to communicate symbolically with language so that we can add to our model by listening or reading to others telling us about things they have encountered and we haven't and also to add more from our imagination and to reason more elaborately about our mental model. But that mental model of the environment is the core of our intelligence. The symbolic layer is just an add-on.
What ML and attempts at AGI are targetting is just that add-on layer. Without the perceived world underpinning it they're not going to get there. You and I can read a description of a room, a landscape, a person or experience, fictional or otherwise and add it to our mental model because we have seen and experienced these things directly during our training of our brains in those early years and beyond. A notional disembodied AGI can't have that connection to give a sense of self or an understanding of anything that's communicated to it. No amount of description can give it the sense of what a drink is because it's never felt the weight of the vessel and contents, never tasted it, never sensed the tempperature and never swallowed it. It is and must remain deficient in kind, not just in degree from a real intelligence.