Re: are we sure what we do is more than autocomplete
Yes. Off the top of my head:
1. We invented language
2. We don't need vast quantities of training data to do what we do. A child can be shown 3 cats and recognise any cat.
3. General intelligence fundamentally means coming up with things that aren't in the data.
I've used LLMs successfully to write and translate code between languages. But my attempts to use it to write text have all met with failure. I've always finished by rewriting the LLM output to correct errors and remove unnecessary verbiage.