These systems are useful
These LLM systems are indeed very useful, accurate and practical for a wider variety of problems.
One example I implemented last week at work, was a system for helping to write Cypress tests for journeys through an insurance company website. Writing a system to fireup a browser and navigate to the site, and then giving the LLM the DOM of the loaded page a human can write something like 'accept cookies and then select that you want to purchase Dog Insurance'. The LLM can then take that (along with the serialized DOM) and return Cypress code to perform the action on the site, which we can then concatenante to our test code file and also execute to change the state of the website. We can then pass the new DOM and a new instruction 'fill out the form with my dog 'Geoff's' details. He is 10 years old and a border collie.
Using an LLM in this way generates accurate results and usable test files. The advantage over writing the tests directly oneself are that if the structure of the website changes you can just regenerate the test file at the click of a button. A human would have to go in and start looking at the DOM all over again to rewrite the tests to ensure that any DOM changes haven't affected his test commands.
This is just one practical use of LLMs doing something that we needed humans to do for us previously. To say they have no utility, or a trivial is a very misguided way to think about this new technology.