Re: ChatGPT/copilot failure rate 100%
Each time I had a question it completely failed. I only went there three times with actual questions, didn't grasp the topic. And came up with solutions with are either invented invented nonsense, or programming solutions which contradict and cannot work. It is still just a mix-and-match tool. If no one had the solution to your problem posted on the net, "AI" won't make it.
Just this, it's similar to Google 25 years ago - before it went crap. Ask it a question and it'll give you an answer. If you're lucky it may in fact be correct. What it will not be is presented in the proper context.
The difference is that old Google would always present the source material front and centre, if the first result happened to be a passing reference that just happened to trip the issue at hand it was easily dismissed. There would generally also be a ten minute read discussing the issue in the round. The problem even there was people couldn't be bothered - far too time consuming - as opposed presumably to going to a library and reading a book on the issue, perhaps actually gaining some insight along the way. So you end up with the single sentence answer used as the definitive without the underpinning to establish if the answer is complete or appropriate or even if the question makes sense.
AI, at least in its current form, is exactly the same but more difficult to diagnose because of the surrounding verbiage. Sure it all looks relevant, but a critical eye often shows it to be nothing more than "Here's what else I know about that topic". No indication as to if your question omits some key understanding that you didn't know to ask about in the first place.
Last summer work was really pushing Copilot - they must have spent money on it - so I figured it was worth playing with. At the time I had just built a new shed from flat pack so asked about lining it. Each time I asked I got a different answer - "So I have the outer skin, the insulation, the breathable membrane and the inner lining, what order to they go in?" would give one. Asking where the damp proof membrane goes gives a different answer, often omitting the breathable membrane unless lead to do so. Following that up with a query about an air gap gives yet more contradictory results. By the end the lining was going be 8" thick and use a third of the interior volume of my shed. Decided to talk to someone who knows what they are talking about instead.
On a similar vein I've just set it a delibrate trap that demonstrates exactly my point: "how do i change the spark plugs on my diesel car?" The answer:
Changing the spark plugs on a diesel car involves a few steps. Here's a general guide to help you through the process:
Preparation: Make sure your engine is cool and disconnect the battery to avoid any electrical issues.
Locate the Spark Plugs: Refer to your car's manual to find the spark plugs. They are usually on the top or side of the engine2.
Remove the Ignition Leads: Carefully remove the ignition leads (thick, insulated wires) attached to the spark plugs. It's best to do this one at a time to avoid confusion2.
Remove the Old Spark Plugs: Use a spark plug socket and an extension if needed to unscrew the old spark plugs.
Prepare the New Spark Plugs: Check the gap on the new spark plugs using a feeler gauge or gap tool. Adjust if necessary according to your car's specifications1.
Install the New Spark Plugs: Apply a small amount of anti-seize compound to the threads of the new spark plugs and screw them into place. Tighten them with a torque wrench to the manufacturer's specifications2.
Reconnect the Ignition Leads: Reattach the ignition leads to the new spark plugs.
Reconnect the Battery: Once all the new spark plugs are in place, reconnect the battery and start the engine to ensure everything is working properly.
Would you like more detailed instructions or a video tutorial to help you through the process?