Re: But when deeper thought was required, ChatGPT fared poorly.
If you really think emitting statistically chosen token after token, without any reasoning, would result in coherent fan fiction with the characters you asked for, or a program that does exactly what you asked for, I'd say you are in denial.
You are then setting up a false dilemma to further that denial, ie, the AI is either entirely non-intelligent OR it has to be as capable as a competent software developer. When much of humanity wouldn't pass that bar, they would fall into your excluded middle populated by people near one end of the bell curve.