Re: Pulling up the ladder
Keep in mind, I'm very far from being anything more than a mildly interested individual when it comes to intelligence. What has worked for me as a test of intelligence is comprehension, i.e. whether someone is just parroting. Usually some simple, open questions quickly expose the "intelligence pretender", such as can you explain this?, or how does it apply in this situation? And then some follow-up questions.
While this did the job for me - busting empty arguments, shutting down pointless discussions - I doubt that it would work with a sufficiently sophisticated LLM. Such may still not have any comprehension or experience of its own but could draw from the appropriate responses to appear to be intelligent. And then: what is the difference?