[mdcds]

I'm heavily involved in interviewing at my current org and have been pondering same questions.

Some ideas:

  1. use ChatGPT (or similar) to test your questions. I read that GPT-like models cannot do abstract manipulation. Perhaps there is a way to phrase follow up questions such that the model cannot relate to the earlier question. 
  
  2. in system design session, focus on detail instead of high level. Also, you can draw a diagram of a design and ask the candidate to point out deficiencies.

  3. what if we could use GPT-like system to generate new programming questions of equal difficulty for each new interview candidate? this would solve the problem of questions leaking and making it to sites like LeetCode.

[bironran]

yet for 3, interviewees might feed that back into ChatGPT for answers :)

Good suggestions on 1 and 2. Thanks for being on-topic.