[yuck39]

Don't rule out possibility 1.

Sometimes you have to learn how to frame the problem in a way to get the results that you want. These tools need lots of context, not just about the rest of the code base but the problem itself. You can think of it a bit like how the early adopters of high level programming languages had to fight against compilers to get the assembly output that they wanted.

For example, if I tell an LLM to generate a python script that finds the square of a number I might want: def square(x): return x * x

but it may give me: print("Enter a number:") x = int(input()) print("The square is", x * x)

This is a very very simple example but I think it illustrates my point. If you provide enough context to the exact problem you want to solve the results are astronomically better.