top | item 38449903

(no title)

freshpots | 2 years ago

"Technical documentation is probably one of the worst usecases for GenAI, I'm not sure why so many companies are rushing to add it."

I am one of those people who think that it would help people summarize it, get better compliance with specs, etc.

However, I am limited in my knowledge when it comes to GenAI.

Why do you think it is one of the worst use cases?

discuss

order

rurp|2 years ago

Because being precisely correct is especially important in technical documentation. GenAI is great at producing loads of content that looks sort of right, but terrible at logical correctness and, to a lesser extent, brevity.

In my original example I asked Q about sorting in DynamoDB. The answer it gave was categorically wrong! That's worse than useless, it's actively misleading. If it can't get a simple example correct I have no faith that it will be reliable for more comicated real world questions, but those mistakes will be harder to catch.

lazystar|2 years ago

as another anecdote, Q advised me to update a security group with a rule to allow ingress traffic on specific ports from a Lambda function execution role. It's jumbling up documentation from two completely different security tools; it's only a matter of time before Q causes a prod incident somewhere.