[fitzgera1d]

What's the hallucination rate of human lawyers? Spent $1,400/hour on a series of unusable drafts just the other day.

[NoboruWataya]

In the sense of just completely making up references out of nowhere? Very low. Humans make mistakes, of course, but they tend not to be so egregious. Grounding a submission on a made up reference is quite likely to be fatal to your case in a way that most human errors aren't.

[squigz]

This is the important bit that's always missing in discussions about LLM/AI applications to existing industries - what is the rate of mistakes for a human worker?

[pbhjpbhj]

Pretty low if they want to pass bar exams.

[echelon]

Hence the excitement behind investing in AI legal tools.

[fitzgera1d]

Further, I now get emails from legal that regularly seem drafted by ChatGPT.