[martinsnow]

What do you do when it flags you or someone you know who's innocent? Blindly trusting these models without any verification will put innocent people in prison. Normal people don't understand why they are so confident. They're confident because they believe all the data they have is correct. I forsee a future with many faux trials because they don't understand critical thinking.

[RussianCow]

> Blindly trusting these models without any verification will put innocent people in prison.

I don't think anybody is suggesting this. But if the models can gleam information/insights that humans can't, that's still valuable, even if it's wrong some percentage of the time.

[snowe2010]

This is what happened with dna testing at the beginning. Prosecutors claimed it was x percentage accurate when in fact it was hilariously inaccurate. People thought the data was valuable when it wasn’t.

[8organicbits]

If you are interested in the history of pseudoscience in the courtroom and methods for deciding what should be permitted in court, see: https://en.m.wikipedia.org/wiki/Daubert_standard

It is, and will continue to be, a hard problem.