[lewhoo]

Those certainly were the catchy headlines. Here's an interesting article:

https://news.mit.edu/2024/study-reveals-why-ai-analyzed-medi...

“We found that even state-of-the-art models which are optimally performant in data similar to their training sets are not optimal — that is, they do not make the best trade-off between overall and subgroup performance — in novel settings,” Ghassemi says. “Unfortunately, this is actually how a model is likely to be deployed. Most models are trained and validated with data from one hospital, or one source, and then deployed widely.”