[rectang]

If the AI gets attached to a health insurer (not the case here as far as I know), I would expect it to make decisions that are aligned with the company’s incentive to weed out unprofitable patients. AI is not a human who takes a Hippocratic oath; it can be more easily manipulated to perform unethical acts.

[stvltvs]

AI is an overloaded term, so I'm not sure whether insurers are using LLMs or more traditional ML, but they are already using "AI" to deny claims.

https://www.liveinsurancenews.com/health-insurance-claims-de...

[PUSH_AX]

I don't think anyone would use an AI with such a severe conflict of interests, unless this was completely hidden from the user.

[rectang]

With an integrated insurer/provider, they just have to make primary care scarce so that it takes months to get an appointment, and then offer AI Doctor as an option. Not all patients have to use it for it to be cost effective.