[kmerroll]

Paywalled, but not a huge surprise really. Sounds like part of the problem was the internal pharma team not having a plan for what to use CoPilot for and going for the "it's AI!" theme from Microsoft.

I am seeing great value in AI-based solutions related to knowledge assistants and for automation N(A). Neither of these seem like strong suites for CoPilot, but it's very early days.

That we're seeing much better results using self-hosted open source models (Llama 3.1, etc.) should be concerning for Microsoft as well.