The headline "GPT-4 increased BCG consultants’ performance by over 40%" is misleading since it implies that they became more productive in their actual work, when this is a carefully controlled study that separates tasks by an "AI frontier". Only inside the frontier did the "quality" of work increase by 40%, while they completed 12% more tasks on average.
skepticATX|2 years ago
> while AI can actually decrease performance when used for work outside of the frontier
There is some value here but the authors can define "frontier" however they please to end up with whatever productivity increase they are looking for.