The economic Turing test: when hiring managers prefer the machine

Turing asked when a human could no longer tell a machine from a person. The more consequential question in 2026 is when a hiring manager stops caring — because for a growing set of tasks, the machine's output is preferred on cost, speed and consistency.

Michael McCarroll 13 min read Updated June 2026

What the economic Turing test actually says

The classical Turing test asked whether a human evaluator could distinguish a machine's responses from a person's. The economic Turing test, articulated recently in industry discussion by figures such as Anthropic co-founder Ben Mann, asks a different question: at what point does a hiring manager, given a task and a budget, consistently prefer the machine's output over a human contribution (Guo and Gil 2025)?

It is a more useful question because it is decidable. Controlled experiments already show generative AI matching or exceeding human performance on essay writing, first-draft software development and some categories of economic explanation and advice (Mei et al. 2024). The economic Turing test has therefore already been passed for whole slices of knowledge work — at least in isolated tasks, at least on average.

The consulting-firm headline and what is actually happening

Large consulting firms have begun to attribute headcount reductions explicitly to AI. Reports of McKinsey shedding around ten per cent of its workforce have been widely repeated with AI cited as the cause (Cutter 2025). The reality is more complex — a combination of natural attrition, strategic repositioning and a softer market for advisory services — but the direction of travel is genuine.

The important point for workforce strategy is not whether AI is the sole cause of this or any specific reduction. It is that the marginal cost of a competent first draft — of a slide, a memo, an analysis, a policy — has collapsed. Any role whose value proposition rests on producing the first draft is now on notice.

The reverse Turing test and the accountability question

Pagliari, Bucciarelli and Chen (2021) explore a mirror-image concept: the reverse Turing test, in which machines evaluate whether a human's instructions are distorting or harmful. Modern general-purpose AI systems already apply something like this — they refuse to generate instructions for weapons, they push back on instructions that would violate their published usage policies.

The reverse test matters because it shifts accountability. When a machine refuses a human instruction because the instruction is distorting, the human's authority to instruct has been meaningfully constrained by a private supplier's policy choices. For governance frameworks — ISO 42001, the EU AI Act, sectoral regulators — this raises questions that most organisations have not begun to think about seriously.

AI is often the fairer decision-maker — which cuts both ways

Recent experimental work finds that AI systems, in certain economic and decision-making contexts, are more altruistic and more consistent than human participants (Mei et al. 2024). For a hiring manager comparing outputs, this is an attractive property. For a governance function, it introduces a subtler problem: the machine's fairness is a design choice by the supplier, not a value chosen by the deploying organisation.

An organisation that outsources fairness to its model provider has, by that fact, outsourced part of its ethics function. That may be an acceptable trade-off for low-stakes tasks. It is not acceptable for lending decisions, safeguarding judgements, or clinical triage. The economic Turing test does not tell an organisation which category a decision falls into. That remains a human, accountable choice.

What workforce strategy should actually do

The wrong response is defensive: hiring freezes, blanket bans, moral panic about replacement. The right response is deliberate role redesign around the tasks the model still cannot do well — judgement under ambiguity, accountability to regulators and customers, ethical reasoning in genuinely novel situations, relationships with specific counterparties who require a specific human presence.

  • Redraw job descriptions around the residual human tasks, not around producing outputs the model now produces cheaply.
  • Invest in the seniors, not just the juniors. The junior who reviews the model's first draft needs new failure-mode recognition that senior colleagues currently do not teach.
  • Rebuild the apprenticeship. When the model replaces the first draft, the traditional route to competence disappears. Design a replacement or lose the pipeline.
  • Publish an AI-and-work policy that names what the organisation will and will not use AI to decide, and who signs off on the boundary.

References

  • Cutter, C. (2025) 'Consulting firms cite AI in layoff decisions', Wall Street Journal.
  • Guo, S. and Gil, E. (2025) No Priors Podcast: Interview with Ben Mann, Anthropic.
  • Mei, Q. et al. (2024) 'A Turing test of whether AI chatbots are behaviorally similar to humans', PNAS, 121(9).
  • Pagliari, R., Bucciarelli, E. and Chen, S.-H. (2021) 'Decision-making in an intelligent environment', Journal of Ambient Intelligence and Humanized Computing.
  • Russell, S. (2023) Human Compatible: AI and the Problem of Control. 2nd edn. London: Penguin.

Frequently asked questions

What is the economic Turing test?
It is the point at which a hiring manager consistently prefers AI output over a comparable human contribution on cost, speed and quality. For essay writing, first-draft code and economic explanation, it has already arrived in controlled comparisons.
Are consulting firms really cutting headcount because of AI?
The reductions attributed to AI are usually a mix of natural attrition, strategic repositioning and market softness, but the direction of travel is real. Firms are hiring fewer analysts and asking more of the humans who remain.
Should we freeze hiring in response?
No. Defensive hiring freezes create senior-judgement gaps you will need in three to five years. The strategic response is deliberate role redesign toward judgement, accountability and the tasks the model still cannot do reliably.
How do we manage the risk that AI outputs replace human accountability?
Assign a named human accountable owner to every AI-assisted decision, require disclosure where AI has been used, and keep humans in the loop for reversibility-critical judgements. Accountability does not transfer to the model.

Govern the AI decisions your organisation is already making

ISO-STANDARD.app gives you an AI-and-work policy, an inventory of AI-assisted decisions and the accountability record your board will need.

ISO-STANDARD.app ships a ready-to-adopt ISO 42001 workspace with the risk register, controls catalogue, policies and audit-ready exports already wired together — no spreadsheet sprawl, no consultant lock-in.

Free downloads for this topic

Prefer a conversation? Email hello@iso-standard.app — a real human responds within one business day.

Trust & security
ISO 27001 aligned
Controls mapped to Annex A
Encryption in transit & at rest
TLS 1.3 · AES-256
MFA enforced
TOTP required for all admins
GDPR & UK GDPR
DPA on request · EU/UK data
SOC 2 ready posture
Audit-grade logging
RLS-isolated tenants
Row-level data separation
← All guidesHome →