header-logo header-logo

Home Login E-newsletter About us

The Lawyer Challenge & the AI team

© Copyright LexisNexis 2025. All Rights Reserved.
03 November 2017
Issue: 7768 / Categories: Legal News , Profession , Technology
printer mail-detail

Machines outsmarted lawyers from leading Magic Circle and international firms in a week-long contest.

The Lawyer Challenge, held last week, pitched 112 real life flesh and blood humans against machines fitted with artificial intelligence (AI). Contestants, working unsupervised with all their usual resources, were presented with factual scenarios of PPI mis-selling claims and asked to predict whether or not the Financial Ombudsman would succeed in the claim. The AI team had an accuracy of 86.6%, while human error reduced the real-life lawyers to a 62.3% accuracy scoring.

Ludwig Bull, scientific director at CaseCrunch, the legal AI company which organised the contest, said: ‘These results show that if the question is defined precisely, machines are able to compete with and sometimes outperform human lawyers.’

Issue: 7768 / Categories: Legal News , Profession , Technology
printer mail-details

MOVERS & SHAKERS

Read All
Sponsored by
DWF—19 appointments

DWF—19 appointments

Belfast team bolstered by three senior hires and 16 further appointments

Cadwalader—Andro Atlaga

Cadwalader—Andro Atlaga

Firm strengthens leveraged finance team with London partner hire

Knights—Ella Dodgson & Rebecca Laffan

Knights—Ella Dodgson & Rebecca Laffan

Double hire marks launch of family team in Leeds

NEWS
Read All
NLJ this week: Fraud claims climb as courts brace for AI threats
Charlie Mercer and Astrid Gillam of Stewarts crunch the numbers on civil fraud claims in the English courts, in this week's NLJ. New data shows civil fraud claims rising steadily since 2014, with the King’s Bench Division overtaking the Commercial Court as the forum of choice for lower-value disputes
NLJ this week: Pro bono power without the red tape
Bea Rossetto of the National Pro Bono Centre makes the case for ‘General Practice Pro Bono’—using core legal skills to deliver life-changing support, without the need for niche expertise—in this week's NLJ
NLJ this week: Traders’ convictions quashed in Libor shock
The Supreme Court issued a landmark judgment in July that overturned the convictions of Tom Hayes and Carlo Palombo, once poster boys of the Libor and Euribor scandal. In NLJ this week, Neil Swift of Peters & Peters considers what the ruling means for financial law enforcement
NLJ this week: Small firms call for tech clarity as AI looms
Small law firms want to embrace technology but feel lost in a maze of jargon, costs and compliance fears, writes Aisling O’Connell of the Solicitors Regulation Authority in this week's NLJ
NLJ this week: Trans pool player loses discrimination fight
Charles Pigott of Mills & Reeve reports on Haynes v Thomson, the first judicial application of the Supreme Court’s For Women Scotland ruling in a discrimination claim, in this week's NLJ
Copyright © 2025 LexisNexis
back-to-top-scroll