header-logo header-logo

NLJ this week: When AI hallucinates, lawyers risk real-world sanctions

241420
The dangers of uncritical artificial intelligence (AI) use in legal practice are no longer hypothetical. In this week's NLJ, Dr Charanjit Singh of Holborn Chambers examines cases where lawyers relied on ‘hallucinated’ citations — entirely fictitious authorities generated by AI tools

From US sanctions to UK High Court referrals under the Hamid jurisdiction, courts have made clear that professional duties cannot be delegated to technology.

Singh explains that AI systems predict plausible-sounding text rather than verify truth, meaning fabricated cases can appear alarmingly authentic. As Dame Victoria Sharp warned, misuse carries ‘serious implications for the administration of justice and public confidence’.

While techniques such as retrieval-augmented generation may reduce risks, Singh stresses that every reference must still be checked manually. His message is unequivocal: ‘Legal research should never be completely outsourced to AI’. Used responsibly, AI can augment practice; used lazily, it risks misconduct, reputational damage and loss of trust.

MOVERS & SHAKERS

Harneys—Maggie Kwok & George Weston

Harneys—Maggie Kwok & George Weston

Harneys senior leadership appointments

Freeths—Keith Browne & Jim Jordan

Freeths—Keith Browne & Jim Jordan

Freeths strengthens London Construction and Engineering practice with two strategic senior hires

Anthony Collins—Laura Moss

Anthony Collins—Laura Moss

Anthony Collins announces strategic hire to deepen skills base in the social business sector

NEWS
Existing defamation law can respond to AI ‘hallucinations’, but allocating responsibility will prove harder where outputs reach users without human intervention
The High Court has upheld a rare successful serious-irregularity challenge after an arbitrator relied on an implied term neither party had advanced
Thirty years after The Future of Law shook a profession still using fax machines, its central forecast looks increasingly less like prophecy and more like description
More than 100 teams from the legal and financial services sectors competed in five sports at the 51st Law Society RFC Festival of Sport earlier this month
Part-time status need only be an effective cause of less favourable treatment, rather than the sole cause, the Supreme Court has held in Augustine v Data Cars
back-to-top-scroll