header-logo header-logo

NLJ this week: When AI hallucinates, lawyers risk real-world sanctions

241420
The dangers of uncritical artificial intelligence (AI) use in legal practice are no longer hypothetical. In this week's NLJ, Dr Charanjit Singh of Holborn Chambers examines cases where lawyers relied on ‘hallucinated’ citations — entirely fictitious authorities generated by AI tools

From US sanctions to UK High Court referrals under the Hamid jurisdiction, courts have made clear that professional duties cannot be delegated to technology.

Singh explains that AI systems predict plausible-sounding text rather than verify truth, meaning fabricated cases can appear alarmingly authentic. As Dame Victoria Sharp warned, misuse carries ‘serious implications for the administration of justice and public confidence’.

While techniques such as retrieval-augmented generation may reduce risks, Singh stresses that every reference must still be checked manually. His message is unequivocal: ‘Legal research should never be completely outsourced to AI’. Used responsibly, AI can augment practice; used lazily, it risks misconduct, reputational damage and loss of trust.

MOVERS & SHAKERS

Walkers—Muriel Marseille

Walkers—Muriel Marseille

Ashurst's Chief Risk Officer joins Walkers

Excello Law—John Osborne

Excello Law—John Osborne

Northern family lawyer John Osborne joins Excello

mfg Solicitors—Rebecca Rogers, Kennedy Langley & Victoria Griffiths

mfg Solicitors—Rebecca Rogers, Kennedy Langley & Victoria Griffiths

Trio of promotions announced at Kidderminster law firm mfg Solicitors

NEWS
A sole director can conspire with their own company for the purposes of the tort of unlawful means conspiracy, the High Court has ruled in a judgment with potentially wide implications for business disputes
The Court of Appeal has reinforced that domicile depends on intention rather than residence alone, in a significant post-Brexit ruling on cross-border financial remedy claims
The Chancery Division's long history comes to an end this autumn as it is reborn as the Business and Property Division, prompting questions over whether the shake-up is really necessary
The Financial Conduct Authority (FCA) continues to show that failing to disclose regulatory issues can attract harsher consequences than the original misconduct itself
Rejecting a generous settlement can prove an expensive mistake, as two recent high-profile cases demonstrate
back-to-top-scroll