header-logo header-logo

NLJ this week: When AI hallucinates, lawyers risk real-world sanctions

241420
The dangers of uncritical artificial intelligence (AI) use in legal practice are no longer hypothetical. In this week's NLJ, Dr Charanjit Singh of Holborn Chambers examines cases where lawyers relied on ‘hallucinated’ citations — entirely fictitious authorities generated by AI tools

From US sanctions to UK High Court referrals under the Hamid jurisdiction, courts have made clear that professional duties cannot be delegated to technology.

Singh explains that AI systems predict plausible-sounding text rather than verify truth, meaning fabricated cases can appear alarmingly authentic. As Dame Victoria Sharp warned, misuse carries ‘serious implications for the administration of justice and public confidence’.

While techniques such as retrieval-augmented generation may reduce risks, Singh stresses that every reference must still be checked manually. His message is unequivocal: ‘Legal research should never be completely outsourced to AI’. Used responsibly, AI can augment practice; used lazily, it risks misconduct, reputational damage and loss of trust.

MOVERS & SHAKERS

Keystone Law—Milena Szuniewicz-Wenzel & Ian Hopkinson

Keystone Law—Milena Szuniewicz-Wenzel & Ian Hopkinson

International arbitration team strengthened by double partner hire

Coodes Solicitors—Pam Johns, Rachel Pearce & Bradley Kaine

Coodes Solicitors—Pam Johns, Rachel Pearce & Bradley Kaine

Firm celebrates trio holding senior regional law society and junior lawyers division roles

Michelman Robinson—Sukhi Kaler

Michelman Robinson—Sukhi Kaler

Partner joins commercial and business litigation team in London

NEWS
The government has pledged to ‘move fast’ to protect children from harm caused by artificial intelligence (AI) chatbots, and could impose limits on social media as early as the summer
All eyes will be on the Court of Appeal (or its YouTube livestream) next week as it sits to consider the controversial Mazur judgment
An NHS Foundation Trust breached a consultant’s contract by delegating an investigation into his knowledge of nurse Lucy Letby’s case
Draft guidance for schools on how to support gender-questioning pupils provides ‘more clarity’, but headteachers may still need legal advice, an education lawyer has said
Litigation funder Innsworth Capital, which funded behemoth opt-out action Merricks v Mastercard, can bring a judicial review, the High Court ruled last week
back-to-top-scroll