This website will offer limited functionality in this browser. We only support the recent versions of major browsers like Chrome, Firefox, Safari, and Edge.

Search the website
Thought Leadership

AI and Expert Evidence: Opportunities, Risks and Responsibilities

Picture of Tom Whittaker
Passle image

Speaking at the Bond Solon Expert Witness Conference, Mrs Justice Joanna Smith, co-chair of the working group responsible for the CJC final report on the “Use of AI for Preparing Court Documents”, addressed how AI has the potential to improve efficiency and productivity in the process of producing expert evidence, helping experts process large volumes of information, identify patterns and communicate complex material more effectively. But its rapid development does not change the fundamentals. Experts’ duties of independence, objectivity, transparency, and professional competence remain exactly the same.

Below we summarise some of the key takeaways from the conference speech:

The CJC recommends an AI declaration for experts

The CJC final report on the use of AI for preparing court documents recommended a new AI specific declaration where an expert uses AI to generate or influence the substantive content of their report, including their methodology or substantive analysis. Where required, the declaration should provide sufficient information to enable the opposing party and court to scrutinise the expert’s methodology effectively. This may, where necessary, include identifying the AI tool used. Please see our article here on the CJC final report. 

AI can be used safely, but experts need to understand its limits

AI can assist with administrative tasks, information management, and drafting support, including organising and classifying documents, creating chronologies, summarising material, research, structuring reports and checking for errors or inconsistencies. However, administrative use can cross into substance. An AI summary may miss context or nuance, a transcription may inaccurately reflect what was said, and a tool used to structure material may subtly influence the content. Experts therefore need to understand what the technology is capable of and its limitations.

The key risks go beyond hallucinations, to training, understanding, and oversight

Hallucinations, confidentiality breaches, and technical misunderstandings are important risks. Inappropriate reliance on AI risks eroding independent judgment and outsourcing the expert’s opinion. Experts must verify factual assertions, references, and conclusions, rather than taking AI outputs at face value. 

At a practical level, a lack of training in the relevant AI tool, insufficient understanding of what it is capable of and inadequate oversight are also significant risks. Where teams are used to analyse material or carry out research, experts should understand what AI tools team members are using and how they have been used, even where the expert has not used those tools themselves. Strict protocols should also ensure that team members understand the importance of being clear with the expert about their use of AI.

Practical safeguards should start at the point of instruction

Experts should consider from the outset whether AI use is permitted, whether the tool is fit for purpose and secure, and whether its limitations are understood. They should keep a proper record of its use and ensure outputs are validated. Where AI influences substantive content, experts should consider biases, hidden assumptions, reproducibility and whether every conclusion can be explained and defended as their own.

To this end, Mrs Justice Joanna Smith sets out a “number of important questions that every expert should bear in mind upon receipt of instructions” (verbatim as follows):

  1. What are my instructions on the subject of AI? May I use AI or is it prohibited for some reason (such as intellectual property concerns, data protection or regulatory compliance). Even if your instructions do not raise the issue, I think it makes good practical sense for you to disclose your intended use in the first instance and to discuss that use with your instructing solicitors.
  2. Does the technology that I intend to use incorporate AI? Do I need to carry out due diligence to investigate that question?
  3. Is the AI tool I intend to use fit for the purpose for which I intend to use it? Why has it been chosen over any other similar tool? Am I using the most up to date tool for this task? It might be necessary to carry out research into other similar tools that might be more suited to the purpose. One can readily imagine cross-examination around the question of whether you have used the best, most up to date tool for the task and, if not, why not.
  4. Is the tool I intend to use secure such that confidential or privileged information is not going to find its way into the public domain – a topic I suspect it will always be worth discussing with your instructing solicitors.
  5. Where you are working in a team – do all members of the team understand the importance of disclosing their use of AI and of keeping a written record of the key steps in the process, including how the output was used? Have they all had appropriate training?
  6. Whether you are working in a team or not: Do I understand how the AI system operates, including its limitations and the steps that have been taken by others in my team to validate its outputs? Could I explain these things in court if I had to do so?
  7. Do I have a proper record of how the AI tool has been used and the extent to which, if at all, it has generated or influenced substantive content?
  8. If it has generated or influenced substantive content, then I think there are 10 things you need to be asking yourselves:
    a) Do I need to disclose the AI tool that has been used and can I justify its use?
    b) Is the output robust and can it be reproduced?
    c) Might it be subject to any known biases in the AI tool or underlying data set on which the tool was trained and, if so, how might those impact the output?
    d) Might it include hidden assumptions?
    e) Have I done all that I can to verify the output?
    f) Have I applied sufficient human oversight to ensure that any hallucinations or errors have not found their way into the evidence?
    g) Are the opinions expressed genuinely my own?
    h) Can I explain every conclusion that I have arrived at?
    i) Would I be comfortable describing exactly how I used AI to a judge under oath?
    j) Coming full circle, have I complied with my professional duties?

Key takeaway

AI is a tool, not an expert. Responsibility ultimately remains with the expert witness. Transparency, verification, and professional judgment should be the guiding principles. The question is not whether experts should use AI tools, but how experts can use AI tools responsibly, safely and in a manner consistent with their obligations to the court.

For more information about the law, technology and practice of disclosure, contact Tom Whittaker or Stacie Bourton.

See more from Burges Salmon

Want more Burges Salmon content? Add us as a preferred source on Google to your favourites list for content and news you can trust.

Update your preferred sources

Follow us on LinkedIn

Be sure to follow us on LinkedIn and stay up to date with all the latest from Burges Salmon.

Follow us