Case Study: LawTech Open Innovation Lab
Independently benchmarked by leading firms.
In SuperTech WM's 2026 LawTech Open Innovation Lab, three leading UK law firms tested Chancery on real legal tasks and the results were independently measured.
The Results
Faster work, faithful to the source.
32.7%
average time saved on real legal tasks
Over 50% on some tasks.
4.08 / 5
Faithfulness to source. The top score in the field, where the average was 3.56.
Zero
Outputs flagged unsafe or unusable.
Benchmarked by
Three leading UK law firms
Source: SuperTech WM LawTech Open Innovation Lab, 2026.
What the Reviewers Said
In their own words.
“Superb structure to the output, a sense of systematic, thorough analysis.”
On senior time-saving and supervision
“…Chancery shines in this area, because the output is so structured and systematic, with no sign of hallucination (that I could see).”
On collaboration
“The UI makes it easy for senior and junior to collaborate within Chancery – a brilliant feature.”
On the output
“Highly structured, easy-to-review, clear, readable and professional output.”
The Programme
A shared benchmark for legal AI.
Law firms are adopting AI quickly, but without shared benchmarks or consistent ways to evaluate it. Pilots are costly in time and attention, and firms often duplicate each other's effort.
The LawTech Open Innovation Lab, run by SuperTech WM, was set up to change that. It is not a procurement exercise or a vendor showcase. Legal technology vendors and law firm teams work side by side, testing tools on real workflows against benchmarking frameworks designed for the programme.
In 2026, three leading UK law firms took part. Chancery was one of the technology providers, and the firms assessed our outputs alongside those of the other vendors in the field.
At a glance
- Run by
- SuperTech WM
- Programme
- 20 March to 6 May 2026, closing with a Showcase Day
- Law firms
- Three leading UK law firms
- Academic partner
- Aston University
- Funding
- Part-funded by the West Midlands Combined Authority
How It Was Assessed
Real tasks, judged by lawyers.
Each tool was benchmarked against the criteria SuperTech WM set for the programme.
01
Time saved against effort
How much faster the work gets done, net of the effort it takes to set up and use the tool.
02
Output quality and accuracy
Whether the output is correct and good enough to rely on.
03
Supervision burden
How much junior and senior review time the output needs before it can be used.
04
Hallucination and risk controls
Whether the tool stays faithful to its sources and flags what it cannot support.
05
Integration friction
How easily the tool fits into the way a firm already works.
06
Scalability and cost
Whether the tool is practical to roll out across a firm at a sensible cost.
Why It Matters
Evidence you can check.
Measured by the firms, not by us
These results come from independent benchmarking by the participating firms, not from our own testing.
Faithful to the source
Chancery scored highest in the field for faithfulness to source. Every answer cites the passage it relies on, and Chancery Verify checks each citation against the stored document.
Safety shown, not just claimed
Not one Chancery output was flagged unsafe or unusable by the reviewing firms.
See the platform the firms benchmarked.
Bring a real task to a demo and we will show you how Chancery handles it.