COLIN DOYLE
RESEARCH
TEACHING
CV
AI evaluation
Using Differences in State Law to Test Whether LLMs Reason or Remember
When a large language model correctly applies a legal rule to facts, it’s hard to tell whether the model has reasoned its way to the answer or has followed a context-specific pattern learned from its training data.
Colin Doyle
,
Aaron D. Tucker
PDF
If You Give an LLM a Legal Practice Guide
Large language models struggle to answer legal questions that require applying detailed, jurisdiction-specific legal rules.
Colin Doyle
,
Aaron D. Tucker
PDF
DOI
The Restatement (Artificial) of Torts
This article experiments with processes for using large language models to construct a Restatement of Torts based upon the model’s understanding of leading torts cases.
Colin Doyle
PDF
Source Document
Cite
×