COLIN DOYLE
RESEARCH
TEACHING
CV
large language models
Using Differences in State Law to Test Whether LLMs Reason or Remember
When a large language model correctly applies a legal rule to facts, it’s hard to tell whether the model has reasoned its way to the answer or has followed a context-specific pattern learned from its training data.
Colin Doyle
,
Aaron D. Tucker
PDF
Automation and Access to Justice
The United States faces an access-to-justice crisis. Legal technology has emerged as a potential solution, with generative AI offering new possibilities for automating access to justice. But questions linger about whether AI can automate legal reasoning and whether such capabilities would expand…
Colin Doyle
PDF
DOI
If You Give an LLM a Legal Practice Guide
Large language models struggle to answer legal questions that require applying detailed, jurisdiction-specific legal rules.
Colin Doyle
,
Aaron D. Tucker
PDF
DOI
LLMs as Method Actors: A Model for Prompt Engineering and Architecture
We introduce “Method Actors” as a mental model for guiding LLM prompt engineering and prompt architecture.
Colin Doyle
PDF
Source Document
The Restatement (Artificial) of Torts
This article experiments with processes for using large language models to construct a Restatement of Torts based upon the model’s understanding of leading torts cases.
Colin Doyle
PDF
Source Document
Cite
×