Eventually, the Steam Drill Always Wins: "Law Professors Prefer AI Over Peer Answers"
A study involving sixteen U.S. law professors evaluated the effectiveness of AI-generated answers compared to peer responses in contracts courses. The results showed that LLMs were rated significantly higher than human responses, with an average win rate of 75.33%. The findings suggest that LLMs not only meet but often exceed professional standards in legal education.
- ▪Sixteen contracts professors from fourteen U.S. law schools participated in the study.
- ▪LLMs received an average win rate of 75.33% compared to their human counterparts.
- ▪Harmfulness rates for LLM responses were low, with only 3.53% flagged as harmful.
Opening excerpt (first ~120 words) tap to expand
Artificial Intelligence Eventually, the Steam Drill Always Wins: "Law Professors Prefer AI Over Peer Answers" Eugene Volokh | 6.2.2026 2:03 PM <img fetchpriority="high" decoding="async" class="size-large wp-image-8378801" src="https://d2eehagpk5cl65.cloudfront.net/img/q60/uploads/2026/04/Bradypus_tridactylus_skull1-1024x589.jpg" alt="" width="1024" height="589" srcset="https://d2eehagpk5cl65.cloudfront.net/img/q60/uploads/2026/04/Bradypus_tridactylus_skull1-1024x589.jpg 1024w, https://d2eehagpk5cl65.cloudfront.net/img/q60/uploads/2026/04/Bradypus_tridactylus_skull1-300x173.jpg 300w, https://d2eehagpk5cl65.cloudfront.net/img/q60/uploads/2026/04/Bradypus_tridactylus_skull1-768x442.jpg 768w, https://d2eehagpk5cl65.cloudfront.net/img/q60/uploads/2026/04/Bradypus_tridactylus_skull1.jpg 1100w"…
Excerpt limited to ~120 words for fair-use compliance. The full article is at Reason.com.
Discussion
0 commentsMore from Reason.com
