Categories: ECONOMY

Law professors prefer AI over peer answers


Large language models (LLMs) are increasingly promoted as educational tutors, yet most evaluations focus on domains with a single ground truth. Many disciplines, however, hinge on judgment: reasoning, weighing ambiguity, and reaching defensible conclusions. Law provides a sharp test. We conducted a blinded evaluation of short-answer tutoring in contracts courses with sixteen U.S. law professors. Participants created 40 representative questions, wrote answers, and judged 2,918 anonymized comparisons between human and LLM responses. Professors rated LLMs far higher than their peers (average win rate = 75.33%), with models performing similarly to the best instructor. LLM responses were also rarely flagged as harmful (3.53%, vs 12.06% for professors). Preferences for LLM answers were consistent across evaluators and reflected shared professional standards. Our evaluation can be reliably extended to additional models by employing a separate LLM as a judge, rendering expert agreements an effective, scalable method to evaluate AI tutors in judgment-rich domains.

“far”.  That is from a new paper by Alejandro Salinas, et.al.  Via Andrew Curran.  And via John Chamberlain:

Artificial intelligence (AI) and large language models (LLMs) tools are capable of mass-producing academic finance papers that are nearly indistinguishable from human-authored research, according to a new study published in the Journal of Economic Literature.

C’mon people, get ready.  I know it is difficult to admit when your human capital has been devalued, but that time is upon us.  In particular, being prolific is no longer such a comparative advantage in academia.  You might run to the “but I know what questions to ask” cope, but I implore you to solve for the equilibrium.  What is the equilibtium wage for merely asking questions?

Of course academic life and projects will continue, but the real rewards will go to people doing new, innovative, and hitherto impossible projects with AI.



Source link

Mainedigitalnews.com

Share
Published by
Mainedigitalnews.com

Recent Posts

A Conversation about L.S.D. (…just the high points…) Renovation

By . Tipton and Sluyter will reflect on how the Group’s current company uses modern…

11 hours ago

New York Rangers trade Spencer Martin to Chicago Blackhawks in goalie swap

The New York Rangers and Chicago Blackhawks have swapped goalies. The Rangers have sent Spencer…

11 hours ago

ASTER Plunges 32% as CEO Probes Price Swings

Aster CEO Leonard Leung says the team is investigating a sharp swing in its ASTER…

11 hours ago

The hidden meanings in Hokusai's iconic Great Wave

Hokusai's 1831 masterpiece is mysterious, elusive and has "a power to befuddle" Source link

11 hours ago

Classroom Reset Cleanup Activity (Free Printable)

Ready to work together as a team to refresh and reset your classroom? This collaborative…

11 hours ago

Phylicia Rashad Is Having the Most Fun on ‘The Gilded Age’

Photo: Karolina Wojtasik/HBO Sign up for The Gilded Age Club, a subscriber-exclusive newsletter where writers…

11 hours ago