In a recent experiment, Anthropic created a classified marketplace where AI agents represented both buyers and sellers, striking real deals for real goods and real money.
The company admitted this test — which it called Project Deal — was only “a pilot experiment with a self-selected participant pool” of 69 Anthropic employees who were given a budget of $100 (paid out via gift cards) to buy stuff from their coworkers.
Nonetheless, Anthropic said it was “struck by how well Project Deal worked,” with 186 deals made, totaling more than $4,000 in value.
The company said it actually ran four separate marketplaces with different models — one that was “real” (where everyone was represented by the company’s most-advanced model, and with deals actually honored after the experiment) and another three for study.
Apparently, when users are represented by more advanced models, they get “objectively better outcomes,” Anthropic said. But users didn’t seem to notice the disparity, raising the possibility of “‘agent quality’ gaps” where “people on the losing end might not realize they’re worse off.”
Also, the initial instructions given to the agents didn’t appear to affect sale likelihood or the negotiated prices.
By Kari Barclay. As Kari Barclay drives between their lefty liberal arts campus and the…
Braden Schneider has been in the news a lot lately. From trade rumors to his…
Update July 22 at 4:37 am UTC: The article has been updated to include additional…
One of the most striking elements of Fleabag was the fact she constantly broke the…
Major new report from the White House Office of Science and Technology Policy. Five things…
It’s no question that everybody—and students especially—could benefit from less screen time. But what if…