The company admitted this test ' which it called Project Deal ' was only 'a pilot experiment with a self-selected participant pool' of 69 Anthropic employees who were given a budget of $100 (paid out via gift cards) to buy stuff from their coworkers. The company said it actually ran four separate marketplaces with different models ' one that was 'real' (where everyone was represented by the company's most-advanced model, and with deals actually honored after the experiment) and another three for study. Apparently, when users are represented by more advanced models, they get 'objectively better outcomes,' Anthropic said. But users didn't seem to notice the disparity, raising the possibility of ''agent quality' gaps' where 'people on the losing end might not realize they're worse off.' StrictlyVC kicks off the year in SF. Register now for unfiltered fireside chats and VC insights with leaders from Uber, Replit, Eclipse, and more. Plus, high-value connections that actually move the...
learn more
