On Wednesday, Andon published a new installment in how things are going in its Vending-Bench research, where the lab has frontier models run a simulated vending machine business for a simulated year. The mission is simple: Make more money than the other models. It benchmarks the results in areas like final cash balance, prices paid to suppliers, and refunds paid. In the latest test, which included Claude Opus 5, GPT-5.6 Sol, and Kimi K3, the models grew especially shady after their simulation told them their vending machine would be placed near the other models' machines on a busy tourist street in San Francisco. Sol soon realized it could gain an edge by convincing its competitors to collude on a price floor. The models were all buying drinks at $1.50 a bottle, and Sol proposed they agree to sell for no less than $2.15. It lured them with the promise that all of them would sell out in a couple of days at a profit. Opus' water sales dropped to zero overnight. The next day, it sent...
learn more
