On Friday, NovaSky, a team of researchers based out of UC Berkeley's Sky Computing Lab, released Sky-T1-32B-Preview, a reasoning model that's competitive with an earlier version of OpenAI's o1 on a number of key benchmarks. Sky-T1 appears to be the first truly open source reasoning model in the sense that it can be replicated from scratch; the team released the data set they used to train it as well as the necessary training code. 'Remarkably, Sky-T1-32B-Preview was trained for less than $450,' the team wrote in a blog post, 'demonstrating that it is possible to replicate high-level reasoning capabilities affordably and efficiently.' $450 might not sound that affordable. But it wasn't long ago that the price tag for training a model with comparable performance often ranged in the millions of dollars. Synthetic training data, or training data generated by other models, has helped drive costs down. Palmyra X 004, a model recently released by AI company Writer, trained almost entirely...
learn more
Ratings & Reviews
Entrepreneur & Investor
YOU MIGHT ALSO LIKE