Research on Andrew Sheveshttps://andrewsheves.com/tags/research/Recent content in Research on Andrew ShevesHugoen-usTue, 28 Jan 2025 00:00:00 +0000Reasoning Engine Benchmarks - Jan 2025https://andrewsheves.com/2025/01/28/reasoning-engine-benchmarks-jan-2025/Tue, 28 Jan 2025 00:00:00 +0000https://andrewsheves.com/2025/01/28/reasoning-engine-benchmarks-jan-2025/<h2 id="deepseek-r1-vs-claude-sonnet-35">DeepSeek R1 vs Claude Sonnet 3.5</h2> <p>There’s been a lot of excitement around the <a href="https://huggingface.co/deepseek-ai/DeepSeek-R1">Chinese Deepseek r1 model</a> that was released last week. Deepseek is a reasoning, chain of thought (CoT) model that’s shaken things up due to the comparatively tiny budget ($ 6 million, which is probably OpenAI’s o1 cost to run its warm-up sequence) needed to train a frontier model of this sort.</p> <p>(There’s also been a fair amount of dread as US AI models are no longer the only game in town and Deepseek was considerably cheaper than an of the US alternatives. US firms were hammered in Monday’s trading with over $100bn</p>