"DeepSeek produced a model close to the performance of US models 7-10 months older, for a good deal less cost (but NOT anywhere near the ratios people have suggested)" says Anthropic's CEO

Anthropic's CEO has a word about DeepSeek.

Here are some of his statements:

  • "Claude 3.5 Sonnet is a mid-sized model that cost a few $10M's to train"

  • 3.5 Sonnet did not involve a larger or more expensive model

  • "Sonnet's training was conducted 9-12 months ago, while Sonnet remains notably ahead of DeepSeek in many internal and external evals. "

  • DeepSeek's cost efficiency is x8 compared to Sonnet, which is much less than the "original GPT-4 to Claude 3.5 Sonnet inference price differential (10x)." Yet 3.5 Sonnet is a better model than GPT-4, while DeepSeek is not.

TL;DR: Although DeepSeekV3 was a real deal, but such innovation has been achieved regularly by U.S. AI companies. DeepSeek had enough resources to make it happen. /s

I guess an important distinction, that the Anthorpic CEO refuses to recognize, is the fact that DeepSeekV3 it open weight. In his mind, it is U.S. vs China. It appears that he doesn't give a fuck about local LLMs.