White House AI czar David Sacks alleged Tuesday that DeepSeek had used OpenAI’s data outputs to train its latest models through a process called distillation.

DeepSeek didn't invent distillation, but it woke up the AI world to its disruptive potential. It also ushered in the rise of a new open-source order — a belief that transparency and ...

Distillation, also known as model or knowledge distillation, is a process where knowledge is transferred from a large, complex AI ‘teacher’ model to a smaller and more efficient ‘student ...

A flurry of developments in late January 2025 has caused quite a buzz in the AI world. On January 20, DeepSeek released a new open-source AI model called R1 and an accompanying research paper.

OpenAI has said that it believes that DeepSeek, the Chinese start-up behind the shockingly powerful AI model that launched last month, may have ripped off its technology. The irony is rich: We ...

Distillation is often used to train new systems. If a company takes data from proprietary technology, the practice may be legally problematic. But it is often allowed by open source technologies.

Knowledge distillation can create more intelligent, efficient student models that bring AI closer to real-time decision making and democratization and make advanced AI systems more practical ...

Why ‘Distillation’ Has Become the Scariest Word for AI Companies DeepSeek’s success learning from bigger AI models raises questions about the billions being spent on the most advanced technology ...

How AI model distillation works. The process of model distillation begins with a pre-trained teacher model. This teacher model has already been trained on a large dataset and is capable of making ...

Distillation has shown to be a good method for cheaply re-creating an AI model’s capabilities, but it doesn’t create new AI models vastly better than what’s available today. Topics ...