Here, the bigger, more complex model — which is considered to be the "teacher model" — transfers much of its learnings to the smaller "student model.""They can essentially mimic the reasoning process that they learn from the parent model and they can suck the knowledge out of the parent model,

David Sacks says OpenAI has evidence that Chinese company DeepSeek used a technique called "distillation" to build a rival model.