Open models recap: more on Kimi K3, Qwen 3.8, Xi's WAIC speech, distillation, the open-closed gap, and what's next
The podcast examines the progress in open model development, highlighting models like Qwen 3.8 and Kimi K3, and discusses challenges in benchmarking, distillation, and post-training fine-tuning. It notes the growing infrastructure and economic incentives in China, with significant investments in labs and the impact of chip smuggling. The open ecosystem is expected to expand, driven by the potential of open models in niche tasks and future advancements, while emphasizing the importance of capital efficiency and resource allocation.
More videos from Interconnects
I wrote an AI textbook — how long until AI can do it better?
Reflections on AI's writing ability and how AI models get more capable.
interconnects.ai··Mads Kristian Nylund·AI EducationAI GovernanceAI Ethics
5 useful things you'll learn in my new post-training textbook (shipping now!)
After a few long years of finding time to document my lessons from training open models, my post-training book is done!
interconnects.ai··Mads Kristian Nylund·AI EducationAI DevelopmentAI Tools
Lessons from the hacks
Musings on model alignment, what determines safety, and where we go from here.
interconnects.ai··Mads Kristian Nylund·AI InfrastructureAI GovernanceAI Ethics