
Open-source AI without Jensen A decapitation. It’s time to rebuild. interconnects.ai/p/open-sour…

What you need to know about the latest models and AI research trends, from @natolambert

Open-source AI without Jensen A decapitation. It’s time to rebuild. interconnects.ai/p/open-sour…

How well can we measure open model inference share? Our first open model economy research note for paid subscribers. interconnects.ai/p/how-well-…

New talk on the open model economy. I wanted to break down the case of where open model builders should steer the economics of the industry, if we want to avoid being swallowed by OpenAI and Anthropic in due time. This rests fully on being able to drive the cost of inference down dramatically on specialized, repetitive tasks, rather than trying to compete on cost with the frontier labs in any general agent. A core piece of it is how the open model economy is very fragmented, leaving an interesting puzzle we need to solve to get revenue from applications to feed back into the next model cycle. This is a very near-term problem as closed labs scale rapidly. This talk investigates: Are people using open models? How close are open models to the frontier? Mapping the open model economy How open models win This is a practice recording of my talk "How Open Models Win" for Fireworks Forge 2026 in San Francisco (3 November 2026), which will have improvements over this one.

Was I wrong about open models & cyber risks? interconnects.ai/p/was-i-wro…

Artificial Analysis v5 and the benchmarker's dilemma A sort of review of the benchmarking industry and what's missing. interconnects.ai/p/artificia…

My first open model lecture, covering all the many pieces that build the ecosystem, and the open questions/debates determining where it goes next. How does distillation fit in? How do we manage risks? How do we see access to models changing in the future? I'm excited to revisit these questions about every 6 months, to give a state of the union on the field. Chapters 00:00 Introduction 01:36 What is an open model? 08:47 Why should we care about open models? 18:52 How competitive are the best open models today? 25:28 How are open models built? The role of distillation 34:52 Are people actually using open models? 41:47 What comes next with open models? 47:32 Conclusions What questions did I not answer that you have?

Interconnects Podcast #20: We got together to debate hard questions and messy realities after a crazy, somewhat intimidating, week in the AI world: - Why did Kimi K3.1 Pro have a mixed reaction with such incredible benchmarks? Will it be adopted? - Were we wrong about the risks of open-weight models and cybersecurity? - Why do cyber experts discuss recent events so differently than AI experts? - What comes next in the few months? What will change our minds? Chapters: 00:00 Kimi K3.1 Reaction 08:15 Kimi’s open-weight cyber principles 11:23 You can hack everything era 15:54 PHP2Shell, LiteLLM, and the new internet 24:00 Abliterated APIs, safeguards, and trusted access 31:41 Anthropic not hiring juniors employees 36:16 Florian’s Muse addiction 45:30 Wrap-up More of these soon!

Interconnects Podcast: Kimi K3.1 Pro, the new cyber reality, and Muse musings #20 YouTube: youtu.be/0xiq7RHVGRE Transcript / Podcast: interconnects.ai/p/podcast-k…

Finally got to put together a complete deck on the state of open models. What they are, licenses, how competitive they are, signs people are using them, distillation's impact, and how we balance the risks and benefits of openness! Will record a video lecture of these soon, and hopefully re-do them a few times a year.


Artifacts 25: DeepSeek V4.1 Flash 1017, American-made models, and new regulatory controls in the US & China. 28 models you should be aware of, from: DeepSeek @deepseek_ai (2) NVIDIA @NVIDIAAI (2) Ornith @ornith_ (2) Liquid AI @liquidai (2) Xiaomi @Xiaomi Cloudflare @Cloudflare Reflection @reflection_ai Prism ML @PrismML InclusionAI @TheInclusionAI Meta @AIatMeta StepFun @StepFun_ai Moondream @moondreamai FluidVoice @FluidVoiceApp Aikido Security @AikidoSecurity Trillion Labs @TrillionLabs InternLM @intern_lm Cohere @Cohere_Labs Mistral AI @mistralai Institute of Foundation Models @IFM_AI Perplexity @perplexity_ai Google @GoogleAI Black Forest Labs @bfl_ai Qwen @alibaba_qwen Fish Audio @FishAudio Read the issue below.

Meta shakes up the frontiers, open and closed US open weights are back! interconnects.ai/p/meta-shak…

Nathan Lambert of @trillium_labs says Chinese AI researchers' jaws drop to the floor when he tells them how much compute OpenAI has: "The Chinese labs are very technically excellent. They are more compute-starved." "Without a doubt, they have a comparable talent pool to draw on... To say that China is anything but equal on talent, you're gonna have a hard time because they just have so many people being trained at such a high level." "What they don't have is compute." "You talk to people there, and you're like, 'Oh, I heard an average OpenAI researcher has five thousand H100 equivalents that they can access at any time,' and like their jaw just falls to the floor. They're just like, 'I can't comprehend.'" @natolambert @lishali88
Nathan Lambert, former post-training co-lead at the Allen Institute for AI, now launching Trillium, a nonprofit open AI lab, joins a16z's Lisha Li to discuss whether open models can really keep up with the frontier. When he tells researchers in China that an average OpenAI researcher reportedly has five thousand H100s to work with, "their jaw just falls to the floor." In his view, Chinese labs have the talent but are mostly short on compute. He also thinks the distillation story is overblown. Based on the research, he puts its edge at a few months, and says "there's a bit of cope" in thinking only American labs can build good models. A lot of frontier progress outside math and code comes down to labs buying 1) data and 2) RL environments. It's a multibillion-dollar market, and some of it is sloppy enough to teach models to reward hack. That's a big part of why Trillium exists. Nathan wants to give away the environments other people would sell, and show exactly how his team uses AI to build AI, including where the models still get stuck. His bet is that the more people can see how this works, the better prepared everyone is for what's coming. 0:55 Can open models keep up with the frontier? 2:05 What it takes to reach the frontier 3:55 Open weights and the fast-follower playbook 8:25 Chinese labs: equal talent, less compute 9:55 Why distillation is harder than it looks 14:55 Is distillation theft or competition? 16:20 The lab flywheel vs owning your weights 21:45 Can general models beat every specialist? 26:30 AI at 1% of today's cost in 4 years 27:15 The RL env boom and reward hacking 31:30 What Trillium will build in the open 35:30 Breaking into AI in the age of AI slop 38:05 Open-sourcing how AI builds AI 44:25 Why Nathan isn't pre-training 49:45 Agent swarms and why lab secrets leak 54:25 Fast takeoff vs risks already here YouTube: youtu.be/BKuK0M6oDTI @natolambert @trillium_labs @lishali88

We've been monitoring a decline in HuggingFace downloads across the top open LLMs we track for interconnects. It looks like there was a slight change in counting of downloads, as we saw a ~30% download rate drop for many top models, but this is continuing over time. What else do people think it may be?

I expect rapid progress but not towards general superintelligence Musings on RSI after a week in SF. interconnects.ai/p/i-expect-…
