
Different AI models rely on different mixes of news sources to answer the same political questions -- super interesting new research from my collaborators at @freesystemslab! As we build towards political superintelligence, there are going to be a bunch of important questions about how to incorporate news content. Before we figure all that out, we need basic facts about how things are working on the ground today. This research is super helpful for that, and I'm thrilled that @danmthomp and Sho Miyazaki are doing such great work on this topic.
📰 New research: Inside AI’s election news diet What news does AI read to get up to speed on politics? And what kind of news does it reward? Following interesting recent commentary on our Japan election study from @mattyglesias, @JerusalemDemsas and @TheStalwart, we ran a bigger test on the US midterms across 35 Senate races, 18 days, and 15,750 answers. What we found: - Each model has its own favorite news outlet for political news: AP for GPT, Yahoo for Claude, PBS for Gemini, and NYT for Grok. - GPT tends to behave like a civic guide (reading more election office and campaign sites), whereas Claude behaves more like a news summarizer (reading national news, Wikipedia, polls). - Grok draws on X and Gemini on YouTube for political information, far more than the other models we studied. Gemini cites YouTube in 55% of its answers and X shows up in 59% of Grok’s. - A huge share of AI's local news is provided by large nonprofit networks that very few people will have heard of. States Newsroom, a large network of over 40 local newsrooms, appears in 60% of GPT’s answers. - For many models, prediction markets are now a go-to source for polling information. Kalshi is cited more by Claude than any poll aggregator. Full study here: freesystems.substack.com/p/i…












