Powerful @WSJ article by @katiebindley on how Gemini helped solve her 20-year medical mystery.
It connected decades of symptoms, synthesizing fragmented longitudinal data across labs, imaging reports, and surgical history, and flagged endometriosis & adenomyosis as potential diagnoses. It also gave her scripts to discuss with her care team and navigate care pathways.
A heartening demonstration of the tangible real world impact of our @GoogleDeepMind efforts in health.
wsj.com/health/wellness/how-…
Silicon Valley shows you everything at the extremes: a lot of great people, a lot of true a**holes. Ask anyone who's met Jensen Huang which bucket he's in. Not saying his sins are mild. Just that of everyone here who deserves this kind of fall, he's near the bottom of the list.
Sometimes it’s hard for me to understand why Dario gets so much unjustified hate, from scientists and non-scientists alike, for saying diseases like cancer will become relics of humanity’s past in a decade or so.
If you’ve done science both pre- and post-AI, you know how absurdly productive and fun it has become. Seeing model capabilities grow like this just gives me hope.
The future is going to be fun. And you know... maybe once we really pull this off, the best of humanity’s effort will have a different agenda than relieving our sufferings from diseases!
Something has shifted in the frontier! TahoeMysts, Tahoe's internal eval, is not easy (as evident from the pass rates here). For most of the year models crept up a point or two per release... the best ones still failing close to two-thirds. But look at Mythos 5.2, and especially Gemini 4 Carbon: 38% to 46% in one jump. These lines are almost vertical!
Something has shifted in the frontier! TahoeMysts, Tahoe's internal eval, is not easy (as evident from the pass rates here). For most of the year models crept up a point or two per release... the best ones still failing close to two-thirds. But look at Mythos 5.2, and especially Gemini 4 Carbon: 38% to 46% in one jump. These lines are almost vertical!
Something has shifted in the frontier! TahoeMysts, Tahoe's internal eval, is not easy (as evident from the pass rates here). For most of the year models crept up a point or two per release... the best ones still failing close to two-thirds. But look at Mythos 5.2, and especially Gemini 4 Carbon: 38% to 46% in one jump. These lines are almost vertical!
Big news! Full article below 👇
Fauna Bio’s rare biological data and powerful AI approaches have uncovered another promising obesity drug target. @EliLillyandCo has made an additional milestone payment for a second target identified through Convergence™ AI. Huge congratulations to the @faunabio team 🚀
businesswire.com/news/home/2…
Evaluating a model’s ability to tackle open-ended tasks in biology (and science more broadly) is hard.
Expert-curated tasks leave a lot wanting. Even setting scaling aside, it’s hard to find an outlier scientist impressed by their difficulty or grading rubric.
I’ve been thinking about a qualitative framework that would precede the ultimate validation outcome: three levels of model / harness output, judged by a superstar expert.
Tier 1: Reliable. “OK, this is solid. It doesn’t f*** up.”
Gets the fundamentals right.
Tier 2: Legit & interesting. “Well-reasoned, well-synthesized, genuinely interesting. But I could have gotten there.”
Rigor plus non-trivial synthesis.
Tier 3: Outlier insight. “F***, I wish I’d thought of that.”
Well-reasoned and surprising. Reachable from the evidence, yet I didn’t reach it. Worth investing in proper validation.
What makes a biological reasoning task verifiable? Our team @tahoe_ai has spent the last few months on that question and landed on one conviction: for human-difficult tasks with verifiable rewards, the answer key has to come from ground-truth experimental data.
Along the way we built thousands of such environments, which we call TahoeMysts, and we use them to evaluate frontier models (among other things). Every so often a new model produces a big jump, and it is always exciting. Today is one of those days: @claudeai Mythos 5.2!
We will say more about this work in the future. In the meantime, take a look at our results today.
Excited for the launch of Gemini for Healthcare!
We’re extending the Gemini agent with specialized healthcare skills and connectors to Epic, Optum, and more, built to support HIPAA compliance.
Instead of spending hours piecing together fragmented records and policies, care teams can offload the admin burden and get time back for what matters most: patient care.
Today, we’re announcing Gemini for healthcare.
This newest addition to our suite of purpose-built industry solutions extends the Gemini agent to health systems and health plans.
Learn more → goo.gle/4zf0s11
What makes a biological reasoning task verifiable? Our team @tahoe_ai has spent the last few months on that question and landed on one conviction: for human-difficult tasks with verifiable rewards, the answer key has to come from ground-truth experimental data.
Along the way we built thousands of such environments, which we call TahoeMysts, and we use them to evaluate frontier models (among other things). Every so often a new model produces a big jump, and it is always exciting. Today is one of those days: @claudeai Mythos 5.2!
We will say more about this work in the future. In the meantime, take a look at our results today.
Most benchmarks grade against what's already written down. In biology, the real answer key is what the cells did. 🧬
TahoeMysts from @tahoe_ai scores models against our proprietary experimental data.
📈 Mythos 5.2: 43% ➡️ 49% was an interesting observation today, a real jump, though with half the tasks still unsolved. 🧩
What makes a biological reasoning task verifiable? Our team @tahoe_ai has spent the last few months on that question and landed on one conviction: for human-difficult tasks with verifiable rewards, the answer key has to come from ground-truth experimental data.
Along the way we built thousands of such environments, which we call TahoeMysts, and we use them to evaluate frontier models (among other things). Every so often a new model produces a big jump, and it is always exciting. Today is one of those days: @claudeai Mythos 5.2!
We will say more about this work in the future. In the meantime, take a look at our results today.
I'm glad we have this internal eval. When the model version number just jumped from 5.1 to 5.2 I was expecting a minor performance increase. But the increase in biological reasoning ability was huge!
What makes a biological reasoning task verifiable? Our team @tahoe_ai has spent the last few months on that question and landed on one conviction: for human-difficult tasks with verifiable rewards, the answer key has to come from ground-truth experimental data.
Along the way we built thousands of such environments, which we call TahoeMysts, and we use them to evaluate frontier models (among other things). Every so often a new model produces a big jump, and it is always exciting. Today is one of those days: @claudeai Mythos 5.2!
We will say more about this work in the future. In the meantime, take a look at our results today.
One of many interesting results from our evals work. We've put a lot of thought in designing hard tasks grounded in experimental data that push the reasoning ability of the models. More to share soon.
What makes a biological reasoning task verifiable? Our team @tahoe_ai has spent the last few months on that question and landed on one conviction: for human-difficult tasks with verifiable rewards, the answer key has to come from ground-truth experimental data.
Along the way we built thousands of such environments, which we call TahoeMysts, and we use them to evaluate frontier models (among other things). Every so often a new model produces a big jump, and it is always exciting. Today is one of those days: @claudeai Mythos 5.2!
We will say more about this work in the future. In the meantime, take a look at our results today.
What makes a biological reasoning task verifiable? Our team @tahoe_ai has spent the last few months on that question and landed on one conviction: for human-difficult tasks with verifiable rewards, the answer key has to come from ground-truth experimental data.
Along the way we built thousands of such environments, which we call TahoeMysts, and we use them to evaluate frontier models (among other things). Every so often a new model produces a big jump, and it is always exciting. Today is one of those days: @claudeai Mythos 5.2!
We will say more about this work in the future. In the meantime, take a look at our results today.
I hope that this is not true.
And if it is and if @realDonaldTrump indeed has hesitations, I hope that those hesitations will win out as this would bring about unspeakable catastrophe for the people of Iran, who are the true victims of their rulers.
Under pressure from Israeli prime minister Benjamin Netanyahu, the Trump administration may be within days of launching a nuclear strike on Iran. The target would be Pickax Mountain in central Iran, where Israeli intelligence claims the Iranian government has restarted its nuclear enrichment program. No conventional weapon in the American arsenal can penetrate 300 feet of solid granite to destroy the tunnels where enrichment is supposedly taking place. The only military option is a nuclear strike. Netanyahu has been pushing hard for one. “Bibi calls Trump about it every day,” says an informed observer.
Netanyahu is cornered and desperate. After last week’s election results, he can’t form a government unless Trump intervenes directly in Israeli politics and brokers a deal with other parties that gives Netanyahu 61 seats in the Knesset. Otherwise, he is out as prime minister and on his way to ignominy, investigations and possibly jail. Netanyahu must stay close to Trump. He needs this war.
To that end, he’s applied maximum pressure to his closest allies in the administration, including Secretary of Defense Pete Hegseth and CENTCOM commander Brad Cooper. Both oppose a negotiated settlement to the war they’ve so grievously mismanaged; both are pushing to restart major combat operations. Secretary of State Marco Rubio and CIA director John Ratcliffe are also following Netanyahu’s lead, as are leaders of the Democratic Party. In a recent meeting on the subject, former president Barack Obama said he opposes the current Iran peace deal being drafted in Doha.
The rest of America’s longtime allies in the Middle East are terrified by the prospect of more war. On September 27th, Netanyahu flew secretly to Abu Dhabi to enlist the UAE in his lobbying effort for a final attack on Iran. The Emiratis refused. After eight months of conflict, Gulf economies are teetering. So are global energy and fertilizer markets. They won’t recover soon. Globally, there are a total of about 850 supertankers used to transport oil from producers to the rest of the world. In October alone, 11 of them were badly damaged in Hormuz. At this pace, a global depression is imminent. A nuclear strike would radically accelerate the destruction. Fallout from a ground explosion at Pickax Mountain would contaminate the Persian Gulf, poisoning the water supply for 100 million people.
And those are just some of the immediate consequences for the region. The rest of the world is every bit as exposed. No country other than the United States has ever used a nuclear weapon in war. Some would like to. An American nuclear attack on Iran would set a new precedent. The Russians have already told at least two other governments that an American nuclear strike on Iran would free them to use nuclear weapons against Ukraine. Pakistan and India would be tempted to do the same against each other, as would North Korea against Seoul. After the first nuclear strike, World War Three is inevitable. That war would be short and final.
We’ve been sleepwalking toward this moment for months. Since February, the administration has quietly rewritten America’s nuclear doctrine to make first use of so-called “battlefield nukes” easier and therefore more likely. No one in Washington in either party seems bothered by this. Now we’re on the brink of it.
Close observers say Trump is likely to decide by next weekend whether or not to use nuclear weapons. That would be November 7, six days from now. To his credit, he’s hesitating. At the moment, Trump is listening to his vice president, JD Vance, and to his envoy and friend Steve Witkoff, both of whom argue a deal with Iran can be made.
They’re right, though it won’t be simple. The Iranians are famously frustrating to negotiate with under any circumstances, and elements of that government have become more radical since Ayatollah Ali Khamenei and his family were killed in February. After decades of isolation, even relatively moderate Iranian leaders seem confused by how decisions are made in the West. (There is a widespread belief in Tehran, for example, that the United States government controls Israel.) But overall, people who have spoken to decision-makers in Iran say there is consensus there that more war is bad for everyone and a deal is worth making.
One group that hasn’t been consulted so far is the global population — the hundreds of millions of people who will be killed along with their children if Trump is pushed by Netanyahu into launching a nuclear strike next week. Now would be the time for them to speak up.