←
Nima Alidoust2,261 posts
Nima Alidoust avatar

Nima Alidoust

@nalidoust

CEO and Co-Founder, @tahoe_ai, Princeton PhD *15 زن، زندگی، آزادی

◷ Joined March 2015▧ 134 Photos and videos
Vivek Natarajan avatar
⟳ Nima Alidoust retweeted
Vivek Natarajan@vivnat·Nov 13

Powerful @WSJ article by @katiebindley on how Gemini helped solve her 20-year medical mystery. It connected decades of symptoms, synthesizing fragmented longitudinal data across labs, imaging reports, and surgical history, and flagged endometriosis & adenomyosis as potential diagnoses. It also gave her scripts to discuss with her care team and navigate care pathways. A heartening demonstration of the tangible real world impact of our @GoogleDeepMind efforts in health. wsj.com/health/wellness/how-…

Nima Alidoust avatar
Nima Alidoust@nalidoust·Nov 12

Silicon Valley shows you everything at the extremes: a lot of great people, a lot of true a**holes. Ask anyone who's met Jensen Huang which bucket he's in. Not saying his sins are mild. Just that of everyone here who deserves this kind of fall, he's near the bottom of the list.

Aiden M Sababi avatar
⟳ Nima Alidoust retweeted
Aiden M Sababi@AidenSababi·Nov 11

Sometimes it’s hard for me to understand why Dario gets so much unjustified hate, from scientists and non-scientists alike, for saying diseases like cancer will become relics of humanity’s past in a decade or so. If you’ve done science both pre- and post-AI, you know how absurdly productive and fun it has become. Seeing model capabilities grow like this just gives me hope. The future is going to be fun. And you know... maybe once we really pull this off, the best of humanity’s effort will have a different agenda than relieving our sufferings from diseases!

Something has shifted in the frontier! TahoeMysts, Tahoe's internal eval, is not easy (as evident from the pass rates here). For most of the year models crept up a point or two per release... the best ones still failing close to two-thirds. But look at Mythos 5.2, and especially Gemini 4 Carbon: 38% to 46% in one jump. These lines are almost vertical!

Post attachment
Nima Alidoust avatar
Nima Alidoust@nalidoust·Nov 11

Machina ex machina.

Something has shifted in the frontier! TahoeMysts, Tahoe's internal eval, is not easy (as evident from the pass rates here). For most of the year models crept up a point or two per release... the best ones still failing close to two-thirds. But look at Mythos 5.2, and especially Gemini 4 Carbon: 38% to 46% in one jump. These lines are almost vertical!

Post attachment
Hani Goodarzi avatar
⟳ Nima Alidoust retweeted
Hani Goodarzi@genophoria·Nov 11

Something has shifted in the frontier! TahoeMysts, Tahoe's internal eval, is not easy (as evident from the pass rates here). For most of the year models crept up a point or two per release... the best ones still failing close to two-thirds. But look at Mythos 5.2, and especially Gemini 4 Carbon: 38% to 46% in one jump. These lines are almost vertical!

Post attachment
Linda Goodman avatar
⟳ Nima Alidoust retweeted
Linda Goodman@LindaBGoodman·Nov 11

Big news! Full article below 👇 Fauna Bio’s rare biological data and powerful AI approaches have uncovered another promising obesity drug target. @EliLillyandCo has made an additional milestone payment for a second target identified through Convergence™ AI. Huge congratulations to the @faunabio team 🚀 businesswire.com/news/home/2…

Post attachment
Nima Alidoust avatar
Nima Alidoust@nalidoust·Nov 11

Evaluating a model’s ability to tackle open-ended tasks in biology (and science more broadly) is hard. Expert-curated tasks leave a lot wanting. Even setting scaling aside, it’s hard to find an outlier scientist impressed by their difficulty or grading rubric. I’ve been thinking about a qualitative framework that would precede the ultimate validation outcome: three levels of model / harness output, judged by a superstar expert. Tier 1: Reliable. “OK, this is solid. It doesn’t f*** up.” Gets the fundamentals right. Tier 2: Legit & interesting. “Well-reasoned, well-synthesized, genuinely interesting. But I could have gotten there.” Rigor plus non-trivial synthesis. Tier 3: Outlier insight. “F***, I wish I’d thought of that.” Well-reasoned and surprising. Reachable from the evidence, yet I didn’t reach it. Worth investing in proper validation.

Nima Alidoust avatar
Nima Alidoust@nalidoust·Nov 11

More info on the philosophy behind the tasks.

What makes a biological reasoning task verifiable? Our team @tahoe_ai has spent the last few months on that question and landed on one conviction: for human-difficult tasks with verifiable rewards, the answer key has to come from ground-truth experimental data. Along the way we built thousands of such environments, which we call TahoeMysts, and we use them to evaluate frontier models (among other things). Every so often a new model produces a big jump, and it is always exciting. Today is one of those days: @claudeai Mythos 5.2! We will say more about this work in the future. In the meantime, take a look at our results today.

Post attachment
Vivek Natarajan avatar
⟳ Nima Alidoust retweeted
Vivek Natarajan@vivnat·Nov 10

Excited for the launch of Gemini for Healthcare! We’re extending the Gemini agent with specialized healthcare skills and connectors to Epic, Optum, and more, built to support HIPAA compliance. Instead of spending hours piecing together fragmented records and policies, care teams can offload the admin burden and get time back for what matters most: patient care.

Today, we’re announcing Gemini for healthcare. This newest addition to our suite of purpose-built industry solutions extends the Gemini agent to health systems and health plans. Learn more → goo.gle/4zf0s11

1:49
Xinming Tu avatar
⟳ Nima Alidoust retweeted
Xinming Tu@TuXinming·Nov 10

Agree that for superhuman-level science evals, the GT should come from ground-truth experimental data, not a solution written by human.

What makes a biological reasoning task verifiable? Our team @tahoe_ai has spent the last few months on that question and landed on one conviction: for human-difficult tasks with verifiable rewards, the answer key has to come from ground-truth experimental data. Along the way we built thousands of such environments, which we call TahoeMysts, and we use them to evaluate frontier models (among other things). Every so often a new model produces a big jump, and it is always exciting. Today is one of those days: @claudeai Mythos 5.2! We will say more about this work in the future. In the meantime, take a look at our results today.

Post attachment
Aiden M Sababi avatar
⟳ Nima Alidoust retweeted
Aiden M Sababi@AidenSababi·Nov 9

Most benchmarks grade against what's already written down. In biology, the real answer key is what the cells did. 🧬 TahoeMysts from @tahoe_ai scores models against our proprietary experimental data. 📈 Mythos 5.2: 43% ➡️ 49% was an interesting observation today, a real jump, though with half the tasks still unsolved. 🧩

What makes a biological reasoning task verifiable? Our team @tahoe_ai has spent the last few months on that question and landed on one conviction: for human-difficult tasks with verifiable rewards, the answer key has to come from ground-truth experimental data. Along the way we built thousands of such environments, which we call TahoeMysts, and we use them to evaluate frontier models (among other things). Every so often a new model produces a big jump, and it is always exciting. Today is one of those days: @claudeai Mythos 5.2! We will say more about this work in the future. In the meantime, take a look at our results today.

Post attachment
Valentine Svensson avatar
⟳ Nima Alidoust retweeted
Valentine Svensson@vallens·Nov 9

I'm glad we have this internal eval. When the model version number just jumped from 5.1 to 5.2 I was expecting a minor performance increase. But the increase in biological reasoning ability was huge!

What makes a biological reasoning task verifiable? Our team @tahoe_ai has spent the last few months on that question and landed on one conviction: for human-difficult tasks with verifiable rewards, the answer key has to come from ground-truth experimental data. Along the way we built thousands of such environments, which we call TahoeMysts, and we use them to evaluate frontier models (among other things). Every so often a new model produces a big jump, and it is always exciting. Today is one of those days: @claudeai Mythos 5.2! We will say more about this work in the future. In the meantime, take a look at our results today.

Post attachment
Shreshth Gandhi avatar
⟳ Nima Alidoust retweeted
Shreshth Gandhi@shreshth_gandhi·Nov 9

One of many interesting results from our evals work. We've put a lot of thought in designing hard tasks grounded in experimental data that push the reasoning ability of the models. More to share soon.

What makes a biological reasoning task verifiable? Our team @tahoe_ai has spent the last few months on that question and landed on one conviction: for human-difficult tasks with verifiable rewards, the answer key has to come from ground-truth experimental data. Along the way we built thousands of such environments, which we call TahoeMysts, and we use them to evaluate frontier models (among other things). Every so often a new model produces a big jump, and it is always exciting. Today is one of those days: @claudeai Mythos 5.2! We will say more about this work in the future. In the meantime, take a look at our results today.

Post attachment
Nima Alidoust avatar
Nima Alidoust@nalidoust·Nov 9

What makes a biological reasoning task verifiable? Our team @tahoe_ai has spent the last few months on that question and landed on one conviction: for human-difficult tasks with verifiable rewards, the answer key has to come from ground-truth experimental data. Along the way we built thousands of such environments, which we call TahoeMysts, and we use them to evaluate frontier models (among other things). Every so often a new model produces a big jump, and it is always exciting. Today is one of those days: @claudeai Mythos 5.2! We will say more about this work in the future. In the meantime, take a look at our results today.

Post attachment
Nima Alidoust avatar
Nima Alidoust@nalidoust·Nov 2

I hope that this is not true. And if it is and if @realDonaldTrump indeed has hesitations, I hope that those hesitations will win out as this would bring about unspeakable catastrophe for the people of Iran, who are the true victims of their rulers.

Under pressure from Israeli prime minister Benjamin Netanyahu, the Trump administration may be within days of launching a nuclear strike on Iran. The target would be Pickax Mountain in central Iran, where Israeli intelligence claims the Iranian government has restarted its nuclear enrichment program. No conventional weapon in the American arsenal can penetrate 300 feet of solid granite to destroy the tunnels where enrichment is supposedly taking place. The only military option is a nuclear strike. Netanyahu has been pushing hard for one. “Bibi calls Trump about it every day,” says an informed observer. Netanyahu is cornered and desperate. After last week’s election results, he can’t form a government unless Trump intervenes directly in Israeli politics and brokers a deal with other parties that gives Netanyahu 61 seats in the Knesset. Otherwise, he is out as prime minister and on his way to ignominy, investigations and possibly jail. Netanyahu must stay close to Trump. He needs this war. To that end, he’s applied maximum pressure to his closest allies in the administration, including Secretary of Defense Pete Hegseth and CENTCOM commander Brad Cooper. Both oppose a negotiated settlement to the war they’ve so grievously mismanaged; both are pushing to restart major combat operations. Secretary of State Marco Rubio and CIA director John Ratcliffe are also following Netanyahu’s lead, as are leaders of the Democratic Party. In a recent meeting on the subject, former president Barack Obama said he opposes the current Iran peace deal being drafted in Doha. The rest of America’s longtime allies in the Middle East are terrified by the prospect of more war. On September 27th, Netanyahu flew secretly to Abu Dhabi to enlist the UAE in his lobbying effort for a final attack on Iran. The Emiratis refused. After eight months of conflict, Gulf economies are teetering. So are global energy and fertilizer markets. They won’t recover soon. Globally, there are a total of about 850 supertankers used to transport oil from producers to the rest of the world. In October alone, 11 of them were badly damaged in Hormuz. At this pace, a global depression is imminent. A nuclear strike would radically accelerate the destruction. Fallout from a ground explosion at Pickax Mountain would contaminate the Persian Gulf, poisoning the water supply for 100 million people. And those are just some of the immediate consequences for the region. The rest of the world is every bit as exposed. No country other than the United States has ever used a nuclear weapon in war. Some would like to. An American nuclear attack on Iran would set a new precedent. The Russians have already told at least two other governments that an American nuclear strike on Iran would free them to use nuclear weapons against Ukraine. Pakistan and India would be tempted to do the same against each other, as would North Korea against Seoul. After the first nuclear strike, World War Three is inevitable. That war would be short and final. We’ve been sleepwalking toward this moment for months. Since February, the administration has quietly rewritten America’s nuclear doctrine to make first use of so-called “battlefield nukes” easier and therefore more likely. No one in Washington in either party seems bothered by this. Now we’re on the brink of it. Close observers say Trump is likely to decide by next weekend whether or not to use nuclear weapons. That would be November 7, six days from now. To his credit, he’s hesitating. At the moment, Trump is listening to his vice president, JD Vance, and to his envoy and friend Steve Witkoff, both of whom argue a deal with Iran can be made. They’re right, though it won’t be simple. The Iranians are famously frustrating to negotiate with under any circumstances, and elements of that government have become more radical since Ayatollah Ali Khamenei and his family were killed in February. After decades of isolation, even relatively moderate Iranian leaders seem confused by how decisions are made in the West. (There is a widespread belief in Tehran, for example, that the United States government controls Israel.) But overall, people who have spoken to decision-makers in Iran say there is consensus there that more war is bad for everyone and a deal is worth making. One group that hasn’t been consulted so far is the global population — the hundreds of millions of people who will be killed along with their children if Trump is pushed by Netanyahu into launching a nuclear strike next week. Now would be the time for them to speak up.

Shreshth Gandhi avatar
⟳ Nima Alidoust retweeted
Shreshth Gandhi@shreshth_gandhi·Oct 29

Please share your feedback with us here or at tara@tahoebio.ai We love hearing stories about what people are building (more features coming soon!)