←
Phil Leung2,992 posts
Phil Leung avatar

Phil Leung

@proleu

cofounder @Xaira_Thera formerly @UWProteinDesign views my own instagram.com/proleu

◷ Joined July 2012▧ 217 Photos and videos
Phil Leung avatar
Phil Leung@proleu·Nov 7

anthropic.com/research/inves… Vaults 👌

Gonna start rating random proteins today we have "major vault protein". TLDR: S tier 10/10 protein - Literally MVP - D39 symmetry is giving main character energy - Doesn't just look cool, also does useful stuff (a bonus imo) - If there was a @ContainerStore for proteins it would probably be available there

Phil Leung avatar
Phil Leung@proleu·Oct 25

At @Xaira_Thera we are closing the loop. SOTA models for molecular design and biological understanding (X-Design and X-Cell) allow us to design functional molecules for undruggable targets at unprecedented scale, and to increase our ability to decipher complex disease biology. At the same time, massive data generation efforts in the "X-Lab" fill in the gaps in public data and allow us to ask questions that haven't been asked before, which in turn makes the models themselves, and the harness in which we run them, even better. Today, I wanted to share my thoughts on two tool layers we're building to accelerate these efforts. The first tool is a software layer. X-Scientist is a self improving agent harness compatible with many frontier LLMs (including recent Claude models from @AnthropicAI and GPT Astra from @OpenAI). This harness achieves SOTA performance on a number of tasks relevant to our design and data generation efforts, and allows humans to extend their reach to larger experiments and accelerate artisanal data analysis and design pipelines, including large-scale protein design campaigns. The second tool is a hardware layer that integrates natively with our software stack. X-Automate is a robotics ecosystem that powers the X-Lab. X-Automate combines X-Bots (robots which work alongside human scientists in the wetlab), and X-Scientist, to coordinate workflows and monitor activities. We demonstrate X-Automate in a use case where it helps to bridge the gap between walk-up automation and analytical biochemistry, empowering scientist to hand off routine activities like sample loading. Both of these two tool layers are truly in their infancy and I expect they may be able to contribute substantially to our goal of bringing 10x more medicine to 10x more patients in the next 10 years. xaira.com/news/x-automate-br… xaira.com/news/x-scientist-r…

2:18
Phil Leung avatar
Phil Leung@proleu·Oct 18

This paper has excellent experiments and pretty mixed α/β folds (6 crystal structures..!) Also proteases are very useful research tools. Great stuff. Congrats @kinasekid and coauthors!

Can we design proteins that cut other proteins? Our de novo cysteine protease paper is out in Nature! We designed new folds that cleave peptide backbones, with activity demonstrated in mammalian cells. Paper and code 👇 nature.com/articles/s41586-0…

Post attachment
Phil Leung avatar
Phil Leung@proleu·Oct 17

AI native biotech companies with wet labs dedicated to data generation have a straightforward path to becoming some of the most interesting RL sandboxes. Check out this cool whitepaper from @leashbio @Andrewdblevins @allmeasures and colleagues. Idea goes basically like this: 1. Synthesize a combinatorial library that enumerates a chemical space. 2. Pre-measure binding enrichment for all the combinations for a large number of protein targets. 3. Give Claudes the chemical components of the library and let them try to put them together to get binders with a limited budget and learn from each attempt. github.com/Leash-Labs/minos-…

Post attachment
Kaitlin Maile avatar
⟳ Phil Leung retweeted
Kaitlin Maile@kaitlinmaile·Oct 10

We've been cooking up something enthralling: weight matrices inherently perform linear attention over their training history, but more powerful kernels do better. Here's the principled apéritif and experimental amuse-bouche. Save room for more (or join us in the kitchen)

Johannes Oswald @oswaldjoh Oct 9 Article Retrieval centric deep learning: Replacing Weight Matrices with Vector Databases Long post ahead - sorry about this, but might be worth it. You never know. ........ When we started this project, we were motivated by the following question: If we would have way more cheap compute

Phil Leung avatar
Phil Leung@proleu·Oct 10

Another great paper this time from @OPIGlets relevant for anyone working on structure prediction models TL;DR of this one is that models trained with a layernorm right after dropout layer have an expectation mismatch at inference time (since dropout is turned off). Authors fix this with a closed form correction that adjusts for the dropout factor Very principled paper and super easy to understand. arxiv.org/html/2609.32062

Post attachment
Phil Leung avatar
Phil Leung@proleu·Oct 2

There have been many more exciting results recently, hopefully we can share more soon.

Phil Leung avatar
Phil Leung@proleu·Oct 2

On the other end of the spectrum is XA-4, a GPCR. When we first looked at it, we said, "That one is gonna be tough". Here, we can make a strong argument that design unlocks a truly undruggable target. We ran a traditional screening campaign head-to-head against a de novo design campaign. Nothing validated from the naive library, but several of the designs showed real binding and were functional in assays. Since we made these designs with X-Design, they also show great developability characteristics straight out of the computer.

Post attachment
Phil Leung avatar
Phil Leung@proleu·Oct 2

Our X-Design modeling suite is trained to predict developability characteristics. The harness we run these models in explicitly optimizes many of these properties during design. We intend for any hits to come out of the models *already* having properties compatible with conversion to lead matter. We design binders in a single round to XA-1, which is an "easy" target. Most binders pass a battery of industry-standard developability panels and are humanlike, despite being VHH-format single-domain antibodies in this case. These were some of my favorite binders we made this year.

Post attachment
Phil Leung avatar
Phil Leung@proleu·Oct 2

I'd like to share a small update about what we've been doing at @Xaira_Thera . We've been mostly heads down focused on making design to progress internal programs and building out our platform until now. 🧵to follow. For antibody design to actually add value, it needs to either: 1. dramatically improve the speed and quality of antibodies over traditional discovery pipelines for easy targets 2. unlock therapeutic targets so difficult that they were previously inaccessible to traditional approaches In this post we provide a tiny preview of two internal programs we designed antibodies to that illustrate our platform meets both of these criteria. There is of course, a spectrum of targets in between the "easy" and the "undruggable" such as these GPCRs we made VHH and VHVL binders to which we highlight as well: xaira.com/news/de-novo-desig…

Post attachment
Magnus Bauer avatar
⟳ Phil Leung retweeted
Magnus Bauer@kinasekid·Sep 30

OpenAI’s dot is a protein designer now 😂 It runs RFdiffusion/MPNN/AF2 on its cloud computer, tracks progress in a scratchpad, and opens the predicted designs in PyMOL to click through. All on CPU. Time to enter the Anthropic × Adaptyv competition with this setup? Wish me luck 😆

0:16
Phil Leung avatar
Phil Leung@proleu·Sep 26

Really liked this preprint from @OutpaceBio biorxiv.org/content/10.64898… The key idea here is to remove some of the loopy regions from IL2 that bind IL-2Rα, while preserving the IL-2Rβγ interfaces. It's a well-scoped design problem, but I also like it for aesthetic reasons. Those loopy regions always bother me when I look at the IL-2 structure on its own because they look really floppy and unstructured, not properties you'd typically associate with a well-behaved protein. Turns out the aesthetic preferences are well founded because when they re-looped the helices with designed short loops, the thermostability of the designed IL-2 improved a lot over the loopy native one. Very nice stuff, classical Rosetta protein design. Always fun to see these kinds of whiteboard-originated protein design hypotheses come to fruition and hopefully eventually reduce a lot of human suffering

Post attachment