←
Jiarui Lu84 posts
Jiarui Lu avatar✓

Jiarui Lu ✓

@jiarlu

doing things

◷ Joined December 2018▧ 15 Photos and videos
Jiarui Lu avatar
Jiarui Lu@jiarlu·10h

this is intriguing. first, the frontier LMs seem to start swallowing UniProt-scale seq data, with surprising acc; then it will be fun to further investigate if these LM representations encode structure/dynamics/function knowledge, like ESM; and decode, like ESMFold/SimpleFold

Post attachment
Chi Han avatar
⟳ Jiarui Lu retweeted
Chi Han@Glaciohound·Nov 17

I am excited to be joining CS@U Wisconsin-Madison in Fall 2027! I will recruit PhD students. If you are also enthusiastic about researching how LLMs work and/or applying them to other scientific problems, please apply and mention me in your application. @WisconsinCS

Jiarui Lu avatar
Jiarui Lu@jiarlu·Nov 16

Great work! This such resonates with the philosophy behind SimpleDesign, for protein sequence–structure modeling 🧬arxiv.org/abs/2609.03377 SimpleDesign feeds amino acid seq (text) and 3D coordinates (vision) directly into a unified Transformer, with modality-specific layers and joint attention. no structure tokenizer; no pretrained structure encoder. from different domains, but same principle 😀

1:20
Jiarui Lu avatar
Jiarui Lu@jiarlu·Nov 14

Congrats, Yong! Really enjoyed reading this — it's fun to see SimpleFold (oh yeah) get remixed with LLMs so well. Great work!😄

0:30
Jiarui Lu avatar
Jiarui Lu@jiarlu·Nov 11

Recently I’ve seen many agent frameworks built around bio foundation models. Real-world agents (powered by claude, gpt, or deepseek) can retrieve valuable biological context. Yet much of that evidence has had no direct path into cofolding. Too often, the fallback is to sample more random seeds. Mol-1-constraint extends Mol-1 with an interface that lets agents turn biological evidence into model guidance. We’re making it available to everyone. We’re opening this path so researchers and engineers can build together and push the frontier. AGI should belong to everyone.

Jiarui Lu avatar
Jiarui Lu@jiarlu·Nov 11

Mol-1-constraint is now available to every researcher ^^ 88.3% success on Foldbench-AB. Code and weights released: github.com/molence/Mol-1/tre… Clone it. Build on it. Make it part of your research. Or try it directly at lab.molence.com. Research should benefit everyone. We’re putting that belief into practice.

Post attachment
Jiarui Lu avatar
Jiarui Lu@jiarlu·Oct 28

Hi! We just released Mol-1, the frontier open-source cofolding. Try and benchmark it for your research and real-world problems: built for science, agents, and workflows. Sign-up and cook. lab.molence.com Open-sourced for all: github.com/molence/Mol-1 you're gonna like it

0:08
Jiarui Lu avatar
Jiarui Lu@jiarlu·27 Sep 2025

Wrapped up my intern at @Apple MLR and heading back to school. Really lucky to learn from & work with amazing folks here. Excited to see SimpleFold (github.com/apple/ml-simplefo…) out and moving forward 🔥 — proud to contribute, and make minuscular effort to the community w/ the team.

Joshua Susskind avatar
⟳ Jiarui Lu retweeted
Joshua Susskind@jmsusskind·26 Sep 2025

This is so cool! Glad to see how quickly people are able to work with and build on the SimpleFold model! Nice work @OpenBioAI :)

0:20
Yuyang Wang avatar
⟳ Jiarui Lu retweeted
Yuyang Wang@YuyangW95·26 Sep 2025

Thanks @OpenBioAI for integrating SimpleFold! Glad to see the community start using our model

0:20
Miguel Angel Bautista avatar
⟳ Jiarui Lu retweeted
Miguel Angel Bautista@itsbautistam·25 Sep 2025

So I understand that was unexpected for a lot of people, @Apple MLR has released a protein folding model! arxiv.org/abs/2509.18480. Here’s a summary of what SimpleFold is and what it represents: - What is SimpleFold? A generative model that essentially treats protein folding almost exactly as if it were a text-to-image or text-to-3D problem. - What are we sharing? A research paper and a codebase under an MIT license github.com/apple/ml-simplefo… (looking forward to people contributing to it!). We are also releasing pre-trained checkpoints of different sizes so that researchers can best tradeoff performance for efficiency. - Why protein folding? We are doing this work largely because protein folding is an excellent benchmark for structured data generation and multi-modality. Protein folding is a very interesting problem from a generative modeling perspective and we do research on generative modeling :) - Why is it interesting? IMO SimpleFold is interesting because I believe in finding recipes (architectures, training objectives, etc.) that generalize across the board to many different data modalities. Let’s say you are an ML expert in text-to-image or text-to-3D, now you can apply your latest and greatest architectural blocks or efficient samplers to protein folding with SimpleFold. I believe this is a net benefit for ML research and science in general. Now getting more into the technical details: - Our architecture is very simple (hence the name), just a stack of transformer blocks with time-step conditioning. This is important because it makes the model efficient at inference time. You can run SimpleFold directly on your Mac and get results quickly without data ever leaving your laptop. - SimpleFold is not necessarily a model that “rejects” inductive biases, it just doesn’t enforce them directly on the architecture. For example, we apply rotation augmentation to all the protein structures during training. This makes the model “softly” invariant to this symmetry. - There were some concerns online about data leakage from AFESM and that driving performance of SimpleFold or making it overfit. We filtered AFESM data so that the CASP14 sequences are not seen during training. As a matter of fact we distilled structures from AF2/ESMFold models, which have the same cutoff data as SimpleFold for PDB data. Both AF2 and ESMFold train on self-distilled datasets, we just train SimpleFold on a bigger set of distilled data. I want to thank my awesome team of collaborators, they are all rockstars. That’s all, for now :)

Post attachment
Joshua Susskind avatar
⟳ Jiarui Lu retweeted
Joshua Susskind@jmsusskind·25 Sep 2025

SimpleFold is out! I'm excited to see how the community receives this work from our research group at Apple, and I hope to see people trying out protein folding on their own laptops with MLX!

Post attachment
Jiarui Lu avatar
Jiarui Lu@jiarlu·25 Sep 2025

Excited to share our recent work on protein folding with "deliberately" minimalist (not small, scale up to 3B params) non-equivariant model built on general-purpose transformers + FM. How about folding proteins on your M-chip Mac in secs? Try it now! 😎

Post attachment