
TurboPairFormer: open-source GPU kernels that deliver up to 1.73× faster OpenFold3 GPU computation per optimizer step than the original Triton backend, with more accurate gradients and reproducible results in fixed-input tests. Triangle attention scales cubically, so doubling the training crop makes it ~8× more expensive. Existing backends each trade away speed, precision, or reproducibility. Researchers from Lambda, Stevens Institute of Technology, and the OpenFold team built TurboPairFormer to address all three on NVIDIA Hopper GPUs: • Up to 1.73× faster than OpenFold3 Triton • Lowest mean Q/K and pair-bias gradient errors vs an FP64 reference • Bitwise-identical gradients across all four types (Q, K, value, pair-bias) in all 600 fixed-input cases Supports H100 and H200. On H200, 1.54× faster than OpenFold3 Triton on 768 pixel images (14.67 vs 22.53 sec/step). Read the blog for the full method and results lambda.com/blog/faster-more-…













