←
DeepSpeed123 posts
DeepSpeed avatar

DeepSpeed

@DeepSpeedAI

Official account for DeepSpeed, a library that enables unprecedented scale and speed for deep learning training + inference. 日本語 : @DeepSpeedAI_JP

◷ Joined May 2020▧ 22 Photos and videos
DeepSpeed avatar
DeepSpeed@DeepSpeedAI·Aug 25

Reminder of DeepSpeed Office Hours

DeepSpeed Office Hours: Tue Aug 25, 12pm ET v0.19.3–0.19.5: • Grad accum for custom & serverless (Tinker) • AutoEP+AutoTP folding & ZeRO-3 TP inference • Hybrid Engine for on-policy distillation • Pinned-memory CPU/NVMe offload speedups Join: zoom-lfx.platform.linuxfound…

DeepSpeed avatar
DeepSpeed@DeepSpeedAI·Aug 19

DeepSpeed Office Hours: Tue Aug 25, 12pm ET v0.19.3–0.19.5: • Grad accum for custom & serverless (Tinker) • AutoEP+AutoTP folding & ZeRO-3 TP inference • Hybrid Engine for on-policy distillation • Pinned-memory CPU/NVMe offload speedups Join: zoom-lfx.platform.linuxfound…

DeepSpeed avatar
DeepSpeed@DeepSpeedAI·Aug 6

The meeting link for tomorrow's DeepSpeed developer meetings is now available: Aug. 7, 9:00 a.m. PT — DeepCompile efficiency & robustness Aug. 7, 10:00 a.m. PT — Expert Parallelism enhancements Everyone interested is welcome to join! zoom-lfx.platform.linuxfound…

Apologies for the short notice! We're holding two DeepSpeed developer meetings on Aug. 7 to discuss our Q3 roadmap goals: 9:00 a.m. PT — DeepCompile efficiency & robustness 10:00 a.m. PT — Expert Parallelism enhancements Roadmap: github.com/deepspeedai/DeepS… Join Slack: deepspeedworkspace.slack.com…

DeepSpeed avatar
DeepSpeed@DeepSpeedAI·Aug 5

Apologies for the short notice! We're holding two DeepSpeed developer meetings on Aug. 7 to discuss our Q3 roadmap goals: 9:00 a.m. PT — DeepCompile efficiency & robustness 10:00 a.m. PT — Expert Parallelism enhancements Roadmap: github.com/deepspeedai/DeepS… Join Slack: deepspeedworkspace.slack.com…

PyTorch avatar
⟳ DeepSpeed retweeted
PyTorch@PyTorch·Jul 22

The PyTorch Foundation continues to grow as a multi-project home dedicated to supporting collaboration across every stage of the AI lifecycle. We are excited to launch a new quarterly blog series where each hosted project - PyTorch, @vllm_project @DeepSpeedAI @raydistributed, Helion and Safetensors - shares its latest updates, technical progress, and roadmap. From core framework optimizations and hardware enablement to overall ecosystem health, our hosted projects achieved a lot over the past quarter. Read the complete update to learn more 👉 bit.ly/4fkiTJy..*

Post attachment
Stas Bekman avatar
⟳ DeepSpeed retweeted
Stas Bekman@StasBekman·Jun 16

PSA for @DeepSpeedAI users - a long outstanding precision-related critical bug has been identified and fixed in github.com/deepspeedai/DeepS… and a new release has been made. The issue was about mixed precision mode downcasting buffers that had to be in fp32 - massively impacting correctness due to large static buffers - e.g. RoPE in Qwen3 models when using long sequence lengths 32K+. Hopefully this fix brings Deepspeed to a close parity with FSDP2 which has been an issue since a long time. You can still have the old behavior but you'd now need to manually configure it - by default the model's buffers will now remain in the original precision. Please install deepspeed==0.19.2 which will do the right thing. Thanks to Tunji Ruwase and Claude Opus 4.8 via Cursor for identifying and fixing the problem.

DeepSpeed avatar
DeepSpeed@DeepSpeedAI·Jun 3

We now have native support for all ZeRO stages 1/2/3 for Muon Optimizers, providing superior performance on LLM pre-training and post-training. Feel free to try it out, kudos to @PKUWZP Guokai Ma, Peng Du and Chi for the contribution!

DeepSpeed now supports the Muon Optimizer. Optimized specifically for internal 2D weights within neural networks, Muon is gaining traction for its significant memory savings and strong convergence metrics during LLM training. In our latest blog post, the DeepSpeed team shares a deep dive into their integration setup, implementation of hybrid optimizer strategies, and early benchmark results. @PKUWZP Read the full technical breakdown here 👉 bit.ly/4dLjGE2

Post attachment
PyTorch avatar
⟳ DeepSpeed retweeted
PyTorch@PyTorch·May 18

Don't miss @DeepSpeedAI virtual office hours on May 26 at 12:00 PM America/New_York to ask questions of @toh_tana member of DeepSpeed TSC & get the latest recent key updates, including AutoSP (sequence parallel), AutoEP (expert parallel), and AutoTP (tensor parallel).

DeepSpeed @DeepSpeedAI May 14 DeepSpeed Virtual Office Hours Have questions about DeepSpeed or ideas for what we should prioritize next? Join our next DeepSpeed Office Hours on Tuesday, May 26 at 12:00 PM America/New_York. We'll cover general questions, Q2

DeepSpeed avatar
DeepSpeed@DeepSpeedAI·Apr 30

Great News! Thanks to DeepSpeed AutoSP, efficient long context LLM training is now easily accessible.

Want to train LLMs on longer contexts without re-engineering your entire systems stack? Introducing AutoSP — the first compiler-based solution that automatically optimizes LLM training for long contexts. Under the hood, AutoSP applies a series of compiler passes that trigger sequence parallelism, paired with a curated activation-checkpointing scheme tailored for long-context training. It's integrated directly into DeepSpeed, so enabling long-context training is just a config change away. No more rewiring your stack to push context lengths. Read the blog to learn more 🖇️ pytorch.org/blog/introducing… ✍ @AhanGupta13, Zhihao W., Neel Dani, @toh_tana, Tunji Ruwase, @_Minjia_Zhang_ #PyTorch #DeepSpeed #AutoSP #OpenSourceAI

Post attachment