←
Amazon Science7,665 posts
Amazon Science avatar

Amazon Science

@AmazonScience

The latest news and research from Amazon's science community. #AmazonScience

◷ Joined December 2019▧ 717 Photos and videos
SemiAnalysis avatar
⟳ Amazon Science retweeted
SemiAnalysis@SemiAnalysis_·Nov 16

ALERT 🚨: Trainium3 Neuron profiling & trace stack is so fine-grained and precise that it can generate pixel art of entire videos! The video below is an actual profile running on Trainium3 DMA engines. We will open-source the entire SKILLS.md later this month.

2:48
SemiAnalysis avatar
⟳ Amazon Science retweeted
SemiAnalysis@SemiAnalysis_·Nov 13

Great work by @radixark, @sgl_project, @BanghuaZ, @alxnails, and AWS on this amazing work on Trainium! Excited to get SGLang Trainium onto the industry-standard AgentX/InferenceX!

🚀 SGLang-Neuron v0.1.0 is now open source and in public preview! Following October's closed beta, SGLang's serving stack now runs on AWS Trainium, co-developed by the SGLang team and AWS Annapurna Labs @AmazonScience. A PyTorch-native plugin on upstream SGLang for Trainium2 and Trainium3: - One fully asynchronous runtime for every LLM: Trainium chips run decode steps back to back - Megakernels: every decoder layer of a step in a single NKI kernel call - PD disaggregation over EFA: Kimi-K3 across three Trainium3 nodes, GLM-5.2 at 1M context - HiCache: evicted prefixes stay in host memory and load back on a later hit - SGLang Diffusion on Trainium2: FLUX.1-dev, FLUX.3-Action, MiniMax-H3, Wan2.2 A14B, LingBot-World-V2 Thank you to the AWS Annapurna Labs team and @YottaLabs for the contributions!

Post attachment
Amazon Science avatar
Amazon Science@AmazonScience·Nov 13

Congratulations to the Amazon Last Mile team on winning the 2026 @INFORMS Daniel H. Wagner Prize. Their paper details a planning system that accounts for how temperature and terrain change a delivery EV's energy needs. amzn.to/4iHcbQU ⚡

Post attachment
Amazon Science avatar
Amazon Science@AmazonScience·Nov 12

The SGLang workflow you already know now runs on AWS Trainium. SGLang-Neuron: serve models and generate RL rollouts on Trainium — same server, same APIs, native PyTorch through TorchNeuron. @sgl_project #SGLangSummit aws.amazon.com/blogs/machine…

Amazon Science avatar
Amazon Science@AmazonScience·Nov 11

Introducing Mitra-v2, a tabular foundation model for both classification and regression. Pretrained entirely on synthetic tables, it leads the single-model field on the TabArena benchmark. amazon.science/blog/mitra-v2…

Amazon Science avatar
Amazon Science@AmazonScience·Nov 6

Amazon senior applied scientist Hamed Karimi received the 2026 @ECMLPKDD Test-of-Time Award for his 2016 paper on the Polyak–Łojasiewicz condition. #ECML2026 amazon.science/blog/hamed-ka…

Amazon Science avatar
Amazon Science@AmazonScience·Nov 4

How do you keep 70-billion-parameter quality while running up to 20 times as fast? AWS researchers combined knowledge distillation with parallel decoding. For @bookingcom's Smart Filters, that meant responses 15 times as fast for 99% of queries. amazon.science/blog/speeding…

The Sanghani Center at Virginia Tech avatar
⟳ Amazon Science retweeted
The Sanghani Center at Virginia Tech@SanghaniCtrVT·Oct 30

A 2026-27 @amazon Fellowship has been awarded to @VT_CS computer science Ph.D. student @Hanibalomari. The Amazon-VT initiative is also supporting five faculty projects. Read about their research at 🔗tinyurl.com/3v5wkxvh @AmazonScience @virginia_tech @SanghaniCtrVT

Amazon Science avatar
Amazon Science@AmazonScience·Oct 28

Amazon's custom Trainium chip helps power the diffusion models behind Prime 360's cinematic highlights, reducing diffusion-model inference latency by more than 40%: amzn.to/4e1puZN

PyTorch avatar
⟳ Amazon Science retweeted
PyTorch@PyTorch·Oct 23

Most AI developers use PyTorch to build their models. And this week @AmazonScience announced a new PyTorch backend for AWS Trainium chips - TorchNeuron. Learn more about the science behind it.

TorchNeuron is now open source. Our new @PyTorch backend translates code into operations executable on AWS Trainium with minimal or no code changes. Learn how the team used AI agents and hundreds of thousands of models to validate it: amazon.science/blog/the-scie…

Amazon Science avatar
Amazon Science@AmazonScience·Oct 23

TorchNeuron is now open source. Our new @PyTorch backend translates code into operations executable on AWS Trainium with minimal or no code changes. Learn how the team used AI agents and hundreds of thousands of models to validate it: amazon.science/blog/the-scie…