←
Jenai Xuning Yang34 posts
Jenai Xuning Yang avatar

Jenai Xuning Yang

@xuningy

Senior Research Scientist @ NVIDIA | PhD in Robotics @ CMU

◷ Joined March 2009▧ 8 Photos and videos
Jenai Xuning Yang avatar
Jenai Xuning Yang@xuningy·Apr 20

When every generalist robot model scores 95%+ on a benchmark, the numbers become meaningless. What if we built a photorealistic benchmark that never saturates and can generate new scenes and tasks with AI Workflows in minutes? We introduce RoboLab! 🧵(1/6)

Post attachment
Ruoshi Liu avatar
⟳ Jenai Xuning Yang retweeted
Ruoshi Liu@ruoshi_liu·Nov 9

Lots of people advocate against doing a PhD these days and I can relate to the sentiments. This is largely driven by the race towards “AGI/RSI” and the irrelevance of academia in this race. I’d like to make a case for doing a PhD specifically in computer science today. If you don’t believe we are approaching singularity in the next few years, then naturally you’d agree that fundamental research breakthroughs are necessary and academia is historically the best place for long-term curiosity-driven research. If you do believe, on the other hand, singularity means the value of “thinking” as a production tool will diminish. But the value of “thinking” as a form of human agency and freedom as well as intellectual entertainment will increase. In other words, humans think to understand our existence, exercise intellectual freedom, explore the unknown, and experience immense pleasure in this process. A PhD has never been just about teaching students to think so that they can produce, and will be less and less so in the future. It’s more about teaching students to think deeply and philosophically and subsequently, enjoy thinking itself. As @phillip_isola put it, we do it “for the love of the game” QED All in all, if you wanna join us on this journey to unlock your intellectual curiosity and deep philosophical thinking, please consider applying for PhD program at @umdcs! cs.umd.edu/grad/apply

Elie Aljalbout ✈️ CoRL avatar
⟳ Jenai Xuning Yang retweeted
Elie Aljalbout ✈️ CoRL@EliJalbout·Sep 22

📢 We're hiring (interns)! The Seattle robotics lab @NVIDIARobotics is looking for talented PhD research interns to join us in 2027. Interns at SRL will have the chance (depending on their preference) to either contribute to one of our ongoing group efforts or work on independent projects/topics of interest on topics including robot foundation models, agentic robotics, and precise manipulation. Reach out to me if interested in working on robot foundation models 🤖🤖 nvidia.eightfold.ai/careers/…

Mononito Goswami avatar
⟳ Jenai Xuning Yang retweeted
Mononito Goswami@MononitoGoswami·Oct 15

🚀 Flexible test-time scaling with a 4B model and just 8K-token context windows! One of my favorite things about 🪽 Hermes is how many simple but powerful ideas come together to tackle a much broader challenge: How do we teach a small model an understudied agentic capability and inadequately measured by existing benchmarks? In our case, that capability is contextual reasoning: knowing when and how to delegate, what to preserve in compact reasoning summaries, and how to continue reasoning from them.

🚀 We gave a 4B model with an 8K context window more test-time compute. Instead of improving, it got worse. Scaling across context windows requires more than inline reasoning. It takes contextual reasoning: knowing how to delegate, preserve reasoning in compact summaries, and continue reasoning from them. (1/10)

Mononito Goswami avatar
⟳ Jenai Xuning Yang retweeted
Mononito Goswami@MononitoGoswami·Oct 15

🎓 On-policy distillation has a teacher problem. SCOUT fixes it. Then irony? OPD lets students learn from reasoning paths they actually visit. But their teachers must provide feedback on paths they rarely take themselves. As these paths grow longer, even strong teachers struggle to provide reliable supervision. Our idea is simple: Why not let the teacher and student learn together?

🧵 Can your teacher go off-policy in On-Policy Distillation? Yes! An unfamiliar student prefix makes the teacher less certain, and its token supervision less reliable. 🧭 We introduce SCOUT (Student-COnditioned Updates of the Teacher), which adapts the teacher to student prefixes. (1/10)

Mononito Goswami avatar
⟳ Jenai Xuning Yang retweeted
Mononito Goswami@MononitoGoswami·Oct 15

Introducing MILO, a step toward recursively self-improving agents for long-horizon, reasoning-intensive problems! 🧬 TL;DR: MILO evolves harnesses, but also the search process that discovers better harnesses. It beats Claude Code and Codex on Terminal-Bench, outperforms methods like GEPA and Meta-Harness, and that's not all! It also discovers tighter upper bounds on three open math problems. 🧵👇

[1/n] 🧬 Want a stronger agent without retraining? Give it a better harness. MILO, our recent work from AWS AI Labs, does this automatically: +12.0% resolution rate on Terminal-Bench 2.1, and new records on 3 open math problems, beating AlphaEvolve, TTT-Discover and EvoX.

1:48
Jenai Xuning Yang avatar
Jenai Xuning Yang@xuningy·Oct 14

Can and should a general-purpose model serve as a robot policy? In Astranomy, we study GPT-6 Astra for general pick-and-place manipulation. Astra sets a new SOTA on RoboLab-120, but real-time robot control remains an open challenge. Full tech report: research.nvidia.com/labs/srl…

2:07
Jenai Xuning Yang avatar
Jenai Xuning Yang@xuningy·Oct 9

Native VLA/WAMs have very weak language-grounding and reasoning capabilities. With ARC, we uplift existing VLA/WAMs to gain ~30pp performance with no new robot action data. The capability is already in these models; we just haven’t fully unlocked it yet. arc-robot-reasoning.github.i…

Today we are introducing ARC, a reasoning recipe for robot foundation models that sets a new state of the art on RoboLab-120 and MolmoSpaces. The prevailing way to improve robot foundation models is brute force: larger models, more robot demonstrations, costly training at scale. ARC needs none of that. With no new robot data and no foundation-scale training, π0.5 and Cosmos3-Nano-Policy gain up to: 📈 +50.0 pp on RoboLab-Reasoning-50 📈 +29.8 pp on RoboLab-120 📈 +27.2 pp on MolmoSpaces To our knowledge, these gains are unprecedented. 📄 Paper: arxiv.org/abs/2610.12386 🌐 Website: arc-robot-reasoning.github.i… 🧵 (1/7)

1:09
Siyi (Stella) Chen ✈️ NeurIPS avatar
⟳ Jenai Xuning Yang retweeted
Siyi (Stella) Chen ✈️ NeurIPS@ChenSiyich·Sep 7

Excited to share that VoLo: A Physical Orchestrator for Open-Vocabulary Long-Horizon Manipulation has been accepted to #CoRL2026! 🎉🤖 VoLo explores agentic robotics for long-horizon, open-vocabulary tasks, where a VLM acts as the robot’s brain with memory to reason, plan, monitor, detect failures, recover, and orchestrate tools—including VLA/WAMs, vision models, and action primitives. We also introduce RoboVoLo, a high-fidelity simulation benchmark with 126 tasks spanning common sense, memory/state tracking, complex references, and world knowledge, together with detailed diagnosis of current system limitations. This work was done during my internship at @nvidia @NVIDIAAI @NVIDIARobotics. Huge thanks to all collaborators @HugoHadfield1, Alexander Zook, @mikacuy, @luke_ch_song, @erwincoumans, @xuningy, Faisal Ladhak, @BirchfieldStan, Jonathan Tremblay, and @robovalts! 🔗 Project: chicychen.github.io/VoLo/ 💻 Code: github.com/NVlabs/VoLoAgent 📊 RoboVoLo Benchmark: github.com/NVlabs/RoboVoLo Looking forward to discussions at CoRL 2026 — hope to meet many of you in person! #CoRL2026 #AgenticRobotics #Robotics #EmbodiedAI #RobotLearning #PhysicalAI #NVIDIA

Post attachment
Mononito Goswami avatar
⟳ Jenai Xuning Yang retweeted
Mononito Goswami@MononitoGoswami·Aug 25

CPT is an important bridge between academic and industrial research. I have benefited from it on both sides: as a graduate student, learning how frontier research is done in industry, and now as an industry researcher, working with graduate students to advance fundamental research. Weakening that bridge would hurt both academia and industry.

ICE just published a new memo (BCM 2608-01) targeting international students. It effectively blocks universities from authorizing CPT internships that are not strictly mandatory for every student to graduate. Even though internships in CS are not technically required for a degree, they greatly benefit both employers and students. They help students get familiar with the U.S. professional system. They also give American employers early access to a vital talent pipeline from top American universities. This policy change cuts U.S. employers off from vital STEM talent pipelines and tells the world’s brightest minds to go elsewhere. This is terrible for our national interest and global competitiveness. We need to retain top talent, not criminalize academic internships.

Post attachment
Jenai Xuning Yang avatar
Jenai Xuning Yang@xuningy·Aug 25

We released DROID+, a new and improved DROID control stack from SRL. We believe robots (and hardware) should be easy to setup and easy to use, and so we updated the DROID stack to be the same. @HugoHadfield1 github.com/nvlabs/droidplus Here's pi0.5 doing our "hello world" task:

Jenai Xuning Yang avatar
Jenai Xuning Yang@xuningy·Aug 5

Our team at SRL is hiring! We're looking for people who dive deep, think systematically, and care deeply about doing rigorous work. If you're excited about understanding the science behind building foundation models, please apply!

We're hiring! The Seattle Robotics Lab (SRL) at NVIDIA is hiring a research scientist to work on robot foundation models. The focus will be on investigating the science behind building VLAs, WAMs, and world models for robotics, and leveraging the findings to propose the next generation of models and training paradigms. We're seeking a world-class researcher (PhD grad) or senior researcher (3+ years of post-PhD experience) with expertise in training generalist policies. The researcher should aim to question conventional wisdom, push beyond the status quo, and dive into the foundations of general-purpose robot intelligence. NVIDIA SRL provides a rare environment to conduct open research on fundamental and applied robotics, with the freedom to publish, collaborate broadly, and tackle big scientific questions at scale. If this sounds like a strong fit, please reach out to us and apply here! nvidia.eightfold.ai/careers/… nvidia.eightfold.ai/careers/…

Jenai Xuning Yang avatar
Jenai Xuning Yang@xuningy·Jul 12

There's a growing gap between how fast generalist robot policies are improving and how well we can actually evaluate that progress, and understand when and why they fail. I wrote a blog on our take: developer.nvidia.com/blog/ho… Want to discuss? Find me at #RSS2026!

NVIDIA Robotics avatar
⟳ Jenai Xuning Yang retweeted
NVIDIA Robotics@NVIDIARobotics·Jun 15

The next wave of robot foundation models is here. ⚡ World-Action Models are emerging as a powerful new approach for physical AI, combining pretrained scene dynamics with action generation. Learn more ➡️ nvda.ws/43C1abm

0:23
Jenai Xuning Yang avatar
Jenai Xuning Yang@xuningy·Jun 15

A fantastic technical deep dive into what's happening now and next in robot foundation models from @moritz_reuss. We're thinking deeply about *how* to build an efficient task generalist policy. Check it out!

World-Action Models (WAMs) have become the second dominant recipe for robot foundation models, next to classical VLAs. So where do they come from, and how do they compare vs VLAs? I wrote an small overview of the WAM landscape, with some personal takes: developer.nvidia.com/blog/pr…