←
Sarvesh Patil918 posts
Sarvesh Patil avatar

Sarvesh Patil

@servo97

Your friendly neighborhood PhD in Robotics @CMU. Dexterous Manipulation | Generative Control | Reinforcement Learning

◷ Joined November 2014▧ 29 Photos and videos
Sarvesh Patil avatar
Sarvesh Patil@servo97·Jun 30

Interaction with the real world is the major bottleneck in robot learning. So what would robot RL look like if we didn’t need to limit compute per interaction? Our latest work, Off-Policy Generative Policy Optimization (OGPO, accepted to ICML26) embarks on answering this question (spoiler alert: when done correctly, it helps massively!). 🧵(1/N)

Post attachment
Quanting Xie (✈️CoRL 2026) avatar
⟳ Sarvesh Patil retweeted
Quanting Xie (✈️CoRL 2026)@DanielXieee·Nov 12

Launching project flow. Our new generation robot hand. Direct drive, liquid cooling. From now, the heating problem is solved for robot hands. more soon… @origami_robo

0:10
Shreyas Kowshik ✈️ CoRL 2026 avatar
⟳ Sarvesh Patil retweeted
Shreyas Kowshik ✈️ CoRL 2026@kowshik_shreyas·Nov 4

1/12 🚨 A long-standing goal in robotics is fully autonomous adaptation. Yet sparse rewards and weak zero-shot exploration often leave robots with little signal to learn from. Our new work asks: What does it take to make autonomous improvement work with minimal human guidance?

Post attachment
Sarvesh Patil avatar
Sarvesh Patil@servo97·Nov 5

Very fun collaboration on understanding how semantic generalizability is observed in multi-task VLA-RL for manipulation by scaling Q-function training. RL post-training is often viewed as a sharpening mechanism that overfits to training task distributions and fails to generalize in OOD settings. But what if that's just a scale issue? Atleast for semantic variations in simple manipulation tasks this seems to be case. Multi-task training improves performance on unseen scenes and objects with no policy updates (Best of N sampling via Q-values) and even more with policy extraction updates (OGPO, AWR)!

Can RL post-training of generalist robot policies enable improvement not just on the tasks we train on, but also generalization beyond them, improving on novel tasks not seen in training? We show that, with the proper RL recipe, we can enable such "generalist improvement"! 🧵

0:13
John Zhang avatar
⟳ Sarvesh Patil retweeted
John Zhang@johnzhangx·Nov 5

introducing mjorbit: an open-source simulator for space robotics that runs thousands of worlds in parallel on a GPU. here, a single RL policy trained in mjorbit flies in from kilometers away in LEO, grabs a satellite with both arms, and points it at earth 🧵

1:00
Tony Tao avatar
⟳ Sarvesh Patil retweeted
Tony Tao@_tonytao_·Nov 3

Back in ~Dec 2025, I really wanted to work on mobile manipulation, but robots were either too expensive or not performant enough. So we built our own! Excited to finally share something I’ve had so much fun working on: 1. Pixel: a co-designed full stack system for learning mobile manipulation. 2. Pixel-UMI: environment aware whole body manipulation without robot data. w/ @JasonJZLiu (1/N)

2:23
Zhanyi Sun avatar
⟳ Sarvesh Patil retweeted
Zhanyi Sun@s_zhanyi·Nov 3

Can more pretraining improve a robot policy’s success rate, yet makes it worse for porttraining? 🤔 In our new work, we find that it can. Continued supervised pretraining of generative robot policies can improve reliability at the expense of coverage, and this tradeoff affects downstream posttraining. Read on to see why this happens and how we can preserve coverage. 1/n 🧵

Post attachment
Prasanna Sriganesh avatar
⟳ Sarvesh Patil retweeted
Prasanna Sriganesh@realprassi007·Oct 27

Sharing this work that I was partially involved with at @multiplylabs We show that using contact information as feedback signal during training can help track grasps even on new, unseen objects. All demos are open loop. Excited to show this work. Project page and video: multiplylabs.github.io/oath/ Paper: arxiv.org/abs/2610.14379

Sharing OATH: Object-Agnostic Tracking for Dexterous Hands. We found that observing the error to reference contact points, a single residual policy can track grasps on completely unseen objects, enabling rapid physics-based retargeting.

1:07
Jon Barron avatar
⟳ Sarvesh Patil retweeted
Jon Barron@jon_barron·Oct 23

Hi all, I have a new result I'm excited to share. It turns out that *all existing implementations* of softmax and cross-entropy (that's JAX, PyTorch, textbooks, etc) have a subtle bug --- two bugs, actually. A simple rewrite fixes both, and eliminates "slingshots" when grokking:

0:07
Quanting Xie (✈️CoRL 2026) avatar
⟳ Sarvesh Patil retweeted
Quanting Xie (✈️CoRL 2026)@DanielXieee·Oct 21

A million hours of what? If we’re scaling human demonstrations for robot learning, what should each hour contain? We built S1, our skill capture glove, alongside our robot hand to record joint movements that map to robot targets, with touch and video on the same timeline.

1:56
Max Simchowitz avatar
⟳ Sarvesh Patil retweeted
Max Simchowitz@max_simchowitz·Oct 21

This is one of my favorite projects I’ve been a part of this year. It’s ostensibly about robotics, but I feel that I learned something very fundamental about how AI models should represent all modalities that (superficially!) seem like they are best suited to being represented in continuous-valued (e.g. float) vectors. TL;DR discrete parametrizations are awesome, learn geometry from data, but aren’t constrained by it, and can perform better as a result. Exactly what the bitter lesson tells us we should look for.

Common belief: Robot policies need continuous action heads; discrete actions are 𝐥𝐞𝐬𝐬 𝐧𝐚𝐭𝐢𝐯𝐞 𝐚𝐧𝐝 𝐥𝐞𝐬𝐬 𝐩𝐫𝐞𝐜𝐢𝐬𝐞. ❗We find policies w/ the simplest discrete representations 𝐦𝐚𝐭𝐜𝐡 𝐨𝐫 𝐛𝐞𝐚𝐭 continuous ones—in sim & real, in single-step & diffusion/flow settings. Here's why 🧵

1:44
zeji yi avatar
⟳ Sarvesh Patil retweeted
zeji yi@ZejiYi·Oct 20

Common belief: Robot policies need continuous action heads; discrete actions are 𝐥𝐞𝐬𝐬 𝐧𝐚𝐭𝐢𝐯𝐞 𝐚𝐧𝐝 𝐥𝐞𝐬𝐬 𝐩𝐫𝐞𝐜𝐢𝐬𝐞. ❗We find policies w/ the simplest discrete representations 𝐦𝐚𝐭𝐜𝐡 𝐨𝐫 𝐛𝐞𝐚𝐭 continuous ones—in sim & real, in single-step & diffusion/flow settings. Here's why 🧵

1:44
jackie avatar
⟳ Sarvesh Patil retweeted
jackie@lambdacalcc·Oct 14

I read more AI output than anything else, all in a language I already know. That felt like a waste, so now about 1 in 8 words is French.

0:30
Jaeyeon (Jay) Kim avatar
⟳ Sarvesh Patil retweeted
Jaeyeon (Jay) Kim@Jaeyeon_Kim_0·Oct 15

Today, we introduce Priming Models, a new paradigm for training one-step generative models from scratch. No diffusion teacher. No flow map. No CFG. No JVP. We believe this work will challenge how we think about building one-step models. Joint work with @sitanch, @du_yilun, @parkwbin03, Bohyung Han. 🔥 1.19 FID one-step on ImageNet 256×256 while using substantially less compute, e.g., 12X less than Drifting-B, 6X less than Drifting-L 🎨 Scales to text-to-image generation (GenEval 0.82) 🤖 World modeling on RT-1 / Bridge-V2 Priming Model is built on one core message: [Reconstruction pretraining --> Distributional post-training].

Sarvesh Patil avatar
Sarvesh Patil@servo97·Oct 14

Video model encodings with recurrent architectures (e.g. GDNs) for latent memory compression (like workspace models) seem to be scaling with the use of world models at scale in multi-task settings! The most impressive tasks for me are the seemingly innocuous ones, like wiping a table. Purely inferring actions from states that look more or less the same can render traditional MDP formulations unsuccessful. Using latent memory states to steer policy actions seems neat to convert the POMDP to an MDP!

What to remember in the past to act—spatial, temporal or motion details? We often assume what’s useful, but that’s hard to know in advance. Meet IMPRINT 🧠: retain rich memory first, then learn to use it for control. Compact latents keep inference fast as history grows. 🧵 1/10

1:00