←
Jimmy (Tsung-Yen) Yang49 posts
Jimmy (Tsung-Yen) Yang avatar

Jimmy (Tsung-Yen) Yang

@JimmyTYYang1

Researcher at @Waymo Research; ML/Embodied AI; PhD @Princeton ECE

◷ Joined August 2018▧ 10 Photos and videos
Jimmy (Tsung-Yen) Yang avatar
Jimmy (Tsung-Yen) Yang@JimmyTYYang1·Oct 11

If you're a PhD student looking for an impactful research internship for Summer 2027, our team would like to hear from you! Topics include, but are not limited to, world models, RL, post-training, and planning: careers.withwaymo.com/jobs/2…

Jimmy (Tsung-Yen) Yang avatar
Jimmy (Tsung-Yen) Yang@JimmyTYYang1·Aug 19

I rarely repost content, but this is a step-change for robotics research. As an embodied AI researcher, I find this to be a truly special moment for the field

Introducing GEN-1.5, a one-shot learner. It can learn new tasks in a few seconds. Show it what to do, and it generalizes. This capability emerged from pretraining on physical data at scale, as a step towards our mission of building general intelligence for the physical world.

3:33
Basile Terver avatar
⟳ Jimmy (Tsung-Yen) Yang retweeted
Basile Terver@BasileTerv987·May 25

📢 Accepted to TMLR, with reproducibility certification 🏅 v2 of our JEPA-WM study (arXiv:2512.24497) is out, with new data-scaling experiments, a Lipschitz analysis of multistep rollout training, and extended discussions. Recap + what's new 👇 w/ @JimmyTYYang1, Jean Ponce, @AdrienBardes, @ylecun

My first PhD paper is out! 🎓 "What Drives Success in Physical Planning with Joint-Embedding Predictive World Models?" tl:dr: JEPA-WMs for robotics: learn dynamics on top of visual encoders, optimize actions towards goal 👇 w/ @JimmyTYYang1, Jean Ponce, @AdrienBardes, @ylecun

1:08
Jimmy (Tsung-Yen) Yang avatar
Jimmy (Tsung-Yen) Yang@JimmyTYYang1·Jan 14

It was great to work with @BasileTerv987 on this project! The JEPA world model works well on unseen robot tasks. Thanks Basile for the amazing work!

My first PhD paper is out! 🎓 "What Drives Success in Physical Planning with Joint-Embedding Predictive World Models?" tl:dr: JEPA-WMs for robotics: learn dynamics on top of visual encoders, optimize actions towards goal 👇 w/ @JimmyTYYang1, Jean Ponce, @AdrienBardes, @ylecun

1:08
Jimmy (Tsung-Yen) Yang avatar
Jimmy (Tsung-Yen) Yang@JimmyTYYang1·18 Dec 2025

It is my pleasure to work with Raktim! A concrete example of how to use human videos to learn robot policies

Introducing DexWM: Dexterous Manipulation World Model tl;dr: train on human videos; fine-grained actions; hand-consistency loss; DexWM+MPC -> zero-shot dexterous manipulation w/ @_amirbar, @DavidJFan, @JimmyTYYang1, @GaoyueZhou, P. Krishnamurthy, M. Rabbat, F. Khorrami, @ylecun

0:56
Dhruv Batra avatar
⟳ Jimmy (Tsung-Yen) Yang retweeted
Dhruv Batra@DhruvBatra_·26 Apr 2024

FAIR researchers (@AIatMeta) presented SegmentAnything and our robotics work at the White House correspondents’ weekend. Llama3 + Sim2Real skills (trained with @ai_habitat) = a robot assistant

Post attachmentPost attachmentPost attachmentPost attachment
The Hill@thehill26 Apr 2024

Washingtonians delved into the world of artificial intelligence (AI) at the Washington AI Network’s inaugural weekend TGAIFriday Lunch for White House correspondents. trib.al/FwHF9Um

Jimmy (Tsung-Yen) Yang avatar
Jimmy (Tsung-Yen) Yang@JimmyTYYang1·20 Oct 2023

Very excited to see that Habitat 3.0 is finally out! Please also check out our paper here: ai.meta.com/static-resource/…

Announcing Habitat 3.0, simulating humanoid avatars and robots collaborating! - Humanoid sim: diverse skinned avatars - Human-in-the-loop control: mouse/keyboard or VR - Tasks: social navigation and rearrangement Over 1,000 steps per second on 1 GPU for large-scale learning!

0:16
Jimmy (Tsung-Yen) Yang avatar
Jimmy (Tsung-Yen) Yang@JimmyTYYang1·2 Aug 2023

Please check out our Spot Sim2Real repo! github.com/facebookresearch/… It aims to reproduce the demos of ASC and LSC. We open-source the weights of the navigation, picking, and place skills, and the infrastructure to use Large Language Models (LLMs) to interact with those skills!

Habitat stable version v0.2.5 released! -- 🤖 Hardware bridge for BD Spot -- 📷 Improved PBR rendering for better synthetic scene visuals -- 🤗 ai-habitat on HuggingFace -- 🏠 Habitat Synthetic Scenes Dataset (HSSD) and more... github.com/facebookresearch/… github.com/facebookresearch/…

Boston Dynamics avatar
⟳ Jimmy (Tsung-Yen) Yang retweeted
Boston Dynamics@BostonDynamics·19 Jul 2023

“We were very interested in testing out high-level reasoning and planning. We wanted to see...if the robot could figure out the steps it needed to take to solve the problem.” - Discover why @MetaAI chose Spot for their research. bit.ly/44ILlhG

Jimmy (Tsung-Yen) Yang avatar
Jimmy (Tsung-Yen) Yang@JimmyTYYang1·21 Jun 2023

This is our recent work building toward "reproducible" robotic research. Thanks @chris_j_paxton for leading such an amazing project!

The future of robot butlers starts with mobile manipulation. We’re announcing the NeurIPS 2023 Open-Vocabulary Mobile Manipulation Challenge! - Full robot stack ✅ - Parallel sim and real evaluation ✅ - No robot required ✅👀 aihabitat.org/challenge/2023…

1:25
Jimmy (Tsung-Yen) Yang avatar
Jimmy (Tsung-Yen) Yang@JimmyTYYang1·18 Jun 2023

Check our work at Meta AI #CVPR23 ! Spot is able to understand natural language instructions and complete the task for you!

AI at Meta@AIatMeta18 Jun 2023

We’ll also be showcasing a handful of demos on the showfloor. We brought Spotty to demo some of our exciting recent work towards general-purpose embodied AI agents. More on this research ➡️ bit.ly/3N8LeVg 5/6

0:35