←
Bardienus Duisterhof288 posts
Bardienus Duisterhof avatar

Bardienus Duisterhof

@bardienus

Incoming Postdoc @stanford || PhD Student @CMU_Robotics with @jeff_ichnowski || Efficient World Models for Robot Manipulation 📷 ||

◷ Joined October 2018▧ 48 Photos and videos
Bardienus Duisterhof avatar
Bardienus Duisterhof@bardienus·Sep 17

Introducing PointZero—a 3D world model pre-trained without robots. Dexterous manipulation requires understanding diverse 3D dynamics, but current approaches rely on expensive robot data. So how can we pre-train a 3D dynamics model without it? PointZero introduces a simple idea: learning to complete 3D point tracks yields transferable 3D dynamics! Our model achieves SOTA results on: 🔥 Zero-shot 3D dynamics 🔥 Action-conditioned 3D dynamics (post-training) 🔥 Imitation learning (post-training) Details and links 👇 1/6

0:43
Arthur Jakobsson ✈️ CoRL '26 avatar
⟳ Bardienus Duisterhof retweeted
Arthur Jakobsson ✈️ CoRL '26@Arthur_K_J·Nov 12

Excited to present the work I am cooking up, JACK, today at the "Do Robots Need World Models?", PhysWM, and UncertainWM workshops. Looking forward to discussing learning from interaction with everyone!

Have you pulled a push door or struggled with a tesla door handle? Articulation isn't easy but we learn from interaction. This begs the question: how should world models reason about what they have seen? I argue our robots need to learn to seek out information from the environment through interaction. Check out arthurjakobsson.com/blog/jac… where I write about my thoughts on this and introduce JACK my current exploration in active sensing and belief based world models.

0:15
Bardienus Duisterhof avatar
Bardienus Duisterhof@bardienus·Nov 12

Full house at the 'Do Robots Need World Models?' workshop! @chelseabfinn talking about long-context VLAs now.

Post attachmentPost attachment

The hottest debate of the year: do robots need 🌎 world models 🌎? Join us at CoRL 2026 for a scientific debate on the case for — and against — world models for robotics, featuring @chelseabfinn @vincesitzmann @YunzhuLiYZ @GeorgiaChal! 📄 Paper submissions are open now and close October 12. We welcome both research papers and position papers. 🏆 Submit your work for a chance to win an NVIDIA Jetson Thor or a Samsung Galaxy Tab S11 Ultra! Organized by @longhini_a @wenlong_huang Lasse Peters, @Jefferson_Aero , @PatkiSiddharth @jeff_ichnowski @drfeifei and myself. Thanks to sponsors @NVIDIARobotics and @Samsung!

Post attachment
Anushka Sagar avatar
⟳ Bardienus Duisterhof retweeted
Anushka Sagar@anushkaasagar·Nov 5

Meet Inkling 2 Small, our newest model from @thinkymachines — on Tinker today, with weights landing after the completion of our final safety checks 🦺

Introducing Inkling 2 Small. Scoring 31 on the AA Intelligence Index, it's a big jump over its predecessor. Inkling 2 Small is available for fine-tuning and inference on Tinker today, with full weight release planned soon. thinkingmachines.ai/news/ink…

Andrea Miele avatar
⟳ Bardienus Duisterhof retweeted
Andrea Miele@andreamiele_·Oct 27

🔥 Diffusion LMs promise what autoregressive models can’t: fixing their mistakes. But new ones often change the noise and the sampler at once. Which matters? We tested it on the hypersphere. Noise: 0.8 points. Sampler: 25. We introduce Spherical Brownian Diffusion 🌐 👇🧵

Vincent Sitzmann avatar
⟳ Bardienus Duisterhof retweeted
Vincent Sitzmann@vincesitzmann·Oct 16

Arthur is right: Europe has a recurring pattern of defeatism. The key to excellence is momentum: Arthur & Mistral have done a great job getting quite close to the frontier, at very small expenditure (relative to other big labs). Given more runway, they *will* get closer still. Further, Europes own frontier AI lab is essential for independence. Europe needs frontier labs where young researchers learn the fundamentals of this technology, as a seed for an ecosystem of applications and new startups: a frontier lab is a never-ending source of startups founded by its alumni, value that Europe can only accrue if it has its own frontier lab. Physical AI - intelligent robots - will require *exactly the same* infrastructure and insights as LLMs do. If Europe gives up on LLMs, Europe will give up its independence on all AI, physical or otherwise. Lastly, perseverance is a muscle that has to be trained: if Europe doesn't learn to not give up in the face of (fierce) competition in the case of LLMs, it will fail at this exercise again when the next innovation comes around. Europe needs a frontier lab like Mistral.

Should Europe leave frontier AI to the Americans and the Chinese? The idea has gained ground in Europe. It is a fundamental mistake. Build or surrender: for now, the choice is still ours. Full article below.

Mateo Guaman Castro @ CoRL 🤠 avatar
⟳ Bardienus Duisterhof retweeted
Mateo Guaman Castro @ CoRL 🤠@mateoguaman·Oct 9

yup, curriculum learning is probably as old as RL :D People usually think of RL as "the agent collects its own data", but the robot can't really pick its own data to solve a hard exploration problem, and see useful gradient signal, if the chance of seeing success is super low (in a sparse reward setting). Which then leads to using denser rewards so that the gradient signal is not impossibly rare to stumble upon. Which then leads to tons of reward tuning and task-specific curriculums. Which then leads to suboptimal policies which are optimizing wrt a soup of mishmashed objectives. Which turns out leads to an inability to scale. So the details of SGS that matter are: 1. Expose a ton of "task configurations" (initial state, goal) to the robot, so that the difficulty of the set of tasks the robot can actually pick from is actually diverse. 2. Instantiate a very simple, automatic, adaptive curriculum based on success rate of each of these task configs (SGS) so that the robot doesn't waste experience in tasks that are neither too easy nor too hard. So the surprising thing is that this simple instanciation lets us train policies with a sparse reward formulation, at much higher scale than previously possible, to achieve really hard robotic tasks :D

Cool results (and website)! But the method wasn't really "missing"; it's curriculum learning, which has been a thing for a long time, unless I'm missing something? The key to making this work well has always been the task distribution.

Post attachment
Mateo Guaman Castro @ CoRL 🤠 avatar
⟳ Bardienus Duisterhof retweeted
Mateo Guaman Castro @ CoRL 🤠@mateoguaman·Oct 9

(1/N) Who says you can't do contact-rich, precise manipulation with sim-to-real RL? No demonstrations, no retargeting, no tactile sensors, no crazy reward tuning. Just 1x, reactive policies trained with scaled up RL. Excited to finally release Success-Guided Sampling (SGS)! More info in @octi_zhang's thread and more thoughts of my own below! 🧵 Website here: sgs-rl.github.io

0:07

(1/5) Everyone says dexterous manipulation needs real-world data. These policies were trained with none. Our robots mesh gears, thread nuts, and insert pegs zero-shot from RGB, and the same recipe works for locomotion across terrains much harder than before. The missing piece wasn't a better RL algorithm, but a small tweak to what the robot practices. Today we're releasing Success-Guided Sampling (SGS), a simple change to the task sampler that unlocks new levels of dexterity and agility with large-scale, end-to-end sim2real RL. No demonstrations, no per-task reward tuning. Just PPO at scale. Check out the policies yourself at sgs-rl.github.io! All videos at 1x speed! 🧵 🔈

1:15
Žiga Kovačič avatar
⟳ Bardienus Duisterhof retweeted
Žiga Kovačič@zzigakovacic·Oct 5

Do coding agents understand the dynamics of the world well enough to reconstruct it from video? We introduce 4DCodeBench to evaluate this ability through 4D inverse graphics. 4DCodeBench.com/ <🧵>

0:54
Ziqi Ma avatar
⟳ Bardienus Duisterhof retweeted
Ziqi Ma@ziqi__ma·Oct 5

Very excited to share LoGo, my internship project at @theworldlabs on post-training world models! We found that reward design matters a great deal in post-training long-horizon video gen for 3D consistency, echoing what we see in other domains, e.g. LLM reasoning. Check out more 👉 ziqi-ma.github.io/logo-websi…

0:41
Charles Maddock avatar
⟳ Bardienus Duisterhof retweeted
Charles Maddock@charles_maddock·Oct 4

Random German lab appears from nowhere and drops SOTA open-weight model Beats Qwen, Mistral, Nematron models with similar active parameter count Trained from stratch

0:12

Small bird, fast wings, Kolibri is here. 78B parameters. 3.46B active. Up to 1M tokens of context. Built in Europe. Now the weights are yours. Run it on your own hardware, under Apache 2.0.

0:04
Vincent Sitzmann avatar
⟳ Bardienus Duisterhof retweeted
Vincent Sitzmann@vincesitzmann·Sep 30

Excited to speak at this workshop!!

The hottest debate of the year: do robots need 🌎 world models 🌎? Join us at CoRL 2026 for a scientific debate on the case for — and against — world models for robotics, featuring @chelseabfinn @vincesitzmann @YunzhuLiYZ @GeorgiaChal! 📄 Paper submissions are open now and close October 12. We welcome both research papers and position papers. 🏆 Submit your work for a chance to win an NVIDIA Jetson Thor or a Samsung Galaxy Tab S11 Ultra! Organized by @longhini_a @wenlong_huang Lasse Peters, @Jefferson_Aero , @PatkiSiddharth @jeff_ichnowski @drfeifei and myself. Thanks to sponsors @NVIDIARobotics and @Samsung!

Post attachment
Bardienus Duisterhof avatar
Bardienus Duisterhof@bardienus·Sep 30

The hottest debate of the year: do robots need 🌎 world models 🌎? Join us at CoRL 2026 for a scientific debate on the case for — and against — world models for robotics, featuring @chelseabfinn @vincesitzmann @YunzhuLiYZ @GeorgiaChal! 📄 Paper submissions are open now and close October 12. We welcome both research papers and position papers. 🏆 Submit your work for a chance to win an NVIDIA Jetson Thor or a Samsung Galaxy Tab S11 Ultra! Organized by @longhini_a @wenlong_huang Lasse Peters, @Jefferson_Aero , @PatkiSiddharth @jeff_ichnowski @drfeifei and myself. Thanks to sponsors @NVIDIARobotics and @Samsung!

Post attachment
Bardienus Duisterhof avatar
Bardienus Duisterhof@bardienus·Sep 28

Wow! Atlas XL go brr brr, congrats team @theworldlabs

World Labs is joining @AMD! Over the past few years our incredible team has pushed the boundaries of spatial intelligence through models like Marble, RTFM, and now Atlas. By partnering with AMD we will train bigger and better models than ever before, and build out an ecosystem of open models. I can’t wait to get started!

Bardienus Duisterhof avatar
Bardienus Duisterhof@bardienus·Sep 28

I'll be at IROS this week and looking to discuss anything (efficient) world models for manipulation. Please DM me to set up a coffee chat! ☕️

Post attachment