We gave a robot the walking directions you'd get from a web map.
Then we let it find its own way through Zurich: crosswalks, stairs, crowded streets, construction sites, 2.35 km in total.
Introducing WayTrace 🧵👇
Awesome stuff!
Right-human arm moving in prompt -> Left-robot arm picks up the cup. Does it imply that the GEN-1.5 has a object centric encoder for the physical-prompt ?
I cannot wrap my head around why the other arm be moving, unless the model **just knows**.
@peteflorence
We've reduced the time it takes to go from physical prompt → robot behavior.
The faster anyone can teach a robot to do something new, the easier it becomes to scale physical work.
Read more about GEN-1.5 in our blog post in the comments below.
One less-known fact about glove-based data collection: it produces higher quality data than teleop on contact-rich tasks.
Remote teleop can’t provide good force feedback, but gloves do naturally, making tasks like sock folding, which rely on feel, far easier to capture.
270K hours of robot data ~30yrs.
90 data collectors working for 8hrs a day for year?
Can be done in around 2M USD with UMI based ?
P.S. Thats around 30B images at 30fps , ~15PB of image storage. Makes sense to lay new internet cables to transfer data (awesome stuff!!!)
Introducing GEN-0, our latest 10B+ foundation model for robots
⏱️ built on Harmonic Reasoning, new architecture that can think & act seamlessly
📈 strong scaling laws: more pretraining & model size = better
🌍 unprecedented corpus of 270,000+ hrs of dexterous data
Read more 👇
“You can’t make progress until you are able to measure it. Robotics still doesn’t have such a rallying call. No one agrees on anything.” I 💯 agree with the recent post from @DrJimFan.
To break this impasse, we are excited to announce ManipulationNet (manipulation-net.org/), a community-driven global infrastructure supported by @NIST, that enables benchmarking real-world robot manipulation research at scale with any robot at any time and anywhere on standardized task setups.
ManipulationNet’s key features include:
✅delivers standardized hardware kits globally to support reproducible task setups
✅provides online task instructions in real-time, which could involve visual/language prompts, task-specific instructions, etc..
✅collects authentic manipulation performance for comparable results on global leaderboards
🌍Join the ManipulationNet, let us aim to "connect the dots" of the up-to-date progresses and challenges to construct a network of real-world robot abilities and skills, a network of research roadmaps, and a network of research questions.
Want to learn more about ManipulationNet? Check out the links below:
🔗Project website: manipulation-net.org
🔗Founding Committee and Developer Team: manipulation-net.org/committ…
🔗Paper: manipulation-net.org/MNet_pr…
(1/7)
BREAKING NEWS
The Royal Swedish Academy of Sciences has decided to award the 2025 #NobelPrize in Physics to John Clarke, Michel H. Devoret and John M. Martinis “for the discovery of macroscopic quantum mechanical tunnelling and energy quantisation in an electric circuit.”
With 3M+ downloads and counting, NVIDIA Cosmos is redefining physical AI.
Announced at #CORL25, new Cosmos updates are allowing developers to generate diverse data for accelerating training robot models at scale.
👏 Cosmos Predict 2.5 will combine three models into one powerful model—reducing complexity, powering up to 30s video generation, and enabling multi-view simulations.
👏 Cosmos Transfer 2.5 will be 3.5x smaller yet faster and sharper—generating photorealistic synthetic data from 3D scenes or spatial inputs.
🔗 nvda.ws/48lW6eT
According to this paper, the Unitree G1 humanoid robot secretly and continuously sends sensor and system data to servers in China without the owner's knowledge or consent. arxiv.org/abs/2509.14139
🇧🇬 Exciting news! Today Bulgaria was announced as a winner of one of six new European AI factories!
✅ The project, valued at €90 million, is a collaboration between INSAIT and Sofia Tech Park. The funding will be used to establish a modern GPU AI data center in Sofia, helping support large-scale AI projects at INSAIT and beyond.
🇪🇺 Bulgaria joins Austria, France, Germany, Poland, and Slovenia as countries that have won an AI factory.
🏆 Helping Bulgaria win an AI factory is yet another step of INSAIT's strategy to position Bulgaria on the global AI map.
Announcing The Stargate Project
The Stargate Project is a new company which intends to invest $500 billion over the next four years building new AI infrastructure for OpenAI in the United States. We will begin deploying $100 billion immediately. This infrastructure will secure American leadership in AI, create hundreds of thousands of American jobs, and generate massive economic benefit for the entire world. This project will not only support the re-industrialization of the United States but also provide a strategic capability to protect the national security of America and its allies.
The initial equity funders in Stargate are SoftBank, OpenAI, Oracle, and MGX. SoftBank and OpenAI are the lead partners for Stargate, with SoftBank having financial responsibility and OpenAI having operational responsibility. Masayoshi Son will be the chairman.
Arm, Microsoft, NVIDIA, Oracle, and OpenAI are the key initial technology partners. The buildout is currently underway, starting in Texas, and we are evaluating potential sites across the country for more campuses as we finalize definitive agreements.
As part of Stargate, Oracle, NVIDIA, and OpenAI will closely collaborate to build and operate this computing system. This builds on a deep collaboration between OpenAI and NVIDIA going back to 2016 and a newer partnership between OpenAI and Oracle.
This also builds on the existing OpenAI partnership with Microsoft. OpenAI will continue to increase its consumption of Azure as OpenAI continues its work with Microsoft with this additional compute to train leading models and deliver great products and services.
All of us look forward to continuing to build and develop AI—and in particular AGI—for the benefit of all of humanity. We believe that this new step is critical on the path, and will enable creative people to figure out how to use AI to elevate humanity.
BREAKING NEWS
The Royal Swedish Academy of Sciences has decided to award the 2024 #NobelPrize in Chemistry with one half to David Baker “for computational protein design” and the other half jointly to Demis Hassabis and John M. Jumper “for protein structure prediction.”
BREAKING NEWS
The Royal Swedish Academy of Sciences has decided to award the 2024 #NobelPrize in Physics to John J. Hopfield and Geoffrey E. Hinton “for foundational discoveries and inventions that enable machine learning with artificial neural networks.”
Not a Nash equilibrium when opponent is not optimal. True that Nash equilibrium strategy is not the most +EV but to figure out opponents sub optimal strategy/biases on the fly and to adjust your strategy is the true poker skill i guess
Let’s say this differently then, catpoopburglar…
all GTO solvers I’ve seen find a Nash equilibrium assuming the other players are playing GTO. If, however, you seed certain players in a 6-handed solver (for example) w non-GTO strategies, the output will be a new Nash equilibrium that deviates from the counterfactual GTO. Call this new line GTO’.
Is this better?
Estimating a full-body pose from only the headset and controllers is ambiguous. Environment information can help resolve this. In our #SIGGRAPH2023 paper the avatar is generated from only the 3 shown coordinate frames (no cameras) + height of the environment (green dots). (1/4)👇