←
David Chen7,320 posts
David Chen avatar

David Chen

@chenosaurus

GM Robotics @LiveKit. Building the realtime platform for Physical AI. Previously @Agtonomy, @skycatch, @twitter.

◷ Joined July 2008▧ 843 Photos and videos
Wevolver avatar
⟳ David Chen retweeted
Wevolver@WevolverApp·Nov 17

Researchers have used reinforcement learning to teach a 5-tonne John Deere skid-steer loader to perform complex acrobatic manoeuvres autonomously. Trained in simulation and transferred to a real machine, the system can balance on two wheels, navigate rough terrain, spin, and control its bucket before landing safely. The research demonstrates the potential of AI-driven automation for heavy construction and industrial machinery. Video Credit: @leggedrobotics / @ETH Paper: wevlv.co/4kltYys #engineering #technology

1:10
David Chen avatar
David Chen@chenosaurus·Nov 10

Big news for ROS 2 users from @livekit. We just released LiveKit Portal for ROS 2! Connect to and control you robots running ROS anywhere in the world. Low latency video & data streaming with ease! github.com/livekit/ros-porta…

Introducing LiveKit Portal for ROS 2. Securely connect your robots to remote operators, cloud GPUs, web apps, or other robots on different networks, without: • Exposing DDS • Changing your existing nodes • Building your own transport layer Check it out: livekit.com/blog/introducing…

Isaac Sin avatar
⟳ David Chen retweeted
Isaac Sin@IsaacSin12·Nov 4

We're hosting another Physical AI Hack this weekend, November 7–8 at @fdotinc in San Francisco. This time, we're partnering with @dreamlabs_ai and their new world action model, Dream-1, which can do tasks zero-shot. @livekit @nvidia @huggingface @dimensionalos @enact_labs are joining us too. @livekit is the real-time layer: connect your robot to human operators and cloud models with ultra low latency, then give it a voice agent so you can talk to it. You'll get LiveKit credits for real-time streaming and voice agents. Other technical partners: @_lightcompany @mirdainsystems @SGhashghaei @spcxstarship Prizes: 1st place: $2,000 + a Metal Arm + credits 2nd place: $1000 + a Maker Arm + credits 3rd place: $500 + a Reachy Mini + credits Sign Up: luma.com/pah There are two tracks: Hill climb (New Track): This is a new format where everyone works to improve the model's accuracy on the same task. We'll announce the task soon and provide the props. You'll climb the leaderboard through fine-tuning, DAgger and a System 2 agent harness around Dream-1, using LiveKit and Dimensional OS. Creative (Zero shot): Build the most creative project you can with Dream-1, LiveKit and Dimensional OS.

0:05
David Chen avatar
David Chen@chenosaurus·Oct 29

RIP @SirPatStew, thanks for all the Star Trek TNG growing up. Once upon a time, when I worked at @twitter, I was asked if I wanted to be in a Vine the company was making. Turns out it was none other than Captain Jean-Luc Picard...

0:07
David Chen avatar
David Chen@chenosaurus·Oct 28

This is gonna be a really good robotics hackathon. High quality hardware from @makermodsai + Dream-1 from @dreamlabs_ai + voice interface & orchestration with @livekit Agents will be a killer combo.

We're hosting a huge Physical AI hackathon. We’ve run robotics hackathons before but this one is different: Bimanual Metal Arm and Maker Arm Stations Fine Tune Dream-1, this is not another ACT competition New Hill Climb leaderboard format Two tracks: push your robot up the live eval leaderboard. Or build the creative, most useful robot application you can think of. Partnering with @dreamlabs_ai @livekit @huggingface @nvidia @_lightcompany @mirdainsystems November 7–8. San Francisco. Co-hosted with Founders Inc @fdotinc Come build with us: luma.com/pah

0:08
Asimov avatar
⟳ David Chen retweeted
Asimov@asimovinc·Oct 12

We're open-sourcing Menlo SDK so you can build your own applications for a humanoid robot. The SDK connects your code to Asimov 1, letting you control its movements and read its state. With the full source available, you can build on the existing foundation and adapt it to what your project needs. You can use it to replay a motion, control the robot through a VR headset, or run your trained policy on real hardware. We're also open-sourcing Asimov Edge, the software that runs on the robot, checks incoming commands, and manages control between your application, a gamepad and other controllers. - SDK: github.com/menloresearch/men… - Docs: docs.menlo.ai/sdk - Order yours: menlo.ai/asimov-1 Keep going.

7:40
LiveKit avatar
⟳ David Chen retweeted
LiveKit@livekit·Oct 15

Voice agents get built three ways: cascaded (STT, LLM, TTS), turn-based speech-to-speech, and full-duplex, where the model listens and talks at the same time. All three now run on LiveKit Inference: GPT-Live and GPT Realtime from @OpenAI, @grok Voice Think Fast from @xai, and Gemini Live from @GoogleDeepMind. One LiveKit Cloud key, one bill.

1:06
David Chen avatar
David Chen@chenosaurus·Sep 28

On my way to the @LiveKit company retreat in Cancun. Half my suitcase is filled with robots and robot accesories. 🤖

UFB - Ultimate Bots avatar
⟳ David Chen retweeted
UFB - Ultimate Bots@UFBots·Sep 23

ULTIMATE BOTS SEASON 2 IS HERE. 🤖🏆 4 teams. 6 events. $100K on the line. Teams will earn points across 3 disciplines: 🥊 Martial arts 💃 Dancing 🏁 Obstacle course Season 2 hits F1 Austin → TwitchCon → IEEE Humanoids → CES → Big Game Weekend → NVIDIA GTC. Captains + teams announced soon. Follow for reveals, ticket drops & live streams.

0:44
David Chen avatar
David Chen@chenosaurus·Sep 16

We just launched our startup program. What are you building in voice, video, or physical AI?

Your whole voice stack, free for a year on LiveKit. $10K in Cloud credits + a year of Scale + $7K in partner inference credits ($1K each: Gemma, @DeepgramAI, @inworld , @rimelabs , @FishAudio, @AssemblyAI, @GradiumAI.) One workspace. No provider keys. Apply now: livekit.com/startups

1:08
David Chen avatar
David Chen@chenosaurus·Sep 15

A chance to interact with Lumi from @lightberry tonight at the Audio Layer event. Hang out and chat about how audio will become the default interface for physical AI with @livekit @ai_coustics @tavus @GradiumAI luma.com/uxmg18ib

MEET LUMI THE WORLD'S MOST INTERACTIVE ROBOT Assembled in SF, shipping in 2026 💛

0:35
ai-coustics avatar
⟳ David Chen retweeted
ai-coustics@ai_coustics·Sep 15

24 hours till Audio Layer! Sign up now: 🔗eu1.hubs.ly/H0yjlcn0 We can't wait to see you at @tavus office for the Audio Layer 3.0: Voice x Robotics. On top of @quinnfavret, @chenosaurus and @ConstanceGriso, our co-founder Fabian will be joined at the panel by @t_v_b_v , representing @lightberry. If you want to see interactive demos with robots and Voice AI models, and connect with builders from both spaces - secure your spot today! See you there?

Post attachment
Binh avatar
⟳ David Chen retweeted
Binh@pham_blnh·Sep 12

it took a lot of prep, but i managed to reproduce this instead of just having astra figure out everything (since i’m token poor), i told it to first do a real2sim of the environment, then move the robot around to check for alignment, then draw the trajectories will be validated first in sim, then transferred to real this saves tokens spent and makes astra draw faster it’s also a proof of how crazy the new model at both few-shot real2sim and robot control below is an attempt to draw a flower meadow using this method

0:29

i gave astra a robot, a paint brush, and a camera then asked it to paint the golden gate bridge in real life! it figured out how to control the robot, and progressively got better throughout its attempts. the timelapse is sick

1:08