
3 years ago today we @things launched Rooms on iOS
Rooms, an interactive 3D space designer and 'cozy game,' arrives on the App Store tcrn.ch/3MNUA9M by @sarahpereztc

Sr. Director at Meta. Previously: CEO of @Things, GM of Vine, PM at Google

3 years ago today we @things launched Rooms on iOS
Rooms, an interactive 3D space designer and 'cozy game,' arrives on the App Store tcrn.ch/3MNUA9M by @sarahpereztc

Tall twin waterspouts over San Francisco Bay near Brisbane, CA lasting several minutes. Never stop chasing. #cawx

Excited for more and more of this
i recreated THE ENTIRE WORLD in minecraft at 1:1 scale. every building on earth, including your house! to do this, i trained a SOTA world-to-minecraft generator on maps data, complete with furnished home interiors! play and check out your neighborhood: worldcraft.gg


1/ Starting today, you can talk to your Muse. Voice and expressive avatars, which we previewed at Connect, are rolling out to everyone in the US. Tap the phone icon and start talking. Work through an idea, rehearse for an interview, or just get a task done if you need to be hands free. Here’s me talking to my Muse, DootDoot:

Hello!
During Connect, we previewed Muse Realtime Avatar, our real-time embodiment technology that turns Muse Realtime Voice into expressive, interactive avatars. Today, we’re rolling it out in the @Muse app in the US, giving people a more natural way to engage with their personal agents. Learn more about Muse Realtime Avatar on our research blog: go.meta.me/47ZSNso

🚨 MUSE ALERT 🚨 the muse ipad app is out now!! check it out for all your tablet superintelligence needs :))

🚨 side project alert 🚨 Announcing Muse Gadgets, an open source ESP32 firmware and Linux sdk so that you can make hardware devices that work with Muse. Grab an API token from gadgets.muse.ai and point your favorite coding agent at the github repo to build your own peripherals for Muse.


Muse on Mac can now take over your computer and do things for you! Local computer use has shipped at Connect! 🥳 This is what I worked on at my startup 2 years ago with many great folks before joining Meta. Very excited to see it now shipped for the masses!

It’s a real life tamagotchi! Want!
And we've been building a joyful little device for talking to your Muse that fits on your keychain. Muse Charm -- shipping in December.

MUSE RESEARCH ALERT: 1/ meet Muse Realtime Avatar, the state-of-the-art model that brings your muse to life alongside Muse Realtime Voice! it animates your muse as it talks to you. voice & video are in sync, so muse will answer in under a second, for as long as you want to chat.


ElevenLabs is coming to @Muse. Voiceovers, soundtracks, and videos are just a message away inside Meta's personal AI agent.


When I look back at the earliest @Muse mocks, the very first thing that was designed was the “status” pill at the top of the screen. That one tiny piece of UI survived every subsequent revision, many months on. It remains one of my favorite parts of the design. Its purpose is to simply and clearly answer the question: what is my agent doing right now? And do that across every surface of the app. Representing status in this way is more of a messaging pattern and was kind of controversial early on. Most AI apps had coalesced around “chain of thought” as the way to represent ongoing work, which almost always appeared at the bottom of the thread itself. I had a petulant aversion to this and it didn’t work anyway, given the initial app was already three tabs (feed, chat, library). A persistent status display was necessary. The initial version didn’t have the avatar and was only capable of ~6 deterministic states. Even in that basic form it was incredibly useful during testing – just showing connection status was critical in those early days. Excited to share some more stories about the design of Muse. I haven’t tweeted in a few years as I’ve just been working away, but I think this will be a fun story.