Things that aren’t there can now see and hear you.
Reality-Aware Rendering is now live in Simulon. Place anything in the real world, act out the scene, and it responds to you.
We made this short in an afternoon. Watch to the end to see what was really there.
Available now on iPhone. How it works 👇
This squirrel moment from yesterday’s Aristotle video is pretty wild.
It came out of nowhere mid-conversation, and I just kept recording to see how our spatial reasoning pipeline would handle it.
The squirrel’s path was adjusted to land on Aristotle, who immediately noticed and reacted.
None of it was planned, scripted, or prompted.
Here's the original recording alongside the final result.
No scripted dialogue. No predefined animations. No predetermined reactions.
We place characters into the world using AR and interact with them naturally, imagining they're really there.
@Simulon reasons about what happened and generates their performance afterward.
It's not real-time, yet. But it's a glimpse into a future where intelligent digital characters can share our physical world.
You perform your side of the encounter. Simulon creates the other.
2/3
Introducing Personas in Simulon.
41 years ago, Steve Jobs imagined speaking to Aristotle.
Today, we're using the iPhone he introduced to show Aristotle that very prediction.
But what if Aristotle could experience our world and ask us questions?
Here's our first unscripted encounter.
Mid-conversation, a real squirrel unexpectedly jumped into the scene, and Aristotle reacted naturally to something completely unplanned.
Aristotle is available in Simulon right now. Go talk to him.
1/3 👇
Steve Jobs has always been a huge inspiration to me.
In 1985, he imagined a future where we could ask Aristotle a question and get an answer.
What fascinates me most is that he wasn’t just imagining access to knowledge, but the ability to interact with the mind behind it.
41 years later, we’re exploring what it means to take that idea even further with @Simulon.
We’re about to share a glimpse into that future.
A few of you noticed a sync difference between our @Simulon reality-aware rendering demo and the original footage.
That comes down to the mode we used.
Interaction Mode favors simulated physical contact over sync accuracy. This demo uses Precision Mode, releasing this week, for tighter sync when you need it.
A virtual mouse adds sugar to a real glass of water. I stir it with a virtual spoon. The rendered water responds to both of us while staying closely synced to the original footage.
Just like the previous demo, no prompting was used. The interactions were generated through spatial reasoning.
We’re still scratching the surface. We’ve got some exciting stuff to share this week 👀
A little Halloween treat from @Simulon. 🎃
We’re giving everyone 500 free credits to bring something impossible to life.
That includes all existing creators and anyone who signs up this weekend.
We’ve also added a collection of Halloween creatures and characters ready to bring into your world. 👻
Credits are valid through Sunday, November 1.
Happy Halloween!
Ok @Simulon… that’s just crazy. The shadows!!! It understands that there are multiple light sources, casting multiple shadows, and it matches the other shadows in the room.
In @Simulon, you can turn any image into a 3D neural asset and bring it into the real world.
Dracula started as a single image. A minute later, he’s riding a real RC car across my dining table, with his cape swinging through the turns. When the car goes over the edge, he jumps off the car and stays on the table.
All of this happens procedurally, with no prompting. He responds to the space and what’s happening around him. The inset shows the original footage.
What would you bring into the world? Drop an image in the replies and tell me what you’d like to see it do. I’ll pick a few and bring your ideas to life.
Took my baby dragon out for shopping @Decathlon
He loved his time over there.
Made with the new @Simulon Reality aware rendering which is out on IOS now.
Android release very soon.
This morning I cloned Dune with @Simulon. Naturally and obviously, the next step was turning him into a kaiju and filming him in the city using reality-aware rendering.