←
Alex Booker7,196 posts
Alex Booker avatar

Alex Booker

@bookercodes

Observability and Evals @Mastra

◷ Joined July 2015▧ 950 Photos and videos
Joel Smith avatar
⟳ Alex Booker retweeted
Joel Smith@jsumnersmith·Nov 10

We're rolling out new pricing for the Mastra platform! We've updated our Free plan and added a $25 plan to make it easier and cheaper for everyone to get their agents live and into production. More details in the blog post: mastra.ai/blog/mastra-platfo…

3:19
Kristian Veter avatar
⟳ Alex Booker retweeted
Kristian Veter@kristianvtr·Nov 4

Every AI chat is built for one human So I put an AI in a group chat with 3 people. It knows who's away, who can't do Mondays, and who gets to make the call Multiplayer agents, built with @mastra 👇

7:00
Mastra avatar
⟳ Alex Booker retweeted
Mastra@mastra·Nov 2

Mastra observability now has interactive histograms. See patterns and find errors faster.

0:07
Alex Booker avatar
Alex Booker@bookercodes·Nov 2

What happens after you find an agent failure? On Thursday, we'll show you what should happen - turn failed traces into datasets, compare changes with experiments and scorers, and automate regression evals Join us as we build this eval loop live! luma.com/mastra-18cw?tk=PbCE…

Alex Booker avatar
Alex Booker@bookercodes·Nov 1

Why not? Send it to your factory. See what it comes up with. Go from there!

I'm now building an "improvements" feature into all of my personal vibecoded applications: a freeform text input that's hooked up to an agent that yolo implements whatever is submitted. It's an interesting experience -- the activation energy barrier to sanding any rough edge or implementing any new feature becomes extremely low. Someone else who uses one of the applications I created has already implemented 150 improvements over the course of a few days. This pattern feels like a new kind of tool -- liquid software? -- and every application that doesn't have this feature now has a slightly rigid and anachronistic flavor. Why can't I just tell it how I want it to be different? Now, it's not obvious to me how this pattern can or should scale. Does it become unmaintainable after a while? (Maybe model intelligence improvement outstrips my feature appetite such that it's fine?) How does collaborative software work in this model? Can software designed this way be secure and reliable? Whatever the larger questions about broader deployment, it definitely works great in a personal context. It reminds me a little of the visions of Lisp/Lisp machines, Smalltalk, and HyperCard -- systems that the user can take control of and modify. Those visions never quite worked, though: the vast majority of software today is not end-user modifiable in any useful way. So, while this "liquid" affordance is a very small touch, the way it changes one's relation to the software feels a bit transgressive and empowering in a Lickliderian and Engelbartian way.

Post attachment
Alex Booker avatar
Alex Booker@bookercodes·Nov 1

Been a rough month. Sorry to say it's going to get worse before it gets better. 😬

October in a nutshell: - PHP got hacked - Railway got hacked - OpenCode got hacked - Binance got hacked - Polymarket got hacked - GitHub Actions got hacked - SoftBank got hacked - Cursor marketplace got hacked - Coinbase vendor got hacked - Fireworks AI got hacked - LiteLLM got hacked - Capcom got hacked - npm packages got hacked - TiDB Cloud got hacked - Warp's vendor got hacked happy cybersecurity awareness month

Alex Booker avatar
Alex Booker@bookercodes·Nov 1

Fair play! This is one of the coolest little demos I've seen lately. Just spent half an hour poking around my favourite spots in London. Very charming.

introducing tiny.london/world after tiny.london & isometric.nyc went viral, dozens people did same maps for their cities. i put all of them in one place from tashkent to goiânia check how similar but different they are!

Post attachment
Alex Booker avatar
Alex Booker@bookercodes·Nov 1

Slack isn't going anywhere soon. The agent experience isn't great right now, and progress feels slow. But it's not enough to build a better mousetrap. Slack is too hard to leave. Your message history and connections live there, and the network effects are huge. If something does dethrone Slack, it'll be less distracting, help you deal with fewer messages less often, and feel agent native. If it happens, it'll take a while. And it'll come from a player that already has distribution - like Linear or Notion 😉

prediction: for the first time ever, slack will see major competition it will happen in the next few months by end of 2027, majority of modern silicon valley companies will be using something else

Mastra avatar
⟳ Alex Booker retweeted
Mastra@mastra·Oct 30

Every vector database has its own SDK, query syntax, and filter rules. Over the last six months we've added seven: same 𝚌𝚛𝚎𝚊𝚝𝚎𝙸𝚗𝚍𝚎𝚡, 𝚞𝚙𝚜𝚎𝚛𝚝, 𝚚𝚞𝚎𝚛𝚢, and 𝚏𝚒𝚕𝚝𝚎𝚛 on Weaviate, Couchbase, OpenSearch, Turbopuffer, etc Swap stores w/o rewriting your code:

0:59
Alex Booker avatar
Alex Booker@bookercodes·Oct 30

We're making the Mastra Observability dashboard best-in-class And everything in it works headless too So you can ask your coding agent to inspect traces and aggregates, and even fix things - potentially automatically 👀

1:21
Alex Booker avatar
Alex Booker@bookercodes·Oct 30

This is on my mind because we just added both to Mastra's Traces table We're adding it to dashboards (follow trends) and experiments next

Post attachment
Alex Booker avatar
Alex Booker@bookercodes·Oct 30

Two latency metrics every agent should track TTFT → how fast your model responds TTFC → how long your user actually waits Fast TTFT but slow TTFC? You probably introduced slow context injection or some other processor

Post attachment