←
Michael Waldman314 posts
Michael Waldman avatar

Michael Waldman

@Mwaldman

Working on bringing local AI to every phone and laptop. Previously @Meta

◷ Joined August 2026▧ 18 Photos and videos
Michael Waldman avatar
Michael Waldman@Mwaldman·Oct 4

Local AI caught up way faster than anyone realizes. Sharing my thoughts having spent time in ML at Meta and dedicating the last year to getting smart on local AI. 1/ Barely anyone, not even hardcore AI power users, realizes how fast local models have caught up to the frontier. Qwen3.8 woke a few people up, but the most technical people are so frontier-pilled they've blinded themselves to the breakneck progress. Meanwhile, normal users don't care about frontier intelligence at all. They want AI that gets the job done, but they have no idea what a local model is or how to run one. So local is stuck in a weird spot: the people who can run these models don't care to do so, and the people who'd benefit most don't know how to run local.

Loci avatar
⟳ Michael Waldman retweeted
Loci@askloci·1h

Another benefit of the shift to open/local that doesn’t get touted enough. Instead of jobs / capital concentrating to a couple hundred employees at closed labs, it will actually distribute to thousands of IT departments.

Recruiters take note: open then local AI will mean the return of the IT department. That will be millions of jobs created 👇🏽

Pratik Gandhi avatar
⟳ Michael Waldman retweeted
Pratik Gandhi@pratikg·4h

✅ BENCHMARKED: Qwen3.8-27B-pi-adapted 🤗 weights on my 64GB M5 Pro Mac mini. After merging the adapter there is no speed penalty! I also benchmarked Qwen3.8-27B Q8_0 (llama.cpp, thinking mode disabled) with and without the LoRA (median of 3): - Prompt processing speed (4K context): 380 (base) vs. 217 (LoRA) vs. 388 tok/s (merged) - Generation speed (4K context): 9.82 (base) vs. 9.42 (LoRA) vs. 9.97 tok/s (merged) - Time to first token (32K context): 105 (base) vs. 170 (LoRA) vs. 106 s (merged) The merged model (28.6 GB; 37.3 GB peak memory usage) fits entirely in the memory of my Mac mini and is on par with the base model in terms of inference speed. Without merging, applying the LoRA seems to come at a cost of ~40% in prompt processing speed. I also had the base and pi-adapted model solve 12 small Python-related tasks in the pi coding agent (2 times each): Both models solved 22/24 tasks, with the pi-adapted model having a slight edge in terms of solving time (313 s vs. 334 s avg. time per task). ~5.5 hours of results from overnight benchmarks, all on a single Mac mini! Fine-tune open models for your use-case, merge the adapters and enjoy full-speed inference on your desktop.

0:16

Introducing Qwen3.8-27B-pi-adapted 🤗 We adapted Qwen's model specifically for the pi coding agent using reinforcement learning and a LoRA adapter. The results, measured as pass@1: 🚀 SWE-bench Pro (Hard 51): 29.4% → 62.7% 💻 Terminal-Bench 2.1: 39.5% → 55.8% ⚡ 55–62% fewer tool calls per task This is the power of open models: you can adapt them to YOUR tools and YOUR use cases. Let’s build! 💛 Open weights: huggingface.co/harness-hub/Q… Methodology: huggingface.co/blog/harness-…

Post attachment
Michael Waldman avatar
Michael Waldman@Mwaldman·2h

Awesome release. The coolest part here is getting some huge gains was actually relatively inexpensive. Post training is orders of magnitude cheaper than pre training yet covers the needs almost any org beyond a lab would have

Introducing Qwen3.8-27B-pi-adapted 🤗 We adapted Qwen's model specifically for the pi coding agent using reinforcement learning and a LoRA adapter. The results, measured as pass@1: 🚀 SWE-bench Pro (Hard 51): 29.4% → 62.7% 💻 Terminal-Bench 2.1: 39.5% → 55.8% ⚡ 55–62% fewer tool calls per task This is the power of open models: you can adapt them to YOUR tools and YOUR use cases. Let’s build! 💛 Open weights: huggingface.co/harness-hub/Q… Methodology: huggingface.co/blog/harness-…

Post attachment
Michael Waldman avatar
Michael Waldman@Mwaldman·3h

got some wild DMs in response to this, so many finance people want an "AI guy" to inform their investments. I feel like an Instagram model right now with some offers to get flown out.

1/ A large hedge fund asked me in to talk about open and local models. The conversation made me realize institutional capital allocation will rapidly change over the next year. They're following the frontier closely, but wanted to discuss how open and local will affect how capital gets distributed across AI spend.

Michael Waldman avatar
Michael Waldman@Mwaldman·21h

Oh no the frontier isn’t frontier-ing

I will not be writing a full review of GPT-6.2 Astra / Sol. I had a terrible experience testing them. They were essentially unusable. I do not recommend these models.

Michael Waldman avatar
Michael Waldman@Mwaldman·22h

Reminder: only the creme de la creme frontier models are capable of summarizing your Amazon orders and subscription payments in your inbox. Next year: frontier models capable of checking your calendar.

Michael Waldman avatar
Michael Waldman@Mwaldman·22h

one of the first advertised use cases of Astra 6.2 is….. reading email 😭 OpenAI is so lost.

OpenAI@OpenAINov 17

Some of you have been asking very politely. Some of you have just been asking. GPT-6.2 Astra and Sol are now available. Super efficient and built to perform where it counts—the real world. openai.com/index/introducing…

1:59
Michael Waldman avatar
Michael Waldman@Mwaldman·23h

4/ this hedge fund is overall pretty ahead on AI - so I expect this new understanding washing over large AI capital allocators to continue spreading, and show up in how they're pricing closed labs. With some other capital allocators I've spoken with, I've been genuinely mind blown in how unread they are on how open models are progressing.

Michael Waldman avatar
Michael Waldman@Mwaldman·23h

3/ One example that landed: for some funds, trading decisions are not compute-bound, rather network bound, meaning the roundtrip time of packets is a dominant factor. This is where local models get really interesting for trading as they can answer quicker than any closed model, and that's a matter of physics, not a problem OpenAI can solve.

Michael Waldman avatar
Michael Waldman@Mwaldman·23h

2/ As we went over the immense progress in open weight models and how quickly they caught up, the question their analysts had quickly shifted to: "Once open (then local) is good enough for most work, how many buyers keep paying frontier prices?" That's the question Sam and Dario have to contend with. But the data is clear: more and more people are choosing open models.

Michael Waldman avatar
Michael Waldman@Mwaldman·23h

1/ A large hedge fund asked me in to talk about open and local models. The conversation made me realize institutional capital allocation will rapidly change over the next year. They're following the frontier closely, but wanted to discuss how open and local will affect how capital gets distributed across AI spend.

Jensen Huang avatar
⟳ Michael Waldman retweeted
Jensen Huang@JensenHuang·Nov 17

Over the past week, I’ve been overwhelmed by the love and support of friends, industry colleagues, and people I've never met. Thank you to everyone who has shown kindness to my family and me. It means the world to me. I came to the United States 53 years ago, and becoming an American citizen is one of the greatest gifts and proudest moments of my life. NVIDIA has been my life’s work. Building it into the company it is today alongside my colleagues has been a privilege and an honor. Nowhere but in America could a company like NVIDIA be possible. I love our country, and I love NVIDIA. I did not live up to the standards expected of everyone at NVIDIA, and I have made serious mistakes in my personal life. I created problems for the Board that I deeply regret. I own my mistakes completely, and I am committed to cooperating with the Board’s independent investigation. Since my departure, I’ve seen an outpouring of calls from NVIDIA’s employees, investors, business partners, and customers for me to return as CEO. Many continue to reach out to me directly as the company navigates complex technology, market, competitive, and geopolitical dynamics. NVIDIA is a once-in-a-generation company. If the Board of Directors decides that my return is in the best interest of our shareholders, our employees, the company, and America, I would be honored to answer these calls and return as CEO. Thank you again to everyone who has shared their good wishes. I am profoundly humbled by your support. To my family: I love you, and I will spend the rest of my life being worthy of yours. Jensen

Michael Waldman avatar
Michael Waldman@Mwaldman·Nov 17

"you have the ability to revoke access" God forbid Dario can't revoke people's access to intelligence. Protect his right to do so at all costs

Dario Amodei on open source models: “If the path continues, I think we could get to a very dangerous place.” “When you control a model and you're deploying it, you have the ability to monitor its usage.” “You can revoke a user's access. You can change what the model is willing to do.” “When a model is released in an uncontrolled manner, there's no ability to do that. It's entirely out of your hands.” “We should confront the advocates of this with that problem and challenge them to solve it.” He clearly doesn't believe Intelligence should be in the hand of the masses and Sam Altman also saying "RAM" shouldn't be accessible to everyone indefinitely agreed with him.

1:28
Michael Waldman avatar
Michael Waldman@Mwaldman·Nov 17

It's hilarious how many X "agencies" exist whose entire business model depends on price gouging VC backed founders. There's a reason most will ask "Have you raised yet" as their first question.

Michael Waldman avatar
Michael Waldman@Mwaldman·Nov 17

Events in the last few days have woken people up to the need to have AI that works even if the grid doesn’t. Loci is the easiest way to own your intelligence. Send it to your family so that they have AI that works offline.

Loci@asklociNov 17

Alex is right - everyone should have an offline AI for emergencies. Until recently, they have all crashed or recommended models that don’t work. That changes with Loci. Be prepared for the next time the grid isn’t working - download Loci.