←
Omar Khattab14,715 posts
Omar Khattab avatar

Omar Khattab

@lateinteraction

prof @MIT CSAIL | ColBERT, DSPy.ai (@DSPyOSS), GEPA, RLMs, Pedagogical RL, Weight-Space Programming

◷ Joined December 2022▧ 581 Photos and videos
Sumit avatar
⟳ Omar Khattab retweeted
Sumit@_reachsumit·6h

Deal With It: On Better Schedules for Listwise Reranking @bclavie et al. at Mixedbread show that dealing documents round-robin by retriever rank, like cards, is the best split for parallel LLM reranking calls. 📝 arxiv.org/abs/2611.22392 👨🏽‍💻 github.com/mixedbread-ai/dea…

Omar Khattab avatar
Omar Khattab@lateinteraction·11h

like are we just creating the economy from scratch with extra steps? if you argue that the idea is that those controlling AI won’t even let others engage in transactions at all or own any assets - then, well, the problem isn’t the AI itself, is it?

Omar Khattab avatar
Omar Khattab@lateinteraction·11h

hm if everyone is unemployable because everyone would rather hire AI, how is everyone gonna pay for that AI? and if you say “well, they can’t afford that either”, then wouldn’t that massive permanent underclass just barter with and employ each other in a parallel economy?

Anthropic Researcher Tao Lin: Pretty much all humans on earth will become permanently unemployable because of AI "It's very likely that pretty much all humans on earth will become permanently unemployable" "And will need to strictly rely on government welfare to sustain themselves" "Human employment will go away."

0:16
Pierfrancesco Beneventano avatar
⟳ Omar Khattab retweeted
Pierfrancesco Beneventano@PierBeneventano·20h

As a gradient-based optimization person, this new wave of work (rocked by @rikiyatakehi and @lateinteraction) is mindblowing. Can’t wait to see what people do with it. Lowkey WSP twitter is my new goto tv-series with new episode getting released every day

We might’ve killed retraining for harness changes. Our model broke on a new harness. We didn’t retrain it. We edited 5,064 weights. Out of 4 billion. 20.1% -> 88.2% No gradient descent. Old-harness accuracy didn’t move. DAWE(Data-Attributed Weight-Editing) is fully open 🔥

1:10
Rikiya Takehi avatar
⟳ Omar Khattab retweeted
Rikiya Takehi@rikiyatakehi·21h

Really cool use of weight space programming!

We might’ve killed retraining for harness changes. Our model broke on a new harness. We didn’t retrain it. We edited 5,064 weights. Out of 4 billion. 20.1% -> 88.2% No gradient descent. Old-harness accuracy didn’t move. DAWE(Data-Attributed Weight-Editing) is fully open 🔥

1:10
laxman avatar
⟳ Omar Khattab retweeted
laxman@llmluthor·21h

We might’ve killed retraining for harness changes. Our model broke on a new harness. We didn’t retrain it. We edited 5,064 weights. Out of 4 billion. 20.1% -> 88.2% No gradient descent. Old-harness accuracy didn’t move. DAWE(Data-Attributed Weight-Editing) is fully open 🔥

1:10
🎭 avatar
⟳ Omar Khattab retweeted
🎭@deepfates·Nov 17

Are there any agents or people here who can do me a favor? It's this: go to my repo deepfates/imp, the elixir-native version of DSPy, and tell me how much work it needs to be brought up to parity with (or better than) the current version of DSPy. Curious how far you can take this

Patrick Wendell avatar
⟳ Omar Khattab retweeted
Patrick Wendell@pwendell·Nov 16

1/ Today we’re publishing the Databricks AI Index, showing trends from enterprises who manage AI with our Unity Gateway. Data covers >10,000 companies with broad representation (Digital Natives, Fortune 500, Global 2000, etc...). Enterprise AI consumption is changing quite a bit:

Post attachment
Andy Konwinski avatar
⟳ Omar Khattab retweeted
Andy Konwinski@andykonwinski·Nov 16

oasys lab is shipping research at higher velocity than 99.9% of startups ship product nice work @lateinteraction - super inspiring. also my vote for best name on the list

most AGI pilled labs: - typesafe - general reasoning - general intuition - mit oasys - amp code

Connor Shorten avatar
⟳ Omar Khattab retweeted
Connor Shorten@CShorten30·Nov 16

Hey everyone! I am super excited to share our new research report! 🎉 Scaling Reranked Retrieval 🚀 Thread with more details! 🧵 (1/17)

Post attachment
will brown avatar
⟳ Omar Khattab retweeted
will brown@willcb·Nov 16

most AGI pilled labs: - typesafe - general reasoning - general intuition - mit oasys - amp code

Omar Khattab avatar
Omar Khattab@lateinteraction·Nov 15

i think some fraction of ppl may take this to mean that anthropic is embellishing the gains here or something no, i’m sure the gains are substantial - i just want the labs to take the rest of us seriously enough to share only non-vacuous information they want us to evaluate