←
Dominik Lukes17,565 posts
Dominik Lukes avatar

Dominik Lukes

@techczech

Exploring schemas and propositions about language models of all kinds on schemasandpropositions.subst… and on grepandgrok.fyi.

◷ Joined April 2009▧ 2,069 Photos and videos
Dominik Lukes avatar
Dominik Lukes@techczech·Oct 19

10 Things that are not really* a concern for AI in 2026: 1 Hallucination 2 Training on your data 3 Bias in models 4 Dependence on proprietary models 5 Running out of pre-training data 6 Jail breaking 7 Model collapse 8 Sycophancy 9 Knowledge cut off dates 10 Models trained "on the Internet" *Not that they don't exist or may never cause problems but because they are not a systemic concern worth worrying about.

Dominik Lukes avatar
Dominik Lukes@techczech·31m

"I don't think most people will really generate their own software" Most people don't use the software they have. They don't know what it is or what it does and can't think of any features they want or the UI/UX that works for them. They will not make their own software because they cannot even articulate what they want. But we will eventually get to a place where the models are good enough and fast enough to make it as they are using it.

this is one of those reasons why I don't think most people will really generate their own software good software is a set of strong opinions and I'd rather have something that's been really thought through by someone else

Dominik Lukes avatar
Dominik Lukes@techczech·36m

Using AI makes it easier to find out what you do want: "making your own software is tough, even with AI, because it's hard to know what you really want"

making your own software is tough, even with AI, because it's hard to know what you really want I didn't end up sticking with this, the modes weren't the right way for me to organize my work gonna a different take that’s more to-do oriented

Dominik Lukes avatar
Dominik Lukes@techczech·12h

Worrying: "OpenAI has maintained pace with capability, at the cost of coherency and readability."

Thought more about this. Anthropic’s lead started with Fable 5. It was the first true “next gen” model. I honestly think most of yall missed just how far ahead Fable was at launch. Understandable tbh. It required you to use the model entirely differently. It was prohibitively expensive. It got taken from us after just 3 days of usage. It had no ZDR policy, so you couldn’t even use it at work in most places 🙃 The result: most people perceived the gap between Fable 5 and GPT-5.6 Sol to be small. IMO, it was massive. GPT-6 Astra mostly caught up on raw capability for short term tasks, but it was unable to stay coherent for long runs. Meanwhile, Opus and Fable keep getting easier to work with and more coherent on long runs, while also gaining in capability. Opus 5.5 brought the Fable wins to everyone, by making it way cheaper, more generous on sub limits, and also great for enterprise (zdr!) OpenAI has maintained pace with capability, at the cost of coherency and readability. Tl;dr - Anthropic has been ahead since Fable 5. OpenAI’s attempts to catch up on benches have hurt the model pretty much everywhere else

Dominik Lukes avatar
Dominik Lukes@techczech·13h

Listen to this please: "Rather than a sprawl of specialized subagents built by different teams, you often get better & cheaper results using one agent to do it all."

This by Anthropic seems both right & a condemnation of many “agentic solutions” & harnesses being built at companies. Rather than a sprawl of specialized subagents built by different teams, you often get better & cheaper results using one agent to do it all claude.com/resources/article…

Post attachmentPost attachment
Dominik Lukes avatar
Dominik Lukes@techczech·Nov 17

I've started a new site called research snacks where I will publish quick research results that I was able to do quickly with AI agents that helped me find something out and may be useful to others. First edition takes issue with @emollick's claim that "2026 is similar to 1957 in a way that 1969 was not from 1900." - at least on the employment front.

So, I was wondering how wrong this claim was and ran a quick research snack on it and it turns out it's wrong in two ways: 1. Trivial wrongness: many more jobs essentially disappeared since 1950s 2. Fundamental wrongness: The change in the employment landscape has been very tumltuous rather than stable - not just because previously unimaginable jobs appeared but also because some of those jobs have appeared and disappeared in the meantime - so I would say that the pictures accopanying the tweet are actually incongruous with the reality of the change researchsnacks.semanticmachi…

Dominik Lukes avatar
Dominik Lukes@techczech·Nov 16

"You're asking everyone else to pay more, wait longer and get less so that nothing has to change for you." Just pay them off.

If your argument against AI is "but what about my job," you're not making an argument against AI. You're asking everyone else to pay more, wait longer and get less so that nothing has to change for you. Cheaper medicine, cheaper legal help, cheaper education, cheaper software. All of it on hold, for billions of people, to protect your routine. Every profession that technology replaced made the same request. None of them got it. And every one of us is better off because they didn't.

Mike Allton | The AI Hat avatar
⟳ Dominik Lukes retweeted
Mike Allton | The AI Hat@mike_allton·Nov 16

Stop thinking about AI like a tool like Microsoft Word and start thinking about it more like an actual assistant. It's not to replace you. It's to replace the stuff you've been doing for years that was never on your job description.

Dominik Lukes avatar
Dominik Lukes@techczech·Nov 16

" 'AI can't create anything new. It just remixes what already exists.' So do you." I can't believe the so called humanists remixing the cliché of human originality cannot see this as obviously true.

"AI can't create anything new. It just remixes what already exists." So do you. Every musician you love learned by playing other people's songs. Every writer read a thousand books before writing one. Every startup is two old ideas stuck together with a new name. Nobody has ever created something from nothing. We take what exists, combine it in a way nobody tried yet, and call it original. That's what creativity is. It always has been. The only new part is that a machine can do it now. And that's the part people can't stand.

Dominik Lukes avatar
Dominik Lukes@techczech·Nov 15

"most PhDs have struck me as far less curious than the average plumber"

I don’t have a PhD. I am not an academic, but I do live in the world of academia, so I am profoundly and painfully aware of my lack of credentials. So I try to just ask a bunch of questions and see what I can learn, But I have been shocked that most PhDs have struck me as far less curious than the average plumber. Many don’t ask questions and they don’t tend to be very curious, and they tend to be more condescending. This seems like a problem. Am I crazy?

Dominik Lukes avatar
Dominik Lukes@techczech·Nov 15

My no slop manifesto: 1 Make software that works 2 Make software that is fast 3 Make software that meets the needs of at least one user 4 Fix 1, 2 or 3 as soon as you notice a problem. How you achieve those things doesn't matter.

The No Slop [in software] Manifesto is fantastic. slopmanifesto.com/

Post attachment
Dominik Lukes avatar
Dominik Lukes@techczech·Nov 15

"It's surprising how quickly people want to overlook some pretty serious ethical questions because of what someone has achieved." Why?

This has been a pretty eye-opening week for me. Not so much because of the revelations about certain people in tech and business but the reactions to them. It's surprising how quickly people want to overlook some pretty serious ethical questions because of what someone has achieved. I'm a naturally optimistic person, but I increasingly feel the US has lost its way. And I don't think this is a left or right issue. We've become so obsessed with individual success that moral responsibility seems to have become optional.. and we're trying hard (with some success) at exporting this thinking abroad. Individualism is one of America's greatest strengths, but somewhere along the way we've confused personal freedom with freedom from responsibility to others. I don't think a society can flourish for long when success becomes an excuse for anything. Maybe there's something more fundamentally positive at play here than I understand, but I recently read Simon Blackburn's Think and this part felt particularly relevant: "A society in which people were incapable of recognizing the others as having a complaint, whatever they do, would be one without an ethic -- but for that very reason it would be hard to recognize it as a society at all."