←
Sebastian Schmon380 posts
Sebastian Schmon avatar

Sebastian Schmon

@SeBayesian

Machine Learning @Latent_Labs, anything from classical statistics to modern machine learning and generative AI, previous @altos_labs

◷ Joined June 2020▧ 30 Photos and videos
Sebastian Schmon avatar
Sebastian Schmon@SeBayesian·5h

This weirdly assumes that people would simply accept such a society?

Anthropic Researcher Tao Lin: Pretty much all humans on earth will become permanently unemployable because of AI "It's very likely that pretty much all humans on earth will become permanently unemployable" "And will need to strictly rely on government welfare to sustain themselves" "Human employment will go away."

0:16
James Whittington avatar
⟳ Sebastian Schmon retweeted
James Whittington@jcrwhittington·Aug 12

We’re excited to announce DiG-bench, a new benchmark for discovery! Over the last few weeks we’ve been testing frontier AI models on our novel discovery games and seeing how they score. Each game is a text-based environment, so they probe discovery capabilities in the natural domain of language models, rather than requiring additional, potentially confounding, visual understanding. TL;DR frontier models have improved a lot over the last few months. But they are still stumped by some surprisingly simple problems, even in their native text domain. With @cocosci_lab (@Princeton) @MITCoCoSci (@MIT) @SchmidhuberAI (@KAUST_News) @misovalko (@Inria) @tri_dao (@PrincetonCS) @RMBattleday @zebkDotCom @FraserGreenlee @akaijsa @ClareMaguire @TimMuller1 @kubicek_ales @physicscat0x7d @SukritSumant @thoughtchannel_ (1/5)

Post attachment
James Whittington avatar
⟳ Sebastian Schmon retweeted
James Whittington@jcrwhittington·Nov 2

Today we are happy to share one of our first open research releases: Latent Sparse Attention (LSA), a step towards subquadratic attention that matches accuracy of full attention at ultra-long context. Sparse attention attends to only a few tokens per query, but it has to find the right ones. At 10M tokens, that search takes 98% of the attention layer's time. LSA makes sparse attention up to 22.7× faster and full attention 72.4x faster. With @kubicek_ales @caciolai @PengLiangzu @SukritSumant @Ben_Hoov @FraserGreenlee @RMBattleday @radim_urban @thoefler @jcrwhittington

0:12
Sebastian Schmon avatar
Sebastian Schmon@SeBayesian·Oct 30

I cannot get over the fact that Max is not the maximum.

We’re renaming our Max plans: Max 5x → Max Max 20x → Ultra Max is still $100/month, and Ultra is still $200. If you’re a subscriber, there’s nothing you need to do. We’re also removing the 5-hour limit for verified Ultra accounts, starting today with most existing subscribers. Newer accounts keep a temporary limit until they’re verified, which helps us prevent fraud and abuse. You'll get an email when it's removed. Weekly limits remain unchanged. View our plans here: claude.com/pricing

Post attachment
Sebastian Schmon avatar
Sebastian Schmon@SeBayesian·Oct 21

The extent to which you can just do things now is staggering: I used AI to generate my own RTS, including the possibility to play against an agent by creating a machine readable gaming engine. I am still wrapping my head around how this will change industries.

0:52
Sebastian Schmon avatar
Sebastian Schmon@SeBayesian·Sep 29

One thing that @OpenAI could do with the massive compute is to brute force re-review every research papers, beginning with maths and physics and continue to stats and ML.

Sebastian Schmon avatar
Sebastian Schmon@SeBayesian·Sep 29

Claude has written me some of the best explanations on topics that were absolutely worth reading and there is a lot of human generated text on the internet that is factually wrong or at least badly written.

Sebastian Schmon avatar
Sebastian Schmon@SeBayesian·Sep 29

Unpopular(?) opinion: we don’t need classifiers to detect whether something is LLM generated or not, but rather whether it’s worth reading, i.e. we need to detect slop vs non-slop, not AI vs human. Those are very correlated but not identical.