←
Arno Solin800 posts
Arno Solin avatar

Arno Solin

@arnosolin

Associate Professor in Machine Learning @AaltoUniversity. Enjoying statistical machine learning. @ELLISforEurope Scholar. @yaf_fi

◷ Joined January 2014▧ 210 Photos and videos
Arno Solin avatar
Arno Solin@arnosolin·Oct 8

6/ Joint work with @bhrobson_, @SanteriMentu, and @wszhao_robot at ELLIS Institute Finland and Aalto University. Check out our paper, project page with interactive examples, and code: 📄 Preprint: arxiv.org/abs/2610.06226 💻 Project page: aaltoml.github.io/LeAVJEPA

Arno Solin avatar
Arno Solin@arnosolin·Oct 8

5/ In the video, audio-to-video attention follows the sound-producing objects, although the model received no localisation supervision. With attentive probes on frozen ViT-L features, we obtain 36.0 mAP on AudioSet-20K and 91.3% accuracy on ESC-50.

Arno Solin avatar
Arno Solin@arnosolin·Oct 8

4/ Embedding alignment brings the views together and LeJEPA's SIGReg regularizer prevents collapse. Pretraining needs no EMA teacher, separate predictor, reconstruction decoder, or contrastive negatives.

Arno Solin avatar
Arno Solin@arnosolin·Oct 8

3/ The important detail is how we construct the views. When every view contains both modalities, matching them can be solved by relying on just one. Modality dropout makes that shortcut harder, and our controlled ablation shows a clear improvement in the learned features.

Arno Solin avatar
Arno Solin@arnosolin·Oct 8

🔥 #LeAVJEPA: A simple recipe for self-supervised learning from sound and vision 🔥 One shared encoder, trained without class labels. Dropping a modality makes audio & video learn a common representation. 🧵

0:43
Quentin Berthet avatar
⟳ Arno Solin retweeted
Quentin Berthet@qberthet·Sep 9

#AISTATS 2027 Call for Paper is out! This year's edition is taking place in Montreal on May 3-6th, 2027 🇨🇦 Aymeric Dieuleveut and I are chairing virtual.aistats.org/Conferen… New this year: AI review, and more! Abstract deadline: September 29, 2026 Paper deadline: October 6, 2026

Eric Malmi avatar
⟳ Arno Solin retweeted
Eric Malmi@ericmalmi·Sep 8

I had the privilege of sitting down with @kchonyc for our new AI podcast "And humanity created intelligence". we discussed the backstory behind the attention paper as well as... 🧵

Post attachment
Arno Solin avatar
Arno Solin@arnosolin·Sep 1

Links to the podcast: 🎧 Spotify: open.spotify.com/show/033LOU… 🎧 Apple Podcasts: podcasts.apple.com/us/podcas… 🎧 YouTube: youtube.com/watch?v=nx0CeYeL…

Arno Solin avatar
Arno Solin@arnosolin·Sep 1

We also talk about the early days of OpenAI, RLHF, and the ideas behind ChatGPT, immediate vs. catastrophic AI risks, AI consciousness and model welfare -- and, of course, p(doom). 4/n

Arno Solin avatar
Arno Solin@arnosolin·Sep 1

The discussion around OpenAI's agents escaping their sandbox is still very much ongoing and gets right to the heart of something we discuss in the episode: when does AI safety stop being about hypothetical future scenarios and become an issue we are dealing with today? 3/n

Arno Solin avatar
Arno Solin@arnosolin·Sep 1

Our guest is Katarina Slama, a former #OpenAI researcher who worked on language-model alignment and co-authored the influential #InstructGPT paper. Today, she works independently on AI safety. 2/n

Arno Solin avatar
Arno Solin@arnosolin·Sep 1

🎙️Katarina Slama, ex-OpenAI, discusses AI alignment and risks in our new episode of "And Humanity Created Intelligence" -- and, for the first time, this one is in English. 1/n

0:39