←
OpenEuroLLM29 posts
OpenEuroLLM avatar

OpenEuroLLM

@OpenEuroLLM

A series of foundation models for transparent AI in Europe

◷ Joined June 2024▧ 16 Photos and videos
OpenEuroLLM avatar
OpenEuroLLM@OpenEuroLLM·Oct 27

"Sovereign AI: Must We Own the Model to Own Our AI Future?" Tomorrow, 28th Oct. at #EMNLP26, represented by Andrey Kutuzov, we will be sharing the OpenEuroLLM perspective on sovereign AI at this very interesting panel within the @WiNLPWorkshop. Join the discussion at 11:00!

Post attachment
OpenEuroLLM avatar
OpenEuroLLM@OpenEuroLLM·Oct 27

Today at @emnlpmeeting, @maxidahl & @TiedemannJoerg & Andrey Kutuzov presented MultiSynt, a multilingual synthetic dataset to support low-resource EU languages on behalf of OpenEuroLLM and EuroLLM supported by the AI Factories initiative. 🫶🇪🇺 Just in case you missed our poster:

Post attachmentPost attachment
OpenEuroLLM avatar
OpenEuroLLM@OpenEuroLLM·Oct 27

Hello Budapest! We are at #EMNLP2026! If you're around, we'd be more than happy to chat about the interesting nuances of building open, multilingual foundation models. Say 👋 to the #OpenEuroLLM team!🇪🇺 📸 Anna, Amaru, Zihao, Jörg, Tomazs, Andrey, Jan, Max, Otto and Niclas

Post attachment
OpenEuroLLM avatar
OpenEuroLLM@OpenEuroLLM·Sep 1

A series of technical reports from our project, like the one just posted by our colleague @kleiaaro, will try to provide answers to the many questions that LLM training teams cope with around the globe. This one is about training recipes 👇

🚀 How do you choose the right LLM training recipe? We just released a tech report on the scaling-law pipeline of @OpenEuroLLM 🇪🇺, along with the corresponding checkpoints, data, and code. arxiv.org/abs/2608.28308 1/N 🧵

OpenEuroLLM avatar
OpenEuroLLM@OpenEuroLLM·Jul 28

Open models matter, we can't agree more! Open weights is surely a necessary step. The OpenEuroLLM project extends this view also to the data, training and evaluation aspects of current AI development. #transparentAI #openScience @HajicJan

For my first post, I’m sharing a letter @NVIDIA signed on why open models matter. AI will transform every industry, power every company, and be built by every country. Open models strengthen safety and cybersecurity, accelerate innovation and diffusion, and enable sovereignty. The world needs both frontier closed models and frontier open models. images.nvidia.com/pdf/Open-W…

Post attachmentPost attachmentPost attachment
OpenEuroLLM avatar
OpenEuroLLM@OpenEuroLLM·Jun 15

Input, more input 🤖⚡ Just like Jonny 5 in Short Circuit, our baby model is reading every single token from its pretraining dataset. So far: 10 trillion tokens, 36 languages + code & math as their own "languages" 📚🌍💻 We’re tracking progress & sharing it openly 👇 (1/2)

OpenEuroLLM avatar
OpenEuroLLM@OpenEuroLLM·Jun 11

Pretraining launched!🚀 Our 9B/10TT baby model is making its first steps in Leonardo (CINECA). 🐣 All people involved are eager to see the results of the effort it took to get here and share them. 👀 And advancing to push hard for the next cycle. 🦾 #goOpenEuroLLM

Post attachment
OpenEuroLLM avatar
OpenEuroLLM@OpenEuroLLM·Jun 9

Wrapping up our 3rd general meeting, hosted by @AISweden in sunny Stockholm ☀️ A full room makes the final decisions before training the first OpenEuroLLM model. Sharing updates, ideas, and future plans. Two more days of tight collaboration. Full speed mode. 🚀 #goOpenEuroLLM

Post attachment
OpenEuroLLM avatar
OpenEuroLLM@OpenEuroLLM·May 13

HPLT is of the datasets we are sharing in our world-readable catalogue across HPCs. Interesting talk!

We are at #LREC2026 presenting HPLT v3 Datasets, monolingual, parallel, massive, highly curated. For depth info and analysis, please: Join us in room Menorca 1 at 16:20!!!

Post attachment
OpenEuroLLM avatar
OpenEuroLLM@OpenEuroLLM·Apr 23

Also, today, know more about bechmark contamination impact goint to the poster of our colleagues from the unversities of Helsinki and Turku and the ELLIS Institute Finland.

Post attachment
OpenEuroLLM avatar
OpenEuroLLM@OpenEuroLLM·Apr 22

Quite a nice "representation" of the OpenEuroLLM crowd will be at the International Conference on Learning Representations (ICLR) this week. On Friday 24, come to poster "OpenThoughts: Data Recipes for Reasoning Models", work partially supported by our project, and meet us!👋

Post attachment
OpenEuroLLM avatar
OpenEuroLLM@OpenEuroLLM·Mar 17

Experimenting with model-based annotation for better data selection? A candidate to consider is propella-1, a multi-property annotator partially funded by #OpenEuroLLM which is fully open-source. 🔓Code, annotations and paper available! arxiv.org/pdf/2602.12414

We released propella-1, a small model for advanced pre-training data annotation 🙃. Work led by @maxidahl within the @OpenEuroLLM project. Link to model + annotations for important pre-training datasets below 👇