←
Vambo AI262 posts
Vambo AI avatar

Vambo AI

@VamboAI

Multilingual Intelligence in Languages We Know, Love & Understand

◷ Joined May 2023▧ 69 Photos and videos
Vambo AI avatar
Vambo AI@VamboAI·15 Dec 2025

We are releasing something important with full transparency 🧵 Fikira Dataset by @VamboAI : a synthetic reasoning dataset for 10 African languages. Version 1.0 is available now: 🔗 huggingface.co/datasets/vamb… Here is why we are doing this and what we need from you:

Post attachment
Randy Bravewiseman avatar
⟳ Vambo AI retweeted
Randy Bravewiseman@bravewiseman·Sep 18

Most African LLMs are Western models with a sprinkle of Swahili. Vambo AI just released MORENA: a 1.5B model trained from scratch for 12 African languages. Not a fine-tune. Open weights. Commercial use allowed. It beats models from Google, Meta, Alibaba and Hugging Face on African language modelling and translation while being up to 8× smaller. Training compute: about $40k of GPUs. Shona, Swahili, Hausa, Yoruba, Igbo, isiZulu, isiXhosa, Kinyarwanda, Setswana, Afrikaans, isiNdebele, Nigerian Pidgin. This is the part people keep saying Africa “can’t do.” Weights: huggingface.co/collections/v… Announced by @thisisisheanesu / @VamboAI

$40,000 worth of GPUs 𝗧𝗵𝗶𝘀 𝗶𝘀 𝗠𝗢𝗥𝗘𝗡𝗔: the largest African language model ever trained from scratch, at 1.5 billion parameters. Not a fine tune, this was trained from the ground up for Africa. 🌍 Trained on 12 African languages, it beats models from Google, Meta, Alibaba and HuggingFace on African language modelling and translation while being up to 8x smaller. 𝗠𝗢𝗥𝗘𝗡𝗔 doesn't belong to us. The weights are open and free to use commercially, so researchers can build on a base that doesn't treat African languages as an afterthought. Weights in the comments. Thanks to @UNDP, @AIHub4SD and CINECA for the GPUs and the support. None of this happens without them.

Post attachment
Vambo AI avatar
Vambo AI@VamboAI·Sep 18

We are proud to release 𝗠𝗢𝗥𝗘𝗡𝗔 today and contribute another foundation for building AI that understands and works with African languages. African languages deserve world class AI. Welcome to 𝗠𝗢𝗥𝗘𝗡𝗔. 👑🌍

Vambo AI avatar
Vambo AI@VamboAI·Sep 18

But is about more than the numbers. Most African language models begin by adapting an existing large language model. 𝗠𝗢𝗥𝗘𝗡𝗔 starts from scratch, with its tokenizer, mixture and target languages designed specifically around African languages from the outset.

Vambo AI avatar
Vambo AI@VamboAI·Sep 18

Behind the model: • 1.5B parameters • 12 African languages: ChiShona, Kiswahili, Hausa, Yorùbá, Igbo, isiZulu, isiXhosa, Kinyarwanda, Setswana, Afrikaans, isiNdebele and Nigerian Pidgin • 251.7B tokens of pretraining and 63B tokens of mid-training • 22,000+ A100 GPU hours

Vambo AI avatar
Vambo AI@VamboAI·Sep 18

𝗠𝗢𝗥𝗘𝗡𝗔 achieves 45.8 chrF++ when translating English into five African languages, comparable to dedicated translation models.

Post attachment
Vambo AI avatar
Vambo AI@VamboAI·Sep 18

On held-out African language text, 𝗠𝗢𝗥𝗘𝗡𝗔 achieves the lowest bits per byte of all 26 models measured, including an 8B African specialist and a 12B general purpose model. 𝗠𝗢𝗥𝗘𝗡𝗔 1.5B base: 1.408 bpb 𝗠𝗢𝗥𝗘𝗡𝗔 1.5B instruct: 1.441 bpb

Post attachment
Vambo AI avatar
Vambo AI@VamboAI·Sep 18

🚨 Introducing 𝗠𝗢𝗥𝗘𝗡𝗔 Today, we are releasing 𝗠𝗢𝗥𝗘𝗡𝗔, a new multilingual AI model built for African languages. 𝗠𝗢𝗥𝗘𝗡𝗔 is a 1.5 billion parameter language model trained from scratch for 12 African languages, with its own tokenizer designed for Africa.

$40,000 worth of GPUs 𝗧𝗵𝗶𝘀 𝗶𝘀 𝗠𝗢𝗥𝗘𝗡𝗔: the largest African language model ever trained from scratch, at 1.5 billion parameters. Not a fine tune, this was trained from the ground up for Africa. 🌍 Trained on 12 African languages, it beats models from Google, Meta, Alibaba and HuggingFace on African language modelling and translation while being up to 8x smaller. 𝗠𝗢𝗥𝗘𝗡𝗔 doesn't belong to us. The weights are open and free to use commercially, so researchers can build on a base that doesn't treat African languages as an afterthought. Weights in the comments. Thanks to @UNDP, @AIHub4SD and CINECA for the GPUs and the support. None of this happens without them.

Post attachment
Chido 🌍 avatar
⟳ Vambo AI retweeted
Chido 🌍@chidodzino·Apr 22

@VamboAI got in!🌟 The amount of hard work and sacrifice that has happened between this picture from 2023 and this @GoogleStartups milestone deserves its own book. Here’s to getting in! And after the 5th attempt because we keep trying until it works out🔥 I am so grateful.

Post attachment
Vambo AI avatar
Vambo AI@VamboAI·Mar 9

@VamboAI has been building localised infrastructure for Africa with a focus on African languages. We are grateful to see our work featured in a @StanfordGSB case study on AI adoption in developing economies alongside ventures from across the world 🌍 gsb.stanford.edu/faculty-res…

QhalaHQ avatar
⟳ Vambo AI retweeted
QhalaHQ@QhalaHQ·Feb 13

Here are some more innovators shaping Africa’s AI future at #AfricaAIVillage Expo – India AI Impact Summit. From Nigeria 1. Udu Technologies – A trusted AI partner helping governments and enterprises turn their AI ambitions into reality. 2. mDoc – A digital healthcare pioneer connecting patients and providers through remote care and monitoring solutions. 3. @equalyz_ai – Democratizing AI for Africa’s diverse language communities by building inclusive AI tools tailored to local contexts. From South Africa 1. @OptimusRobotics – Building next-generation robotics solutions powered by advanced AI technologies. 2. UmkhoAI AI – Driving African self-reliance through AI solutions that empower governments to better serve their people. 3. @VamboAI | Multilingual Intelligence – Enabling users to access powerful AI tools in their native African languages. From Zimbabwe 1. Justtrade365 – An AI-powered platform simplifying trade by connecting businesses to market insights, compliance support, logistics, and finance solutions. From Zambia 1. @agripredict – Using satellite data and AI to give farmers real-time advice on weather, soil, crops, and market prices — accessible even on basic mobile phones. From healthcare to agriculture, robotics to trade, African innovators are building AI solutions designed for real-world impact across the continent. #AIVillageInIndia #IndiaAIImpactSummit #SouthSouthCooperation #AIinAfrica #GlobalMajority #ResponsibleAI #DigitalInfrastructure

Post attachment
Chido 🌍 avatar
⟳ Vambo AI retweeted
Chido 🌍@chidodzino·17 Dec 2025

400+ downloads in 48 hours 🎉 Fikira Dataset by @VamboAI is reaching researchers and developers building African language AI. For those just hearing about it: → Reasoning data for 10 African languages → 50,000+ examples → Open source, free to use 🔗huggingface.co/datasets/vamb…

Vambo AI@VamboAI15 Dec 2025

We are releasing something important with full transparency 🧵 Fikira Dataset by @VamboAI : a synthetic reasoning dataset for 10 African languages. Version 1.0 is available now: 🔗 huggingface.co/datasets/vamb… Here is why we are doing this and what we need from you:

Post attachment
Isheanesu Misi avatar
⟳ Vambo AI retweeted
Isheanesu Misi@thisisisheanesu·17 Dec 2025

400 downloads in two days 🎉 The research community has spoken, I'm working on 2.0 and hope to get more languages, more examples, and human validators. Feedback is always appreciated 🤠

Vambo AI@VamboAI15 Dec 2025

We are releasing something important with full transparency 🧵 Fikira Dataset by @VamboAI : a synthetic reasoning dataset for 10 African languages. Version 1.0 is available now: 🔗 huggingface.co/datasets/vamb… Here is why we are doing this and what we need from you:

Post attachment