--- title: "Africa Creates Compact LLM Morena, Outperforming Google and Meta✴ Models" description: "African company Vambo AI has developed the 1.5-billion-parameter Morena language model, outperforming larger rivals from Google and Meta✴ in local language tasks." date: 2026-09-25T15:45:53.000Z lang: en url: https://xab.info/en/posts/africa-creates-compact-llm-morena tags: [ai, llm, vambo-ai, morena, google, meta, nlp] publisher: "XAB.info" --- # Africa Creates Compact LLM Morena, Outperforming Google and Meta✴ Models ![Morena language model by Vambo AI supporting African languages](https://xab.info/media/2026/09/25/afrike-sozdali-kompaktnuyu-llm-morena/afrike-sozdali-kompaktnuyu-llm-morena-1.webp) ## 🎯 Key Points - The Morena model supports 12 African languages, English, and French. - The model size is 1.5 billion parameters, making it 8 times more compact than alternatives. - Computing resource costs for Nvidia A100 accelerators amounted to about $40,000. African company Vambo AI has introduced the Morena language model with 1.5 billion parameters. It supports 12 African languages, English, French, and can write computer code. In tasks related to African languages, this model, according to the developer, outperforms systems from Google, Meta✴, and Alibaba, while remaining eight times more compact in size than analogues. ### Background and Architectural Features At a key testing stage, Vambo AI Morena showed a result of 1.408 bpb (bits per byte), which was the best among 26 tested models. The closest to it, 1.423 bpb, was shown by a model five times larger — the lower the metric, the better. The model supports the following local languages: Nigerian Pidgin, Igbo, Yoruba, Hausa, Swahili, Shona, Zulu, Xhosa, Kinyarwanda, Tswana, Afrikaans, and Southern Ndebele. Most projects working with these languages use fine-tuned open Meta✴ Llama models, but they retain a vocabulary originally designed for English and programming code. ### Technological Breakthrough in Tokenization Vambo AI took a different approach: before training, they optimized the tokenizer, the composition of training data, and the list of languages, having previously compared vocabulary sizes in terms of cost and efficiency. When encoding African texts, the Morena dictionary uses 1.39 times fewer tokens than Google Gemma 3 and 1.53 times fewer than Llama 3.2, compared on identical fragments. Encoding costs for African text amount to 0.249 tokens per byte versus 0.234 for English — a 6% difference that developers cannot yet explain. The closest competitor is the Africa-adapted version of Meta✴'s model called Lugha-Llama-8B — it showed 1.423 bpb, supporting only 8 instead of 12 languages. For comparison, the 12-billion-parameter Gemma model consumes about 11 times more computational resources than Morena. ### Instruct Version Efficiency and Development Costs Morena optimized for conversational interaction (the instruct version) demonstrates a metric of 1.441 bpb, trailing Lugha-Llama-8B overall, but outperforming it on five shared languages while using only 20% of its parameters. When translating texts from English into five African languages, the instruct version shows 45.8 on the chrF++ metric, which is statistically comparable to specialized translation systems — their result is about 1.4 points higher, while models comparable in size to Morena usually show from 9 to 14 points. During pre-training, Morena processed 251.7 billion tokens, plus another 63 billion during intermediate training. ### Model Lineup and Availability The development required over 22,000 hours of Nvidia A100 accelerator operation — computational resources cost about $40,000. In addition to the main 1.5-billion-parameter model, 0.5-billion and 0.2-billion versions are available. The 0.5-billion parameter variant still outperformed all tested models from other developers across 11 out of 12 languages. The most compact 0.2-billion parameter version is designed for re-evaluating options in speech recognition systems, keyboard applications, and text normalization tasks. The latter costs 58 times less than Lugha-Llama-8B per byte, and when running on a single Nvidia A100 accelerator, it generates 104 tokens per second. A version capable of running on a CPU and locally on a laptop is also available. Vambo AI Morena supports chatbot applications, translation features, and integration with other AI tools. ## 🔍 Fact-Check Verification - [В Африке создали компактную LLM, которая обошла более крупные модели Google и Meta✴ — Morena знает 12 местных языков window-new](https://3dnews.ru/1148979/v-afrike-sozdali-kompaktnuyu-llm-kotoraya-oboshla-bolee-krupnie-modeli-google-i-meta-morena-znaet-12-mestnih-yazikov) - Подробные технические характеристики, параметры bpb и детали токенизации. - [В Африке разработали ИИ-модель с 1,5 млрд параметрами: она превзошла решения от Google и Alibaba](https://overclockers.ru/blog/Nacvark/show/264834/V-Afrike-razrabotali-II-model-s-1-5-mlrd-parametrami-ona-prevzoshla-resheniya-ot-Google-i-Alibaba) - Информация о превосходстве над крупными моделями и архитектуре. - [Africa Built Its Own AI from Scratch: The MORENA AI Model Outperformed Google, Meta, and Alibaba](https://root-nation.com/en/news-en/it-news-en/en-africa-morena-ai-model/) - Международное освещение запуска модели Vambo AI. - [A homegrown African AI model is beating bigger rivals](https://www.msn.com/en-gb/news/other/a-homegrown-african-ai-model-is-beating-bigger-rivals/ar-AA2cQSuQ) - Контекст создания независимого африканского ИИ. ## ❓ FAQ ### Q: How many languages does the Morena model support? **A:** The model supports 12 African languages, as well as English and French. ### Q: What are the main advantages of Morena over Google and Meta✴ models? **A:** Morena demonstrates higher efficiency (better bpb metrics) at a significantly smaller size with a vocabulary optimized for African languages.