Description
Kolibri 1, developed by Aleph Alpha, is a state-of-the-art multilingual large language model designed to handle complex tasks with precision and efficiency. It supports both German and English languages, making it versatile for a wide range of applications. The model is built on a Mixture-of-Experts architecture, featuring 78 billion total parameters and 3.46 billion active parameters per token. This architecture allows Kolibri 1 to excel in multi-step reasoning, retrieval-augmented generation, and agentic tool calling, making it suitable for coding and language assistance tasks.
Read More
Kolibri 1 is optimized for a context length of up to 1,048,576 tokens, although a recommended limit of 262,144 tokens is advised for serving efficiency. The model operates with bfloat16 precision and is best suited for environments requiring high reasoning capabilities. It is released under the Apache 2.0 license, ensuring open access and flexibility for developers and researchers.
The model's training involved a comprehensive dataset of 20 trillion tokens, with a focus on English and German web data, instruction and reasoning tasks, and code. The training process included a mid-training phase and a long-context adaptation stage, enhancing the model's ability to handle extended context windows. Kolibri 1 also incorporates advanced safety features, including mechanisms to decline harmful requests and protect personally identifiable information.
Kolibri 1 is designed for use in various industries, including legal, electronics, hardware, and aviation, providing robust retrieval-augmented question answering capabilities. The model's architecture supports efficient tool calling and terminal interactions, making it a valuable asset for software engineering and terminal environments. With its extensive capabilities and open-source availability, Kolibri 1 is a powerful tool for developers and researchers seeking to leverage advanced AI for complex language tasks.
- CategoryAI Models & LLMs
- Pricing ModelOpen source
- DeploymentCloud
- PlatformsWeb
Kolibri 1 Highlights
Mixture-of-Experts architecture
78 billion total parameters
3.46 billion active parameters per token
Supports German and English languages
Context length up to 1,048,576 tokens
bfloat16 precision
Apache 2.0 license
Optimized for multi-step reasoning
Getting Started with Kolibri 1
Access model page: Visit the Hugging Face website
Authenticate: Log in to your account
Configure: Set up the model parameters
Send prompts: Input your queries
Fine-tune: Adjust the model for specific tasks
Kolibri 1's Use Cases
- Multilingual Assistance
- Complex Reasoning
- Retrieval-Augmented Generation
- Coding Support
- Tool Calling









