Description
BgGPT-Gemma-2-27B-IT-v1.0 is a state-of-the-art Bulgarian language model created by INSAIT, part of Sofia University St. Kliment Ohridski. Built on Google's Gemma 2 27B models, it was pre-trained on approximately 100 billion tokens, with 85 billion in Bulgarian. This extensive pre-training, using the Branch-and-Merge strategy, enhances its cultural and linguistic capabilities in Bulgarian while maintaining English performance.
Read More
The model was instruction-fine-tuned using a Bulgarian instruction dataset derived from real-world conversations. It has been evaluated on various benchmarks, including Winogrande, Hellaswag, ARC Easy/Challenge, TriviaQA, GSM-8k, and MON exams, demonstrating superior performance in logical reasoning, mathematics, and language understanding.
BgGPT-Gemma-2-27B-IT-v1.0 outperforms larger models like Alibaba's Qwen 2.5 72B and Meta's Llama3.1 70B in Bulgarian tasks. It also excels in chat performance, surpassing smaller variants of commercial models such as Anthropic's Claude Haiku and OpenAI's GPT-4o-mini, and matches the best commercial models in Bulgarian chat performance.
The model is available for use with the 🤗 Transformers library and supports integration with vLLM and GGML/llama.cpp formats. It is distributed under the Gemma Terms of Use and welcomes community feedback to optimize its performance further.
- CategoryAI Models & LLMs
- Pricing ModelOpen source
- DeploymentCloud
- PlatformsWeb
BgGPT-Gemma-2-27B-IT-v1.0 Highlights
State-of-the-art Bulgarian language model
Based on Google's Gemma 2 27B
Pre-trained on 100 billion tokens
Instruction-fine-tuned with real-world conversations
Superior performance in Bulgarian tasks
Outperforms larger models
Supports integration with 🤗 Transformers
Distributed under Gemma Terms of Use
Getting Started with BgGPT-Gemma-2-27B-IT-v1.0
Access page: Visit Hugging Face model page
Load model: Use 🤗 Transformers library
Configure environment: Set recommended parameters
Integrate: Use with vLLM or GGML/llama.cpp
Fine-tune: Apply instruction format
BgGPT-Gemma-2-27B-IT-v1.0's Use Cases
- Language translation
- Cultural analysis
- Chat applications
- Educational tools
- Content creation







