Description
Hy3 is a sophisticated Mixture-of-Experts (MoE) model developed by the Tencent Hy Team, featuring 295 billion total parameters with 21 billion active parameters and 3.8 billion MTP layer parameters. Launched after the Hy3 Preview, the model has been refined with feedback from over 50 products and enhanced post-training with high-quality data. Hy3 outperforms similar-sized models and rivals flagship open-source models with 2-5 times more parameters.
Read More
The model demonstrates significant utility gains across various productivity tasks, including coding, office work, financial modeling, frontend design, and game development. It is a cost-effective option for those seeking reliable performance in these areas. Hy3's architecture includes 80 layers, one MTP layer, 64 attention heads, and a hidden size of 4096, supporting a context length of 256K and a vocabulary size of 120,832.
Hy3's performance is not fully captured by public benchmarks, so a blind evaluation with 270 experts was conducted, where it scored 2.67 out of 4, outperforming GLM-5.1. The model excels in frontend development, data & storage, and CI/CD tasks. Improvements in stability, knowledge retention, and multi-turn intent tracking have been made, reducing hallucination rates and commonsense errors significantly.
Hy3 is open-sourced, with model weights available on platforms like Hugging Face, ModelScope, GitCode, and CNB. It supports deployment with vLLM or SGLang and offers a comprehensive model finetuning pipeline. The model is released under the Apache License 2.0.
- CategoryAI Models & LLMs
- Pricing ModelOpen source
- DeploymentCloud
- PlatformsWeb
Hy3 Highlights
295B total parameters
Mixture-of-Experts architecture
21B active parameters
3.8B MTP layer parameters
80 layers excluding MTP
64 attention heads
Context length of 256K
Vocabulary size of 120,832
Open source
Fine-tuning support
Getting Started with Hy3
Access model page: Visit the Hy3 page on Hugging Face
Authenticate: Log in to your Hugging Face account
Configure: Set model parameters and preferences
Send prompts: Interact with the model using your input
Fine-tune: Adjust the model for specific tasks
Hy3's Use Cases
- Coding Assistance
- Office Automation
- Financial Modeling
- Frontend Design
- Game Development
