Description
YuE2-3B is a cutting-edge music generation model hosted on Hugging Face, designed to create high-quality songs from lyrics and style prompts. It competes with leading proprietary models like Suno v5 and v6, achieving state-of-the-art results on benchmarks such as WildSongBench. Users can generate complete songs with vocals and accompaniment, and further refine the output by editing melodies and chords through an editable score. The model supports various modes, including melody-only and full melody and chord planning, allowing for versatile music creation and editing.
Read More
YuE2-3B also offers agentic editing, where users can provide musical feedback to revise scores, styles, and lyrics, enabling a dynamic and interactive music creation process. The model runs locally on a 24GB GPU, producing 48 kHz stereo songs without quantization. It is built on a Mixture-of-Transformers backbone that writes scores and semantic tokens, generating acoustic latents through flow matching, which are then converted into stereo audio by a VAE.
The model supports integration with Hugging Face's APIs, allowing users to load the model, apply text guidance, and utilize separate planning and synthesis APIs. YuE2-3B's performance is optimized for speed, with a 3.6-minute song generated in just over a minute on an RTX 4090 GPU. The model's open-source nature and high-quality output make it an attractive choice for musicians, composers, and developers interested in AI-driven music generation.
- CategoryAI Models & LLMs
- Pricing ModelOpen source
- DeploymentRuns locally
- PlatformsWeb
YuE2-3B Highlights
Open music generation model
Editable score for melody and chords
Agentic editing capabilities
Runs locally on 24GB GPU
Mixture-of-Transformers backbone
Integration with Hugging Face APIs
Supports melody-only and full planning modes
High-quality stereo audio output
Getting Started with YuE2-3B
Access model: Visit Hugging Face
Authenticate: Set up account
Set up environment: Install dependencies
Integrate via API: Use Hugging Face APIs
Optimize: Adjust settings for best performance
YuE2-3B's Use Cases
- Music Composition
- Song Editing
- Agentic Editing
- Local Music Generation
- API Integration
