Description
Solar Pro Preview Instruct is a cutting-edge large language model (LLM) developed to fit into a single GPU with 22 billion parameters. This model demonstrates exceptional performance, surpassing models with less than 30 billion parameters and competing with those over three times its size, such as Llama 3.1 with 70 billion parameters. The model is built using an enhanced version of the depth up-scaling method, scaling a Phi-3-medium model from 14 billion to 22 billion parameters, optimized for a GPU with 80GB of VRAM.
Read More
The training strategy and dataset for Solar Pro Preview have been meticulously curated, resulting in significant performance improvements over the Phi-3-medium model, especially on benchmarks like MMLU-Pro and IFEval, which assess a model's knowledge and instruction-following capabilities. Although this is a pre-release version, it already stands out for its efficiency and capability, with plans for the official Solar Pro release in November 2024, which will include expanded language support and longer context windows.
Solar Pro Preview is specifically designed for instruction-following tasks and conversational engagements, utilizing the ChatML template for optimal performance. This model is available as an API in the Upstage Console, providing various methods for integration. Despite its current limitations in language coverage and context length, Solar Pro Preview is poised for further development and enhancement.
- CategoryAI Models & LLMs
- DeploymentCloud
- PlatformsWeb
Solar Pro Preview Instruct Highlights
22 billion parameters
Single GPU compatibility
Superior performance to models under 30B parameters
Comparable to models over 70B parameters
Enhanced depth up-scaling method
Optimized for 80GB VRAM
Instruction-tuned for conversational tasks
Available as API in Upstage Console
Getting Started with Solar Pro Preview Instruct
Access page: Visit Hugging Face model page
Load model: Use provided inference code
Configure environment: Set up GPU with 80GB VRAM
Integrate: Use API in Upstage Console
Fine-tune: Apply ChatML template for tasks
Solar Pro Preview Instruct's Use Cases
- Conversational AI
- Instruction Following
- Benchmark Testing
- API Integration
- Language Model Research
