Description
Self-Hosted AI Stack is an open-source platform designed for users who want to run AI models, chat, document processing, and voice tools on their own infrastructure. The platform is built using Docker Compose, allowing for easy deployment on local or cloud-based Linux servers. Users can choose to deploy a lightweight stack or customize their configuration to suit specific needs.
Read More
The stack supports running local AI models with InferCrate, powered by Ollama, and provides browser-based chat capabilities through AnythingLLM. Document parsing and retrieval are facilitated by ParseCrate and EmbedCrate, powered by Docling, enabling semantic search and reranking.
For audio processing, ScribeCrate offers transcription services, while SpeakCrate, powered by Kokoro, provides text-to-speech capabilities. The platform also includes GatewayCrate for routing model requests and UplinkCrate for connecting supported tools.
Security is a priority, with fresh deployments generating API keys and configuring password protection for AnythingLLM. The platform is MIT licensed, and while the software itself is free, users may incur costs for hardware, cloud hosting, or external providers.
Self-Hosted AI Stack is ideal for developers, system administrators, homelab users, and small teams seeking a private AI platform they can understand, secure, and operate with confidence. The platform's flexibility and focus on privacy make it a compelling choice for those looking to maintain control over their AI infrastructure.
- CategoryMachine Learning Platforms
- Pricing ModelOpen Source
- DeploymentDocker Compose
- PlatformsLinux
Self-Hosted AI Stack's Core Features
Open-source Docker Compose project
Run local AI models and chat
Document parsing and retrieval
Audio transcription and text-to-speech
Flexible deployment options
Optional NVIDIA GPU acceleration
MIT licensed
API keys and password protection
How to use Self-Hosted AI Stack?
Deploy: Set up Docker Compose on your server
Configure: Choose services and customize settings
Run: Start local models and tools
Secure: Implement API keys and password protection
Self-Hosted AI Stack's Use Cases
- Local AI Model Deployment
- Private Chat Applications
- Document Intelligence
- Voice Processing
- Custom AI Tool Integration
