Description
Inkling is a general-purpose multimodal AI model developed by Thinking Machines Lab, Inc. It features a total of 975 billion parameters, with 41 billion active parameters, and is designed to accept text, image, and audio inputs, generating text outputs. The model is intended for use in English and other languages, making it versatile for various applications. Developers can utilize Inkling for building AI-powered applications, including agentic and tool-use systems, coding assistants, chatbots, and retrieval-augmented generation systems. Its design supports general-purpose conversational use, instruction-following, and other natural language and multimodal tasks. Inkling is released with open weights, allowing for research, fine-tuning, and integration into third-party products by downstream developers.
Read More
The architecture of Inkling is based on a 66-layer decoder-only transformer with a sparse Mixture-of-Experts (MoE) feed-forward backbone. Each token is routed to six of 256 experts, with two shared experts active on every token. The model is natively multimodal, encoding images via a hierarchical patch encoder and audio through discrete token encoding. All modalities are projected into a shared hidden space and processed jointly by the decoder. Inkling supports a context window of up to 1 million tokens, making it capable of handling extensive input data.
Inkling is available through API access via Tinker, the service for fine-tuning, and through third-party inference providers. The model's weights can be downloaded from Hugging Face. For optimal performance, specific hardware configurations are required, including GPU clusters with substantial VRAM. The model has undergone extensive safety evaluations to mitigate risks associated with multimodal interactions, ensuring that it does not present material uplift beyond existing open-weight models. However, users are advised to implement additional safeguards and human oversight when deploying Inkling in high-stakes contexts.
- CategoryAI Models & LLMs
- Pricing ModelOpen source
- DeploymentCloud
- PlatformsWeb
Inkling Model Card Highlights
Model Type: Multimodal autoregressive transformer
API Available: Yes
License: Apache 2.0
Parameters: 975B total, 41B active
Fine-tuning Support: Yes
Multimodal: Yes
Numerics Support: BF16, MXFP8, NVFP4
Context Window: 1M tokens
Getting Started with Inkling Model Card
Access model: Visit the Tinker service for API access.
Authenticate: Set up your account and obtain API keys.
Set up environment: Ensure your hardware meets the model's requirements.
Integrate via API: Use the provided documentation to integrate Inkling into your application.
Optimize: Fine-tune the model as needed for your specific use case.
Inkling Model Card's Use Cases
- Chatbots
- Coding Assistants
- Multimodal Applications
- Instruction-Following
- Retrieval-Augmented Generation
