Skip to main content
ToolPotion
AI Advisor
Submit a Tool (Free)

Granite Switch 4.1 30B

LLMsAI Models & LLMsOpen source · Web

Granite Switch 4.1 30B is a modular large language model (LLM) designed for diverse AI applications. It integrates a base model with multiple adapters and an encoder, enabling a single hosted endpoint to handle natural language responses, general and specialized decisions, and multilingual speech-to-text transcription. This model offers flexibility and comprehensive capabilities for developers.

Visit Website
Share
Granite Switch 4.1 30B screenshot
Granite Switch 4.1 30B screenshot

Granite Switch 4.1 30B is a sophisticated modular large language model (LLM) developed by IBM, available on Hugging Face. This model is engineered to provide a versatile solution for various AI tasks by composing a 30-billion parameter base model with specialized adapters and an embedded speech-to-text encoder. This architecture allows a single hosted endpoint to seamlessly transition between different functionalities, including generating natural language, making general and specialized decisions, and transcribing speech into text.

Read More

The core of Granite Switch 4.1 30B is the ibm-granite/granite-4.1-30b base model, which boasts a 128K context window. It is augmented by two primary adapters: a 'decision' aLoRA for general-purpose decision-making and a 'guardian-core' aLoRA for detecting safety risks such as harm, jailbreaking, profanity, violence, sexual content, social bias, and unethical behavior. These adapters are activated on demand using control tokens within the chat template, providing dynamic functionality.

A key feature of this model is its embedded speech-to-text capability, powered by ibm-granite/granite-speech-5.0-470m-turboctc. This encoder supports transcription in seven languages: English, French, German, Spanish, Portuguese, Italian, and Japanese, outputting punctuated and capitalized transcripts. This means that audio input can be processed directly on the same endpoint as chat and decision tasks, eliminating the need for a separate speech server.

Granite Switch 4.1 30B is licensed under Apache 2.0 and supports backends like HuggingFace Transformers and vLLM. It is designed for developers and organizations looking to integrate advanced language, decision, and speech processing into their applications. The model is also available in other configurations, including an 8B base version and complete Granite Libraries bundles. Ethical considerations emphasize the need for application-level safety testing and monitoring, as the embedded guardian-core adapter provides an additional layer of safety but is not a substitute for comprehensive deployment safeguards.

  • CategoryAI Models & LLMs
  • Pricing ModelOpen source
  • DeploymentCloud
  • PlatformsWeb

  • Modular LLM architecture with base model and adapters

  • 30 billion parameters for the base model

  • 128K token context window

  • Decision-making adapter (aLoRA) for general-purpose decisions

  • Guardian-core adapter (aLoRA) for safety risk detection

  • Embedded multilingual speech-to-text (ASR) encoder

  • Supports English, French, German, Spanish, Portuguese, Italian, Japanese for ASR

  • Automatic language detection for audio input

  • Single hosted endpoint for chat, decisions, and speech-to-text

  • Adapters activated on demand via control tokens

  • Compatible with HuggingFace Transformers and vLLM backends

  • Apache 2.0 License

  • KV cache normalization for adapters

  • No joint training of adapters, allowing independent development

  • Single checkpoint for HuggingFace and vLLM without conversion

  1. Access Model: Navigate to the ibm-granite/granite-switch-4.1-30b page on Hugging Face.

  2. Install Dependencies: Ensure Python (>=3.11, <3.14), granite-switch (>=0.1.1), PyTorch (>=2.11.0), and Transformers (>=5.16, <=5.17.0) are installed.

  3. Load Model: Use the HuggingFace Transformers library to load the model, specifying the desired revision if not the latest.

  4. Activate Adapters: Pass the adapter name (e.g., 'guardian-core', 'decision') to the chat template via `chat_template_kwargs` in your request.

  5. Process Audio Input: Set `asr_enabled: true` in `config.json` to enable speech-to-text transcription for audio inputs.

  6. Send Prompts: Construct prompts for text generation, decision-making, or speech transcription, utilizing the activated adapters.

  7. Interpret Outputs: For decision adapters, read calibrated probabilities over option labels; for guardian-core, parse the JSON verdict.

  • Multilingual Chatbots
  • Automated Decision Systems
  • Content Moderation
  • Speech Transcription Services
  • Intelligent Virtual Assistants
  • Language Understanding
  • AI-Powered Customer Support

Popular AI Tools Like Granite Switch 4.1 30B

Granite Switch 4.1 8B is a modular LLM that integrates a base model, multiple adapters, and an encoder to provide natural-language responses, decision-making, and speech-to-text…

AI Models & LLMs

Ranked #18 in LLMs

View Tool

Modular LLM that integrates a base model, multiple adapters, and an encoder to provide natural-language responses, decision-making, and speech-to-text…Granite Switch 4.1 8B is a modular LLM that integrates a base model, multiple adapters, and an encoder to provide natural-language responses, decision-making, and speech-to-text…

AI Models & LLMs
Ranked #18 in LLMs

Apertus 1.5 is a family of multilingual, multimodal language models designed to support a wide range of languages and contexts. It offers open-source access and improved reasoning…

AI Models & LLMs

Ranked #72 in LLMs

View Tool

Family of multilingual, multimodal language models designed to support a wide range of languages and contexts. It offers open-source access and improved reasoning…Apertus 1.5 is a family of multilingual, multimodal language models designed to support a wide range of languages and contexts. It offers open-source access and improved reasoning…

AI Models & LLMs
Ranked #72 in LLMs

LiquidAI LFM3-1.7B is a text model designed for local agents and specialized applications. It features a tri-hybrid architecture and supports a 256K-token context window, making…

AI Models & LLMs

Ranked #89 in LLMs

View Tool

Text model designed for local agents and specialized applications. It features a tri-hybrid architecture and supports a 256K-token context window, making…LiquidAI LFM3-1.7B is a text model designed for local agents and specialized applications. It features a tri-hybrid architecture and supports a 256K-token context window, making…

AI Models & LLMs
Ranked #89 in LLMs

DeepSeek is an AI research company dedicated to developing general artificial intelligence. It offers open-source frontier LLMs like DeepSeek-V4, DeepSeek-R1, and DeepSeek-Coder,…

AI Models & LLMs

Ranked #2 in LLMs

View Tool

AI research company dedicated to developing general artificial intelligence. It offers open-source frontier LLMs like DeepSeek-V4, DeepSeek-R1, and DeepSeek-Coder,…DeepSeek is an AI research company dedicated to developing general artificial intelligence. It offers open-source frontier LLMs like DeepSeek-V4, DeepSeek-R1, and DeepSeek-Coder,…

FeaturedAI Models & LLMs
Ranked #2 in LLMs

Olmo from Ai2 is a fully open language model designed for advanced AI research and applications. It offers various model variants optimized for programming, reasoning, and…

AI Models & LLMs

Ranked #99 in LLMs

View Tool

Fully open language model designed for advanced AI research and applications. It offers various model variants optimized for programming, reasoning, and…Olmo from Ai2 is a fully open language model designed for advanced AI research and applications. It offers various model variants optimized for programming, reasoning, and…

FeaturedAI Models & LLMs
Ranked #99 in LLMs

Mixtral-8x22B-Instruct-v0.1 is a large language model fine-tuned for instructional tasks. It supports function calling and integrates with Hugging Face transformers, offering…

AI Models & LLMs

Ranked #67 in LLMs

View Tool

Large language model fine-tuned for instructional tasks. It supports function calling and integrates with Hugging Face transformers, offering…Mixtral-8x22B-Instruct-v0.1 is a large language model fine-tuned for instructional tasks. It supports function calling and integrates with Hugging Face transformers, offering…

AI Models & LLMs
Ranked #67 in LLMs

AliceAI-Foundation-80B-A3B-Base is a foundational language model with a hybrid architecture and MoE layers, featuring 80 billion parameters. It excels in factual knowledge tasks,…

AI Models & LLMs

Ranked #31 in LLMs

View Tool

Foundational language model with a hybrid architecture and MoE layers, featuring 80 billion parameters. It excels in factual knowledge tasks,…AliceAI-Foundation-80B-A3B-Base is a foundational language model with a hybrid architecture and MoE layers, featuring 80 billion parameters. It excels in factual knowledge tasks,…

AI Models & LLMs
Ranked #31 in LLMs

Falcon3-10B-Instruct is a state-of-the-art language model designed for reasoning, language understanding, and instruction following tasks. It supports multiple languages and…

AI Models & LLMs

Ranked #66 in LLMs

View Tool

State-of-the-art language model designed for reasoning, language understanding, and instruction following tasks. It supports multiple languages and…Falcon3-10B-Instruct is a state-of-the-art language model designed for reasoning, language understanding, and instruction following tasks. It supports multiple languages and…

AI Models & LLMs
Ranked #66 in LLMs
1 of 8