Skip to main content
ToolPotion
AI Advisor
Submit a Tool (Free)

SenseNova-Loop-9B-Preview

LLMs#85AI Models & LLMsOpen source · Web

SenseNova-Loop-9B-Preview is a multimodal language model designed for long-context and agentic workflows. It processes both text and images to generate text outputs, supporting applications in document understanding, coding, and external tool interaction. The model features a unique looped decoder architecture and two-stream manifold-constrained hyper-connections for efficient, deep execution paths.

Visit Website
Share
SenseNova-Loop-9B-Preview screenshot
SenseNova-Loop-9B-Preview screenshot

SenseNova-Loop-9B-Preview is an advanced multimodal language model engineered to handle complex, long-context scenarios and agentic workflows. Developed by SenseNova, this model is capable of accepting both text and image inputs, subsequently generating text outputs. Its primary applications span areas such as comprehensive document understanding, sophisticated coding tasks, and seamless interaction with various external tools.

Read More

The core of SenseNova-Loop-9B-Preview's architecture lies in its innovative combination of a looped decoder and two-stream manifold-constrained hyper-connections (mHC). This design allows a contiguous block of decoder layers to be executed twice using shared weights, significantly deepening the execution path without duplicating parameters. Learned mappings within the mHC system efficiently manage information flow between two residual streams in the looped section, enhancing the model's ability to process and synthesize information.

Training recipes for the model incorporate long sequences, diverse multimodal inputs, and supervised task trajectories, with a maximum training sequence length reaching 262,144 tokens. This extensive training enables robust performance across a wide range of complex tasks. For optimal operation, users are advised to utilize the documented deployment environment and configuration parameters.

Key architectural highlights include a shared looped block where 24 decoder layers are applied twice, resulting in 56 decoder-layer executions from just 32 distinct layers. The two-stream mHC facilitates intelligent routing and combination of information across the residual streams. Furthermore, the decoder employs a hybrid attention mechanism, interleaving linear and full attention in a repeating four-layer pattern, which is preserved across loop passes. The model also supports MTP for accelerated inference, with Dspark and Dflash2 currently under development to further enhance speed.

  • CategoryAI Models & LLMs
  • Pricing ModelOpen source
  • DeploymentCloud
  • PlatformsWeb

  • Multimodal Input: Accepts both text and images

  • Text Generation: Produces text outputs

  • Looped Decoder Architecture: Executes decoder layers twice with shared weights

  • Two-Stream Manifold-Constrained Hyper-Connections (mHC): Manages information flow between residual streams

  • Long-Context Processing: Supports training sequence lengths up to 262,144 tokens

  • Agentic Workflow Support: Designed for interaction with external tools

  • Hybrid Attention: Interleaves linear and full attention layers

  • Parameter Efficiency: Achieves 56 decoder-layer executions from 32 distinct layers

  • Document Understanding: Capable of processing complex documents

  • Coding Applications: Supports code-related tasks

  • MTP Inference Acceleration: Available for faster processing

  • Fine-tuning Support: Provides documented training recipes for customization

  • Apache License 2.0: Open-source licensing for usage and modification

  • Hugging Face Integration: Available for download and deployment on Hugging Face

  1. Access Model Page: Navigate to the SenseNova-Loop-9B-Preview page on Hugging Face.

  2. Install Dependencies: Install PyTorch compatible with your CUDA environment, then install Transformers 5.18.0 and PyTorch 2.11.0.

  3. Load Model: Use the Transformers library to load the model and its custom implementation from the Hugging Face repository or a local directory.

  4. Configure Inference: Set `model_id` to the repository ID or local path and configure parameters like `enable_thinking` and `device`.

  5. Generate Text: Run the provided Python example to perform text generation, specifying the number of new tokens.

  6. Fine-tune Model: Use the documented training commands with your SFT dataset on a single node with 8 GPUs for fine-tuning.

  7. Deploy Model: Utilize deployment options like LightLLM or SGLang by replacing the local model path in the provided examples.

  • Long-Context Document Understanding
  • Agentic Workflow Automation
  • Multimodal Content Generation
  • Advanced Coding Assistance
  • PPT Design Automation
  • Motion Design Text Generation
  • Data Analysis Reporting
  • Multimodal Research and Development

SenseNova-Loop-9B-Preview Reviews

Loading...

Popular AI Tools Like SenseNova-Loop-9B-Preview

MiniMax M3 is an advanced AI model excelling in coding and agentic tasks. It features a 1M context window and native multimodal understanding, powered by the MSA architecture. The…

AI Models & LLMs

Ranked #61 in LLMs

View Tool

Advanced AI model excelling in coding and agentic tasks. It features a 1M context window and native multimodal understanding, powered by the MSA architecture. The…MiniMax M3 is an advanced AI model excelling in coding and agentic tasks. It features a 1M context window and native multimodal understanding, powered by the MSA architecture. The…

AI Models & LLMs
Ranked #61 in LLMs

LiquidAI LFM3-1.7B is a text model designed for local agents and specialized applications. It features a tri-hybrid architecture and supports a 256K-token context window, making…

AI Models & LLMs

Ranked #91 in LLMs

View Tool

Text model designed for local agents and specialized applications. It features a tri-hybrid architecture and supports a 256K-token context window, making…LiquidAI LFM3-1.7B is a text model designed for local agents and specialized applications. It features a tri-hybrid architecture and supports a 256K-token context window, making…

AI Models & LLMs
Ranked #91 in LLMs

DeepSeek-V4-Flash-Vision-Exp is an experimental multimodal model in the DeepSeek-V4 family, enhancing visual understanding capabilities. It builds on the DeepSeek-V4-Flash…

AI Models & LLMs

Ranked #70 in LLMs

View Tool

Experimental multimodal model in the DeepSeek-V4 family, enhancing visual understanding capabilities. It builds on the DeepSeek-V4-Flash…DeepSeek-V4-Flash-Vision-Exp is an experimental multimodal model in the DeepSeek-V4 family, enhancing visual understanding capabilities. It builds on the DeepSeek-V4-Flash…

AI Models & LLMs
Ranked #70 in LLMs

Inkling-Small is a versatile multimodal model that processes text, image, and audio inputs to generate text outputs. It supports developers in creating AI applications like…

AI Models & LLMs

Ranked #27 in LLMs

View Tool

Versatile multimodal model that processes text, image, and audio inputs to generate text outputs. It supports developers in creating AI applications like…Inkling-Small is a versatile multimodal model that processes text, image, and audio inputs to generate text outputs. It supports developers in creating AI applications like…

AI Models & LLMs
Ranked #27 in LLMs

pplx-embed-v2-context-9b-preview is a contextual embedding model designed for document chunks in RAG systems. It encodes document chunks together, reflecting their surrounding…

AI Models & LLMs
View Tool

Contextual embedding model designed for document chunks in RAG systems. It encodes document chunks together, reflecting their surrounding…pplx-embed-v2-context-9b-preview is a contextual embedding model designed for document chunks in RAG systems. It encodes document chunks together, reflecting their surrounding…

AI Models & LLMs
See the Top 5 AI Models

DeepSeek V4 Flash is an AI model collection designed for advanced text generation tasks. It leverages open source and open science principles to democratize artificial…

AI Models & LLMs
View Tool

AI model collection designed for advanced text generation tasks. It leverages open source and open science principles to democratize artificial…DeepSeek V4 Flash is an AI model collection designed for advanced text generation tasks. It leverages open source and open science principles to democratize artificial…

AI Models & LLMs
See the Top 5 AI Models

Muse Spark 1.3 is Meta's AI model for agentic and coding workflows, built for long-horizon tasks that need reliable tool calling and multi-step reasoning. It offers native…

AI Models & LLMs
View Tool

Meta's AI model for agentic and coding workflows, built for long-horizon tasks that need reliable tool calling and multi-step reasoning. It offers native…Muse Spark 1.3 is Meta's AI model for agentic and coding workflows, built for long-horizon tasks that need reliable tool calling and multi-step reasoning. It offers native…

FeaturedAI Models & LLMs
See the Top 5 AI Models

LLaVA

AI GitHub Repos

LLaVA is a visual instruction tuning model that combines large language and vision capabilities. It aims to achieve GPT-4V level performance, enabling multimodal understanding and…

AI Models & LLMs
View Tool

AI GitHub Repos

Visual instruction tuning model that combines large language and vision capabilities. It aims to achieve GPT-4V level performance, enabling multimodal understanding and…LLaVA is a visual instruction tuning model that combines large language and vision capabilities. It aims to achieve GPT-4V level performance, enabling multimodal understanding and…

AI Models & LLMs
See the Top 250 AI GitHub Repos
1 of 8