Description
NeuDecide is a voice-action model designed to convert spoken commands directly into function calls without the need for transcription. This model is particularly compact, with a size of 43 MB, and can run efficiently on a single thread using ONNX Runtime. It does not require a GPU or an internet connection once downloaded, making it highly accessible for various applications.
Read More
The model operates by taking audio input and a list of tools, outputting the appropriate tool call based on the input. Tools are defined using JSON schemas, allowing users to modify the model's capabilities by simply altering the JSON, rather than retraining the model. This flexibility makes NeuDecide suitable for a wide range of applications, from controlling smart home devices to executing specific software functions.
NeuDecide's architecture includes a pre-trained streaming English speech encoder and a tool-calling encoder-decoder, initialized from Needle and trained as a unified system. The inference process involves three ONNX graphs: the audio encoder, tool encoder, and decoder step, each contributing to the model's ability to process and respond to audio commands effectively.
Despite its capabilities, NeuDecide has some limitations. It can trigger on noise, lacks a calibrated confidence score, and is limited to English. Additionally, it is recommended to keep tool lists short to optimize performance. The model is best used alongside a larger model for handling more complex or open-ended tasks.
NeuDecide is open-source, licensed under Apache 2.0, and can be integrated into various systems with Python 3.10 to 3.13. It is ideal for developers looking to implement voice-action capabilities in their applications without extensive computational resources.
- CategoryAI Models & LLMs
- Pricing ModelOpen Source
- DeploymentRuns locally
- PlatformsWeb
NeuDecide Highlights
Converts speech to function calls
Operates offline without GPU
Uses JSON schemas for tool definitions
Compact size of 43 MB
Runs on ONNX Runtime
Pre-trained English speech encoder
Tool-calling encoder-decoder
Open-source under Apache 2.0
Getting Started with NeuDecide
Access model: Visit Hugging Face repository
Authenticate: Agree to terms and conditions
Set up environment: Install Python 3.10–3.13
Integrate via API: Use JSON schemas for tools
Optimise: Test with various audio inputs
NeuDecide's Use Cases
- Smart Home Control
- Software Automation
- Voice-Activated Tools
- Offline Voice Processing
- Custom Tool Integration








