Skip to main content
ToolPotion
AI Advisor
Submit a Tool (Free)

dots.tts.edit

AI ModelsAI Models & LLMsOpen source · Web

dots.tts.edit V1.1 is a continuous autoregressive model designed for precise, instruction-controlled speech editing and zero-shot text-to-speech synthesis. It supports various operations like text replacement, insertion, deletion, emotion and prosody control, pauses, enhancement, and background-audio operations, all while preserving the original speaker and acoustic context outside the edited regions.

View Model
Share
View Model
Share

dots.tts.edit V1.1 is an advanced continuous autoregressive model developed for sophisticated speech editing and zero-shot text-to-speech (TTS) synthesis. This model offers granular control over speech, allowing users to perform a wide range of modifications while maintaining the integrity of the speaker's voice and the surrounding acoustic environment.

Read More

The model supports comprehensive editing operations, including text replacement, insertion, and deletion, which are crucial for refining spoken content. Beyond basic text manipulation, it provides localized control over emotion and allows for free-form style descriptions, enabling nuanced adjustments to the speech delivery. Users can also precisely control pitch and speaking rate, insert or reduce pauses, and apply speech enhancement or background-audio operations. A key capability is the composition of multiple edit operations, offering flexibility for complex editing tasks.

dots.tts.edit V1.1 is multilingual, supporting both English and Mandarin speech editing and zero-shot synthesis. It generates high-quality 48 kHz audio. The core weights of the model utilize BF16 precision, while the speaker encoder and vocoder maintain FP32 weights for optimal performance. The model can be accessed via a command-line interface (CLI) for speech editing or through a Python API for more integrated applications. It also includes an interactive playground for local experimentation.

Installation involves installing the latest main branch of dots.tts and its recommended dependencies. The CLI requires source audio, a tagged instruction, and an output path, with optional source and target transcripts. The Python API supports various structural tags for detailed control over edits. For zero-shot TTS, the DotsTtsEditRuntime provides `generate` and `generate_stream` functions.

Users are advised to use the model responsibly. Generated or edited speech may occasionally contain errors in pronunciation, timing, speaker similarity, or instruction following. The model should not be used for impersonation, misleading listeners, violating consent, or creating unlawful content. Explicit consent from speakers is required for using their voices. Publicly shared audio that could be mistaken for authentic, unmodified recordings must be clearly disclosed as AI-generated or edited. Misuse can be reported through the model repository's Community discussions.

  • CategoryAI Models & LLMs
  • Pricing ModelOpen source
  • DeploymentCloud
  • PlatformsWeb

  • Continuous autoregressive model for speech editing

  • Zero-shot text-to-speech synthesis

  • Text replacement, insertion, and deletion

  • Localized emotion control and free-form style descriptions

  • Pitch and speaking-rate control

  • Pause insertion and reduction

  • Speech enhancement and background-audio operations

  • Composition of multiple edit operations

  • Preserves speaker and acoustic context outside edited regions

  • Supports English and Mandarin speech editing and synthesis

  • Produces 48 kHz audio output

  • Command-line interface (CLI) for speech editing

  • Python API for integration

  • Interactive local edit playground available

  • BF16 core weights with FP32 speaker encoder and vocoder

  1. Install Dependencies: Install the latest main branch of dots.tts and its recommended dependencies.

  2. Prepare Source Audio: Provide source audio for editing operations.

  3. Define Instructions: Create tagged instructions for desired speech edits, including text, emotion, pitch, or rate controls.

  4. Execute CLI Command: Use the speech editing CLI with source audio, tagged instruction, and output path.

  5. Override Transcripts (Optional): Use --source-text and --target-text to override derived transcripts if needed.

  6. Adjust Speaker Guidance (Optional): Control speaker guidance with --use-xvector and --speaker-scale parameters.

  7. Integrate via Python API: Utilize the Python API with structural tags like <del>, <ins>, <emo>, <pitch> for programmatic control.

  8. Generate Zero-Shot TTS: Use `generate` or `generate_stream` functions from DotsTtsEditRuntime for text-to-speech synthesis.

  • Speech Content Refinement
  • Emotion and Style Adjustment
  • Prosody Control
  • Audio Enhancement
  • Zero-Shot TTS
  • Multilingual Speech Production
  • Interactive Speech Experimentation

dots.tts.edit Reviews

Loading...

Popular AI Tools Like dots.tts.edit

Gemini 3.8 Flash TTS and Flash-Lite TTS are advanced text-to-speech models by Google DeepMind. They offer expressive speech generation and real-time voice translation, suitable…

Text to Speech
View Tool

Advanced text-to-speech models by Google DeepMind. They offer expressive speech generation and real-time voice translation, suitable…Gemini 3.8 Flash TTS and Flash-Lite TTS are advanced text-to-speech models by Google DeepMind. They offer expressive speech generation and real-time voice translation, suitable…

Text to Speech
See the Top 5 AI Models

Descript

AI Apps

Descript is an AI video and audio editor that simplifies editing by allowing users to edit text directly. It offers recording, transcription, editing, and publishing features in…

AI Audio Editors

Ranked #47 in AI Apps

View Tool

AI Apps

AI video and audio editor that simplifies editing by allowing users to edit text directly. It offers recording, transcription, editing, and publishing features in…Descript is an AI video and audio editor that simplifies editing by allowing users to edit text directly. It offers recording, transcription, editing, and publishing features in…

FeaturedAI Audio Editors
Ranked #47 in AI Apps

Ming-3.0-tts-tiny is a multilingual speech synthesis model with paralinguistic and free-form control. It supports zero-shot voice cloning and voice design, offering explicit…

Text to Speech
View Tool

Multilingual speech synthesis model with paralinguistic and free-form control. It supports zero-shot voice cloning and voice design, offering explicit…Ming-3.0-tts-tiny is a multilingual speech synthesis model with paralinguistic and free-form control. It supports zero-shot voice cloning and voice design, offering explicit…

Text to Speech
See the Top 5 AI Models

VoiceStar TTS System

AI GitHub Repos

VoiceStar is a robust, duration-controllable text-to-speech (TTS) system capable of extrapolating speech patterns. It is designed to provide high-quality, customizable voice…

AI Models & LLMs
View Tool

AI GitHub Repos

Robust, duration-controllable text-to-speech (TTS) system capable of extrapolating speech patterns. It is designed to provide high-quality, customizable voice…VoiceStar is a robust, duration-controllable text-to-speech (TTS) system capable of extrapolating speech patterns. It is designed to provide high-quality, customizable voice…

AI Models & LLMs
See the Top 250 AI GitHub Repos

Typeless

AI Apps

Typeless is an AI voice dictation tool that transforms spoken thoughts into clear, polished writing across various applications. It automatically refines speech by removing filler…

Writing & Editing

Ranked #15 in Writing & Editing

View Tool

AI Apps

AI voice dictation tool that transforms spoken thoughts into clear, polished writing across various applications. It automatically refines speech by removing filler…Typeless is an AI voice dictation tool that transforms spoken thoughts into clear, polished writing across various applications. It automatically refines speech by removing filler…

Writing & Editing
Ranked #15 in Writing & Editing

Index-TTS

AI GitHub Repos

Index-TTS is an industrial-level, controllable, and efficient zero-shot text-to-speech system. It offers advanced capabilities for generating human-like speech from text inputs,…

Text to Speech
View Tool

AI GitHub Repos

Industrial-level, controllable, and efficient zero-shot text-to-speech system. It offers advanced capabilities for generating human-like speech from text inputs,…Index-TTS is an industrial-level, controllable, and efficient zero-shot text-to-speech system. It offers advanced capabilities for generating human-like speech from text inputs,…

Text to Speech
See the Top 250 AI GitHub Repos

FineVoice

AI Apps

FineVoice is an AI voice and content creation platform offering text-to-speech with 1500+ realistic voices, voice cloning, voice changing, sound effects, background music, and…

AI Voice GeneratorsMedia & Entertainment

Ranked #14 for Generating sound effects

View Tool

AI Apps

AI voice and content creation platform offering text-to-speech with 1500+ realistic voices, voice cloning, voice changing, sound effects, background music, and…FineVoice is an AI voice and content creation platform offering text-to-speech with 1500+ realistic voices, voice cloning, voice changing, sound effects, background music, and…

AI Voice GeneratorsMedia & Entertainment
Ranked #14 for Generating sound effects

Captions

AI Apps

Captions is an AI video generator and editor that turns footage or ideas into fully edited, ready-to-share videos. It is built for content creators making social videos, ads,…

AI Video EditorsMarketing & Creative Agencies

Ranked #104 in AI Apps

View Tool

AI Apps

AI video generator and editor that turns footage or ideas into fully edited, ready-to-share videos. It is built for content creators making social videos, ads,…Captions is an AI video generator and editor that turns footage or ideas into fully edited, ready-to-share videos. It is built for content creators making social videos, ads,…

FeaturedAI Video EditorsMarketing & Creative Agencies
Ranked #104 in AI Apps
1 of 8