Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 4 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,14 +6,14 @@
[![Python 3.13+](https://img.shields.io/badge/python-3.13+-blue.svg)](https://www.python.org/downloads/)
[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://github.com/appautomaton/mlx-speech/blob/main/LICENSE)
[![Platform](https://img.shields.io/badge/platform-Apple%20Silicon-black?logo=apple)](https://developer.apple.com/documentation/apple-silicon)
[![Project page](https://img.shields.io/badge/project-page-2f7ad9)](https://appautomaton.github.io/mlx-speech/)
[![Project page](https://img.shields.io/badge/project-page-2f7ad9)](https://appautomaton.renocrypt.com/mlx-speech/)
[![CI](https://github.com/appautomaton/mlx-speech/actions/workflows/ci.yml/badge.svg)](https://github.com/appautomaton/mlx-speech/actions/workflows/ci.yml)

Local speech synthesis, editing, and transcription on Apple Silicon, running
pure MLX. No cloud, no PyTorch at runtime.

mlx-speech is an [App Automaton](https://appautomaton.github.io) project.
Project page: **[appautomaton.github.io/mlx-speech](https://appautomaton.github.io/mlx-speech/)**.
mlx-speech is an [App Automaton](https://appautomaton.renocrypt.com) project.
Project page: **[appautomaton.renocrypt.com/mlx-speech](https://appautomaton.renocrypt.com/mlx-speech/)**.
The `appautomaton` org hosts the [code on GitHub](https://github.com/appautomaton/mlx-speech)
and the converted [weights on Hugging Face](https://huggingface.co/appautomaton).

Expand Down Expand Up @@ -212,7 +212,7 @@ mlx-speech/

MIT — see [LICENSE](https://github.com/appautomaton/mlx-speech/blob/main/LICENSE)

Built and maintained by [App Automaton](https://appautomaton.github.io).
Built and maintained by [App Automaton](https://appautomaton.renocrypt.com).

## Acknowledgements

Expand Down
2 changes: 1 addition & 1 deletion docs/huggingface-release.md
Original file line number Diff line number Diff line change
Expand Up @@ -125,7 +125,7 @@ Each Hugging Face repo card should state:
- a minimal `mlx-speech` usage example
- any material license or usage restrictions
- a Links section pointing to the [source repo](https://github.com/appautomaton/mlx-speech)
and the [project page](https://appautomaton.github.io/mlx-speech/)
and the [project page](https://appautomaton.renocrypt.com/mlx-speech/)

## Release Checklist

Expand Down
2 changes: 1 addition & 1 deletion pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ version = "0.5.1"
description = "MLX-native speech library for Apple Silicon."
license = { file = "LICENSE" }
authors = [{ name = "appautomaton" }]
urls = { Homepage = "https://appautomaton.github.io/mlx-speech/", Repository = "https://github.com/appautomaton/mlx-speech", Documentation = "https://github.com/appautomaton/mlx-speech/tree/main/docs", "Hugging Face" = "https://huggingface.co/appautomaton" }
urls = { Homepage = "https://appautomaton.renocrypt.com/mlx-speech/", Repository = "https://github.com/appautomaton/mlx-speech", Documentation = "https://github.com/appautomaton/mlx-speech/tree/main/docs", "Hugging Face" = "https://huggingface.co/appautomaton" }
readme = "README.md"
requires-python = ">=3.13"
dependencies = [
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -76,7 +76,7 @@ print(result.text)
## Links

- Source code: [mlx-speech](https://github.com/appautomaton/mlx-speech)
- Project page: [appautomaton.github.io/mlx-speech](https://appautomaton.github.io/mlx-speech/)
- Project page: [appautomaton.renocrypt.com/mlx-speech](https://appautomaton.renocrypt.com/mlx-speech/)
- More examples: [AppAutomaton](https://github.com/appautomaton)

## License
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -23,14 +23,14 @@ tags:
# DramaBox TTS (MLX, bf16)

[![GitHub](https://img.shields.io/badge/GitHub-mlx--speech-181717?logo=github&logoColor=white)](https://github.com/appautomaton/mlx-speech)
[![App Automaton](https://img.shields.io/badge/App%20Automaton-project-1f6feb)](https://appautomaton.github.io)
[![App Automaton](https://img.shields.io/badge/App%20Automaton-project-1f6feb)](https://appautomaton.renocrypt.com)
[![Gemma backbone](https://img.shields.io/badge/%F0%9F%A4%97%20backbone-Gemma%203%2012B-yellow)](https://huggingface.co/appautomaton/gemma-3-12b-it-backbone-4bit-mlx)

Pure-MLX conversion of [Resemble AI's DramaBox](https://huggingface.co/ResembleAI/Dramabox), an expressive flow-matching diffusion text-to-speech model. It renders 48 kHz stereo speech on Apple Silicon with no PyTorch at inference time. Weights ship as plain `.safetensors` for the [mlx-speech](https://github.com/appautomaton/mlx-speech) runtime.

## Model Details

- Developed by: [App Automaton](https://appautomaton.github.io)
- Developed by: [App Automaton](https://appautomaton.renocrypt.com)
- Upstream model: [`ResembleAI/Dramabox`](https://huggingface.co/ResembleAI/Dramabox), built on [`Lightricks/LTX-2.3`](https://huggingface.co/Lightricks/LTX-2.3)
- Task: English text-to-speech at 48 kHz stereo
- Architecture: Gemma 3 12B text encoder, flow-matching audio DiT (3.3B), audio VAE, BigVGAN + BWE vocoder
Expand Down Expand Up @@ -97,7 +97,7 @@ python scripts/generate_dramabox.py \
## Links

- Source code: [`appautomaton/mlx-speech`](https://github.com/appautomaton/mlx-speech)
- Project page: [appautomaton.github.io/mlx-speech](https://appautomaton.github.io/mlx-speech/)
- Project page: [appautomaton.renocrypt.com/mlx-speech](https://appautomaton.renocrypt.com/mlx-speech/)
- Paired text encoder: [`appautomaton/gemma-3-12b-it-backbone-4bit-mlx`](https://huggingface.co/appautomaton/gemma-3-12b-it-backbone-4bit-mlx)
- Optional voice-ref denoiser: [`appautomaton/re-use-semamba-mlx`](https://huggingface.co/appautomaton/re-use-semamba-mlx)
- More from App Automaton: [GitHub](https://github.com/appautomaton) · [Hugging Face](https://huggingface.co/appautomaton)
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -112,7 +112,7 @@ result = generate_fish_s2_pro(
## Links

- Source code: [mlx-speech](https://github.com/appautomaton/mlx-speech)
- Project page: [appautomaton.github.io/mlx-speech](https://appautomaton.github.io/mlx-speech/)
- Project page: [appautomaton.renocrypt.com/mlx-speech](https://appautomaton.renocrypt.com/mlx-speech/)
- More examples: [AppAutomaton](https://github.com/appautomaton)

## License
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ tags:
# Gemma 3 12B IT Text-Encoder Backbone (MLX, 4-bit)

[![GitHub](https://img.shields.io/badge/GitHub-mlx--speech-181717?logo=github&logoColor=white)](https://github.com/appautomaton/mlx-speech)
[![App Automaton](https://img.shields.io/badge/App%20Automaton-project-1f6feb)](https://appautomaton.github.io)
[![App Automaton](https://img.shields.io/badge/App%20Automaton-project-1f6feb)](https://appautomaton.renocrypt.com)
[![DramaBox TTS](https://img.shields.io/badge/%F0%9F%A4%97%20model-DramaBox%20TTS-yellow)](https://huggingface.co/appautomaton/dramabox-tts-3.3b-bf16-mlx)

MLX 4-bit conversion of the Gemma 3 12B IT text backbone. It serves as the text-conditioning encoder for [DramaBox TTS](https://huggingface.co/appautomaton/dramabox-tts-3.3b-bf16-mlx) in [mlx-speech](https://github.com/appautomaton/mlx-speech), exposing the per-layer hidden states the audio model conditions on. It is not a chat or text-generation model.
Expand All @@ -31,7 +31,7 @@ MLX 4-bit conversion of the Gemma 3 12B IT text backbone. It serves as the text-

## Model Details

- Developed by: [App Automaton](https://appautomaton.github.io)
- Developed by: [App Automaton](https://appautomaton.renocrypt.com)
- Upstream model: [`google/gemma-3-12b-it`](https://huggingface.co/google/gemma-3-12b-it), converted from the `gemma-3-12b-it-qat-q4_0` release
- Role: text-encoder backbone. Produces all 49 hidden states consumed by the DramaBox prompt pipeline.
- Quantization: MLX 4-bit affine, `group_size=64`, with bf16 scales and norms
Expand Down Expand Up @@ -71,7 +71,7 @@ Text conditioning for LTX-2-derived audio diffusion models, specifically DramaBo
## Links

- Source code: [`appautomaton/mlx-speech`](https://github.com/appautomaton/mlx-speech)
- Project page: [appautomaton.github.io/mlx-speech](https://appautomaton.github.io/mlx-speech/)
- Project page: [appautomaton.renocrypt.com/mlx-speech](https://appautomaton.renocrypt.com/mlx-speech/)
- Paired model: [`appautomaton/dramabox-tts-3.3b-bf16-mlx`](https://huggingface.co/appautomaton/dramabox-tts-3.3b-bf16-mlx)
- More from App Automaton: [GitHub](https://github.com/appautomaton) · [Hugging Face](https://huggingface.co/appautomaton)

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ tags:
# Granite Speech 4.0 1B — MLX (int8)

[![GitHub](https://img.shields.io/badge/GitHub-mlx--speech-181717?logo=github&logoColor=white)](https://github.com/appautomaton/mlx-speech)
[![App Automaton](https://img.shields.io/badge/App%20Automaton-project-1f6feb)](https://appautomaton.github.io)
[![App Automaton](https://img.shields.io/badge/App%20Automaton-project-1f6feb)](https://appautomaton.renocrypt.com)
[![Hugging Face](https://img.shields.io/badge/%F0%9F%A4%97-appautomaton-yellow)](https://huggingface.co/appautomaton)

Pure-MLX selective-int8 conversion of IBM's
Expand Down Expand Up @@ -116,7 +116,7 @@ local path.

- Source code: [`appautomaton/mlx-speech`](https://github.com/appautomaton/mlx-speech)
- Runtime guide: [`docs/granite-speech-asr.md`](https://github.com/appautomaton/mlx-speech/blob/main/docs/granite-speech-asr.md)
- Project page: [appautomaton.github.io/mlx-speech](https://appautomaton.github.io/mlx-speech/)
- Project page: [appautomaton.renocrypt.com/mlx-speech](https://appautomaton.renocrypt.com/mlx-speech/)
- Upstream model: [`ibm-granite/granite-4.0-1b-speech`](https://huggingface.co/ibm-granite/granite-4.0-1b-speech)

## License
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -92,7 +92,7 @@ result = generate_longcat_audiodit(
## Links

- Source code: [mlx-speech](https://github.com/appautomaton/mlx-speech)
- Project page: [appautomaton.github.io/mlx-speech](https://appautomaton.github.io/mlx-speech/)
- Project page: [appautomaton.renocrypt.com/mlx-speech](https://appautomaton.renocrypt.com/mlx-speech/)
- More examples: [AppAutomaton](https://github.com/appautomaton)

## License
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -65,7 +65,7 @@ python scripts/generate/moss_local.py \
## Links

- Source code: [mlx-speech](https://github.com/appautomaton/mlx-speech)
- Project page: [appautomaton.github.io/mlx-speech](https://appautomaton.github.io/mlx-speech/)
- Project page: [appautomaton.renocrypt.com/mlx-speech](https://appautomaton.renocrypt.com/mlx-speech/)
- More examples: [AppAutomaton](https://github.com/appautomaton)

## License
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -47,7 +47,7 @@ Duration controls the expected token budget at 12.5 tokens/second.
## Links

- Source code: [mlx-speech](https://github.com/appautomaton/mlx-speech)
- Project page: [appautomaton.github.io/mlx-speech](https://appautomaton.github.io/mlx-speech/)
- Project page: [appautomaton.renocrypt.com/mlx-speech](https://appautomaton.renocrypt.com/mlx-speech/)

## License

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -54,7 +54,7 @@ python scripts/generate/moss_local.py \
## Links

- Source code: [mlx-speech](https://github.com/appautomaton/mlx-speech)
- Project page: [appautomaton.github.io/mlx-speech](https://appautomaton.github.io/mlx-speech/)
- Project page: [appautomaton.renocrypt.com/mlx-speech](https://appautomaton.renocrypt.com/mlx-speech/)

## License

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -59,7 +59,7 @@ Batch JSONL mode is also supported — see `python scripts/generate/moss_ttsd.py
## Links

- Source code: [mlx-speech](https://github.com/appautomaton/mlx-speech)
- Project page: [appautomaton.github.io/mlx-speech](https://appautomaton.github.io/mlx-speech/)
- Project page: [appautomaton.renocrypt.com/mlx-speech](https://appautomaton.renocrypt.com/mlx-speech/)

## License

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ tags:
# Qwen3-ASR-1.7B — MLX (bf16)

[![GitHub](https://img.shields.io/badge/GitHub-mlx--speech-181717?logo=github&logoColor=white)](https://github.com/appautomaton/mlx-speech)
[![App Automaton](https://img.shields.io/badge/App%20Automaton-project-1f6feb)](https://appautomaton.github.io)
[![App Automaton](https://img.shields.io/badge/App%20Automaton-project-1f6feb)](https://appautomaton.renocrypt.com)
[![Hugging Face](https://img.shields.io/badge/%F0%9F%A4%97-appautomaton-yellow)](https://huggingface.co/appautomaton)
[![int8 build](https://img.shields.io/badge/variant-int8%20(default)-1f6feb)](https://huggingface.co/appautomaton/qwen3-asr-1.7b-int8-mlx)

Expand All @@ -28,7 +28,7 @@ MLX-native **bf16** conversion of [Qwen3-ASR-1.7B](https://huggingface.co/Qwen/Q

## Model Details

- Developed by: [App Automaton](https://appautomaton.github.io)
- Developed by: [App Automaton](https://appautomaton.renocrypt.com)
- Upstream model: [`Qwen/Qwen3-ASR-1.7B`](https://huggingface.co/Qwen/Qwen3-ASR-1.7B) (code: [`QwenLM/Qwen3-ASR`](https://github.com/QwenLM/Qwen3-ASR))
- Task: automatic speech recognition — English, Chinese, and mixed Chinese/English (upstream supports more languages; the `mlx-speech` v0 path validates en/zh/mixed)
- Precision: bf16 — MLX format port; keys are remapped to the MLX module tree and audio Conv2D weights transposed to MLX layout
Expand Down Expand Up @@ -81,9 +81,9 @@ asr = mlx_speech.asr.load("models/qwen3_asr_1_7b/mlx-bf16")
## Links

- Source code: [`appautomaton/mlx-speech`](https://github.com/appautomaton/mlx-speech)
- Project page: [appautomaton.github.io/mlx-speech](https://appautomaton.github.io/mlx-speech/)
- Project page: [appautomaton.renocrypt.com/mlx-speech](https://appautomaton.renocrypt.com/mlx-speech/)
- Default int8 variant: [`appautomaton/qwen3-asr-1.7b-int8-mlx`](https://huggingface.co/appautomaton/qwen3-asr-1.7b-int8-mlx)
- More from App Automaton: [Project](https://appautomaton.github.io) · [GitHub](https://github.com/appautomaton) · [Hugging Face](https://huggingface.co/appautomaton)
- More from App Automaton: [Project](https://appautomaton.renocrypt.com) · [GitHub](https://github.com/appautomaton) · [Hugging Face](https://huggingface.co/appautomaton)

## License

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ tags:
# Qwen3-ASR-1.7B — MLX (int8)

[![GitHub](https://img.shields.io/badge/GitHub-mlx--speech-181717?logo=github&logoColor=white)](https://github.com/appautomaton/mlx-speech)
[![App Automaton](https://img.shields.io/badge/App%20Automaton-project-1f6feb)](https://appautomaton.github.io)
[![App Automaton](https://img.shields.io/badge/App%20Automaton-project-1f6feb)](https://appautomaton.renocrypt.com)
[![Hugging Face](https://img.shields.io/badge/%F0%9F%A4%97-appautomaton-yellow)](https://huggingface.co/appautomaton)
[![bf16 build](https://img.shields.io/badge/variant-bf16-lightgrey)](https://huggingface.co/appautomaton/qwen3-asr-1.7b-bf16-mlx)

Expand All @@ -32,7 +32,7 @@ MLX-native **int8** conversion of [Qwen3-ASR-1.7B](https://huggingface.co/Qwen/Q

## Model Details

- Developed by: [App Automaton](https://appautomaton.github.io)
- Developed by: [App Automaton](https://appautomaton.renocrypt.com)
- Upstream model: [`Qwen/Qwen3-ASR-1.7B`](https://huggingface.co/Qwen/Qwen3-ASR-1.7B) (code: [`QwenLM/Qwen3-ASR`](https://github.com/QwenLM/Qwen3-ASR))
- Task: automatic speech recognition — English, Chinese, and mixed Chinese/English (upstream supports more languages; the `mlx-speech` v0 path validates en/zh/mixed)
- Precision: **int8 affine, group_size 64**, applied to the Linear and Embedding layers across the audio tower and text decoder; Conv2D layers are kept unquantized
Expand Down Expand Up @@ -86,9 +86,9 @@ asr = mlx_speech.asr.load("models/qwen3_asr_1_7b/mlx-int8")
## Links

- Source code: [`appautomaton/mlx-speech`](https://github.com/appautomaton/mlx-speech)
- Project page: [appautomaton.github.io/mlx-speech](https://appautomaton.github.io/mlx-speech/)
- Project page: [appautomaton.renocrypt.com/mlx-speech](https://appautomaton.renocrypt.com/mlx-speech/)
- Unquantized variant: [`appautomaton/qwen3-asr-1.7b-bf16-mlx`](https://huggingface.co/appautomaton/qwen3-asr-1.7b-bf16-mlx)
- More from App Automaton: [Project](https://appautomaton.github.io) · [GitHub](https://github.com/appautomaton) · [Hugging Face](https://huggingface.co/appautomaton)
- More from App Automaton: [Project](https://appautomaton.renocrypt.com) · [GitHub](https://github.com/appautomaton) · [Hugging Face](https://huggingface.co/appautomaton)

## License

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@ tags:
# RE-USE SEMamba Speech Enhancement (MLX)

[![GitHub](https://img.shields.io/badge/GitHub-mlx--speech-181717?logo=github&logoColor=white)](https://github.com/appautomaton/mlx-speech)
[![App Automaton](https://img.shields.io/badge/App%20Automaton-project-1f6feb)](https://appautomaton.github.io)
[![App Automaton](https://img.shields.io/badge/App%20Automaton-project-1f6feb)](https://appautomaton.renocrypt.com)
[![DramaBox TTS](https://img.shields.io/badge/%F0%9F%A4%97%20model-DramaBox%20TTS-yellow)](https://huggingface.co/appautomaton/dramabox-tts-3.3b-bf16-mlx)

Pure-MLX conversion of [NVIDIA RE-USE](https://huggingface.co/nvidia/RE-USE), a
Expand All @@ -37,7 +37,7 @@ runs with `denoise_ref=True`, giving the cloning model a clean speaker anchor.

## Model Details

- Developed by: [App Automaton](https://appautomaton.github.io)
- Developed by: [App Automaton](https://appautomaton.renocrypt.com)
- Upstream model: [`nvidia/RE-USE`](https://huggingface.co/nvidia/RE-USE) (SEMamba, bidirectional Mamba over STFT magnitude + phase)
- Role: input-side voice-reference denoiser for DramaBox `denoise_ref=True`. Optional, off by default.
- Conversion: format-only port of the fp32 weights to MLX `.safetensors` (1416 keys, ~9.6M params). No quantization, no architecture change.
Expand Down Expand Up @@ -91,7 +91,7 @@ TTS model's paralinguistic events (breaths, laughs) are preserved.
## Links

- Source code: [`appautomaton/mlx-speech`](https://github.com/appautomaton/mlx-speech)
- Project page: [appautomaton.github.io/mlx-speech](https://appautomaton.github.io/mlx-speech/)
- Project page: [appautomaton.renocrypt.com/mlx-speech](https://appautomaton.renocrypt.com/mlx-speech/)
- Paired model: [`appautomaton/dramabox-tts-3.3b-bf16-mlx`](https://huggingface.co/appautomaton/dramabox-tts-3.3b-bf16-mlx)
- More from App Automaton: [GitHub](https://github.com/appautomaton) · [Hugging Face](https://huggingface.co/appautomaton)

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -120,7 +120,7 @@ On Apple Silicon with int8 weights and bf16 activations, real-time factor
## Links

- Source code: [`mlx-speech`](https://github.com/appautomaton/mlx-speech)
- Project page: [appautomaton.github.io/mlx-speech](https://appautomaton.github.io/mlx-speech/)
- Project page: [appautomaton.renocrypt.com/mlx-speech](https://appautomaton.renocrypt.com/mlx-speech/)
- Upstream model: [`stepfun-ai/Step-Audio-EditX`](https://huggingface.co/stepfun-ai/Step-Audio-EditX)
- Technical report: [arXiv:2511.03601](https://arxiv.org/abs/2511.03601)
- More examples: [AppAutomaton](https://github.com/appautomaton)
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -73,7 +73,7 @@ See [mlx-speech](https://github.com/appautomaton/mlx-speech) for the full runtim
## Links

- Source code: [mlx-speech](https://github.com/appautomaton/mlx-speech)
- Project page: [appautomaton.github.io/mlx-speech](https://appautomaton.github.io/mlx-speech/)
- Project page: [appautomaton.renocrypt.com/mlx-speech](https://appautomaton.renocrypt.com/mlx-speech/)

## License

Expand Down
2 changes: 1 addition & 1 deletion site/README.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
# mlx-speech landing page

Static GitHub Pages site for [mlx-speech](https://github.com/appautomaton/mlx-speech),
published at <https://appautomaton.github.io/mlx-speech/>.
published at <https://appautomaton.renocrypt.com/mlx-speech/>.

## Stack

Expand Down
Loading