scott 29b66e24bb Cache voice conditionals and add FP16 autocast ...

Voice conditionals (s3tokenizer + voice encoder + mel embeddings) are
expensive to compute but depend only on the reference audio, not the
text. Previously they ran on every synthesis chunk — 3x wasted work for
a 3-chunk request. Now computed once at startup and reused.

Also wrap generate() in torch.amp.autocast(float16) for ~2x speedup on
all model computation (T3 LLM, S3Gen CFM, HiFiGAN vocoder).

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-04-05 20:22:13 -04:00

.gitea/workflows

Switch to inline cache to avoid registry blob size limits

2026-04-05 12:14:35 -04:00

.gitignore

Initial implementation: Chatterbox TTS with ROCm and Wyoming

2026-04-05 09:51:09 -04:00

config.py

Multi-pass warmup and smaller chunk_size to fix HA timeout

2026-04-05 15:04:46 -04:00

config.yaml

Multi-pass warmup and smaller chunk_size to fix HA timeout

2026-04-05 15:04:46 -04:00

docker-compose.yml

Switch to ROCm 6.1 + torch 2.5.1 to fix MIOpen workspace=0 slowness

2026-04-05 17:27:21 -04:00

Dockerfile.rocm

Switch to ROCm 6.1 + torch 2.5.1 to fix MIOpen workspace=0 slowness

2026-04-05 17:27:21 -04:00

engine.py

Cache voice conditionals and add FP16 autocast

2026-04-05 20:22:13 -04:00

main.py

Cache voice conditionals and add FP16 autocast

2026-04-05 20:22:13 -04:00

perth_stub.py

Replace resemble-perth with a no-op stub

2026-04-05 11:16:08 -04:00

requirements-rocm-init.txt

Switch to ROCm 6.1 + torch 2.5.1 to fix MIOpen workspace=0 slowness

2026-04-05 17:27:21 -04:00

requirements-rocm.txt

Fix safetensors version conflict with transformers 4.46.3

2026-04-05 17:34:23 -04:00

wyoming_handler.py

Add per-event logging and top-level exception catching

2026-04-05 17:10:32 -04:00

wyoming_voices.py

Add supports_synthesize_streaming=True to TtsProgram

2026-04-05 16:52:02 -04:00

Description

No description provided

213 KiB

Languages

Python 100%