scott 967ed41239 Revert FP16 autocast — increases TTFA on first request ...

autocast triggers fp16 kernel selection at first call for each tensor
shape. Since the warmup uses short text, real requests re-trigger
selection and are slower net. Keeping FP32 + conditionals cache.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-04-05 20:30:49 -04:00

.gitea/workflows

Switch to inline cache to avoid registry blob size limits

2026-04-05 12:14:35 -04:00

.gitignore

Initial implementation: Chatterbox TTS with ROCm and Wyoming

2026-04-05 09:51:09 -04:00

config.py

Multi-pass warmup and smaller chunk_size to fix HA timeout

2026-04-05 15:04:46 -04:00

config.yaml

Multi-pass warmup and smaller chunk_size to fix HA timeout

2026-04-05 15:04:46 -04:00

docker-compose.yml

Switch to ROCm 6.1 + torch 2.5.1 to fix MIOpen workspace=0 slowness

2026-04-05 17:27:21 -04:00

Dockerfile.rocm

Switch to ROCm 6.1 + torch 2.5.1 to fix MIOpen workspace=0 slowness

2026-04-05 17:27:21 -04:00

engine.py

Revert FP16 autocast — increases TTFA on first request

2026-04-05 20:30:49 -04:00

main.py

Cache voice conditionals and add FP16 autocast

2026-04-05 20:22:13 -04:00

perth_stub.py

Replace resemble-perth with a no-op stub

2026-04-05 11:16:08 -04:00

requirements-rocm-init.txt

Switch to ROCm 6.1 + torch 2.5.1 to fix MIOpen workspace=0 slowness

2026-04-05 17:27:21 -04:00

requirements-rocm.txt

Fix safetensors version conflict with transformers 4.46.3

2026-04-05 17:34:23 -04:00

wyoming_handler.py

Add per-event logging and top-level exception catching

2026-04-05 17:10:32 -04:00

wyoming_voices.py

Add supports_synthesize_streaming=True to TtsProgram

2026-04-05 16:52:02 -04:00

Description

No description provided

213 KiB

Languages

Python 100%