scott 9b62fce5c5 [dev-fp16] Convert model weights to fp16 at load time ...

Converting t3/s3gen/ve to fp16 once at load time means:
- Warmup runs in fp16, covering the right dtypes for all real requests
- No per-call autocast casting overhead
- ~2x faster matrix ops and convolutions on RDNA 2 hardware

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-04-05 20:34:33 -04:00

.gitea/workflows

Switch to inline cache to avoid registry blob size limits

2026-04-05 12:14:35 -04:00

.gitignore

Initial implementation: Chatterbox TTS with ROCm and Wyoming

2026-04-05 09:51:09 -04:00

config.py

Multi-pass warmup and smaller chunk_size to fix HA timeout

2026-04-05 15:04:46 -04:00

config.yaml

Multi-pass warmup and smaller chunk_size to fix HA timeout

2026-04-05 15:04:46 -04:00

docker-compose.yml

Switch to ROCm 6.1 + torch 2.5.1 to fix MIOpen workspace=0 slowness

2026-04-05 17:27:21 -04:00

Dockerfile.rocm

Switch to ROCm 6.1 + torch 2.5.1 to fix MIOpen workspace=0 slowness

2026-04-05 17:27:21 -04:00

engine.py

[dev-fp16] Convert model weights to fp16 at load time

2026-04-05 20:34:33 -04:00

main.py

Cache voice conditionals and add FP16 autocast

2026-04-05 20:22:13 -04:00

perth_stub.py

Replace resemble-perth with a no-op stub

2026-04-05 11:16:08 -04:00

requirements-rocm-init.txt

Switch to ROCm 6.1 + torch 2.5.1 to fix MIOpen workspace=0 slowness

2026-04-05 17:27:21 -04:00

requirements-rocm.txt

Fix safetensors version conflict with transformers 4.46.3

2026-04-05 17:34:23 -04:00

wyoming_handler.py

Add per-event logging and top-level exception catching

2026-04-05 17:10:32 -04:00

wyoming_voices.py

Add supports_synthesize_streaming=True to TtsProgram

2026-04-05 16:52:02 -04:00

Description

No description provided

213 KiB

Languages

Python 100%