KittenTTS Nano 0.8 INT8
2 configurations testedQuality criteria
Finite non-silent audio, plausible duration, reference waveform envelope correlation >= 0.95 and duration ratio 0.95–1.05, ASR WER <= 0.25 with no repeated gibberish.
| Precision | Device | Result | |
|---|---|---|---|
INT8 | CPU · WASM | Passed | Fast |
INT8 | GPU · WebGPU | Failed | — |
Test setup & sample details
- Quality gate
- Finite non-silent audio, plausible duration, reference waveform envelope correlation >= 0.95 and duration ratio 0.95–1.05, ASR WER <= 0.25 with no repeated gibberish.
- Tested
- 2026-10-31T13:44:56.369Z
- Environment
- Chrome 156.0.8078.79 on darwin/arm64; isolated fresh process per case; ORT 1.24.3; phonemizer 1.2.1; fflate 0.8.2
- Runtime
- ONNX Runtime Web / phonemizer 1.24.3 / 1.2.1
- Artifact revision
- 84781d74e29ee25217551556398b42f80593a813
- Fixture
{ "file": "model-samples/kitten-tts-nano-0.8-int8.json", "url": "https://f005.backblazeb2.com/file/hubters-webai-public/assets/benchmarks/kitten-tts-nano-0.8-int8.json", "size": 241, "sha1": "0d42895ff75b33dd23aba91af415026880bb0afd", "reference": { "file": "model-samples/kitten-tts-nano-0.8-int8-reference.wav", "url": "https://f005.backblazeb2.com/file/hubters-webai-public/assets/benchmarks/kitten-tts-nano-0.8-int8-reference.wav", "size": 336080, "sha1": "befef1048a243a3f5a24e534989171fe2191064b", "samplingRate": 24000, "license": "CC0-1.0" } }- Rerun when
- artifact revision change; ONNX Runtime or phonemizer version change; fixture or quality-gate change; browser/backend behavior change
Per-case quality & failure details
[
{
"precision": "int8",
"device": "wasm",
"status": "pass",
"quality": {
"finite": true,
"rms": 0.10774327000097104,
"envelopeCorrelation": 0.9988985696795146,
"durationRatio": 1,
"transcript": "The quick brown fox jumps over the lazy dog.",
"wordErrorRate": 0,
"repetitive": false,
"passed": true
},
"runtime": {
"loadMs": 6977,
"inferenceMs": 1407.4000000059605,
"totalMs": 18583.59999999404,
"grade": "good",
"secondsPerAudioSecond": 0.40211428571598873
}
},
{
"precision": "int8",
"device": "webgpu",
"status": "fail",
"quality": {
"finite": true,
"rms": 0.08295988897966146,
"envelopeCorrelation": 0.8736143928330252,
"durationRatio": 1.0071428571428571,
"transcript": "The kitten-lounff ox jumped over the lazy dog.",
"wordErrorRate": 0.4444444444444444,
"repetitive": false,
"passed": false
},
"runtime": {
"loadMs": 8249.90000000596,
"inferenceMs": 3537.7999999821186,
"totalMs": 24599,
"grade": "slow",
"secondsPerAudioSecond": 1.003631205668686
},
"failure": "Generated audio failed the fixed native-reference/intelligibility quality gate"
}
]