Chatterbox Multilingual V2 Desktop
Generate English, Spanish or French speech from text, optionally conditioned on a reference WAV. Returns mono24kHz WAV with official Perth watermark.
Desktop app
Run Chatterbox Multilingual V2 Desktop on your computer
Download the desktop app to load this model, provide input and view results locally.
Public desktop downloads are coming soon.Device requirements
If your device falls short
MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.
GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.
PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.
Benchmark evidence
Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.
Chatterbox Multilingual V2 Desktop
46 configurations testedQuality criteria
{ "scope": "Frozen authored language/mode suite; complete waveform, independent ASR agreement, no repetition, RTF<=5 offline narration. Not subjective voice/locale identity certification.", "cases": [ { "id": "short", "label": "Short speech", "text": "Hello. This is a local speech synthesis test.", "language": "en", "reference": false, "source": "Authored text for reproducible local synthesis; public-domain test text", "referenceFile": null, "referenceSha256": null }, { "id": "numbers", "label": "Numbers and instructions", "text": "The meeting starts at nine thirty. Please bring three notebooks.", "language": "en", "reference": false, "source": "Authored text for reproducible local synthesis; public-domain test text", "referenceFile": null, "referenceSha256": null }, { "id": "reference", "label": "Reference voice", "text": "Hello. This is a local speech synthesis test.", "language": "en", "reference": true, "source": "Authored text for reproducible local synthesis; public-domain test text", "referenceFile": "model-samples/desktop/chatterbox-reference-input.wav", "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe" }, { "id": "spanish", "label": "Spanish speech", "text": "Hola. Esta es una prueba de voz.", "language": "es", "reference": false, "source": "Authored text for reproducible local synthesis; public-domain test text", "referenceFile": null, "referenceSha256": null }, { "id": "french", "label": "French speech", "text": "Bonjour. Ceci est un test de synthèse vocale.", "language": "fr", "reference": false, "source": "Authored text for reproducible local synthesis; public-domain test text", "referenceFile": null, "referenceSha256": null }, { "id": "spanish-reference", "label": "Spanish reference voice", "text": "Hola. Esta es una prueba de voz.", "language": "es", "reference": true, "source": "Authored text for reproducible local synthesis; public-domain test text", "referenceFile": "model-samples/desktop/chatterbox-reference-input.wav", "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe" } ], "maximumWordErrorRate": 0.35, "maximumChineseCharacterErrorRate": 0.25, "maximumHindiCharacterErrorRate": 0.35, "maximumRealTimeFactor": 5 }
| Precision | Device | Result | Platform | Inference / load | Task metric | |
|---|---|---|---|---|---|---|
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 6385 ms / 11930 ms | 1.923 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 6490 ms / 13866 ms | 1.955 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 6624 ms / 11930 ms | 1.995 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 6708 ms / 14437 ms | 2.020 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 6955 ms / 14437 ms | 2.229 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 6990 ms / 11930 ms | 2.240 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 6999 ms / 14437 ms | 2.333 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 7204 ms / 13866 ms | 2.401 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 8094 ms / 14437 ms | 2.438 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 5852 ms / 14437 ms | 2.522 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 7584 ms / 11930 ms | 2.528 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 7739 ms / 14437 ms | 2.546 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 8817 ms / 13866 ms | 2.656 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 5883 ms / 14437 ms | 2.674 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 8947 ms / 14437 ms | 2.695 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 5960 ms / 13866 ms | 2.709 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 8253 ms / 11930 ms | 2.715 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 9021 ms / 14437 ms | 2.717 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 9104 ms / 13866 ms | 2.742 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 6364 ms / 13866 ms | 2.743 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 9136 ms / 13866 ms | 2.752 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 9149 ms / 14437 ms | 2.756 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 9278 ms / 14437 ms | 2.795 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 9314 ms / 11930 ms | 2.805 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 9331 ms / 11930 ms | 2.811 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 9436 ms / 13866 ms | 2.842 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 6264 ms / 11930 ms | 2.847 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 6918 ms / 11930 ms | 2.982 RTF |
FP32 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 10066 ms / 11930 ms | 3.032 RTF |
FP32 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 10073 ms / 11930 ms | 3.034 RTF |
FP32 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 10751 ms / 13866 ms | 3.238 RTF |
FP32 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 12740 ms / 13866 ms | 4.083 RTF |
FP32 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 12970 ms / 13866 ms | 4.267 RTF |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 10825 ms / 12107 ms | 3.470 RTF |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 7794 ms / 12107 ms | 3.480 RTF |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 11271 ms / 12107 ms | 3.659 RTF |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 11359 ms / 14120 ms | 3.688 RTF |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 10801 ms / 14120 ms | 3.750 RTF |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 8456 ms / 12107 ms | 3.775 RTF |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 10884 ms / 12107 ms | 3.779 RTF |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 8531 ms / 14120 ms | 3.808 RTF |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 12605 ms / 12107 ms | 4.146 RTF |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 15186 ms / 18790 ms | 4.931 RTF |
FP32 | cpu | Failed | — | macos · aarch64 | 17633 ms / 14120 ms | 5.800 RTF |
FP32 | cpu | Failed | — | macos · aarch64 | 18154 ms / 14120 ms | 8.104 RTF |
FP32 | cpu | Failed | — | macos · aarch64 | 20941 ms / 14120 ms | 6.712 RTF |
Test setup & sample details
- Quality gate
- { "scope": "Frozen authored language/mode suite; complete waveform, independent ASR agreement, no repetition, RTF<=5 offline narration. Not subjective voice/locale identity certification.", "cases": [ { "id": "short", "label": "Short speech", "text": "Hello. This is a local speech synthesis test.", "language": "en", "reference": false, "source": "Authored text for reproducible local synthesis; public-domain test text", "referenceFile": null, "referenceSha256": null }, { "id": "numbers", "label": "Numbers and instructions", "text": "The meeting starts at nine thirty. Please bring three notebooks.", "language": "en", "reference": false, "source": "Authored text for reproducible local synthesis; public-domain test text", "referenceFile": null, "referenceSha256": null }, { "id": "reference", "label": "Reference voice", "text": "Hello. This is a local speech synthesis test.", "language": "en", "reference": true, "source": "Authored text for reproducible local synthesis; public-domain test text", "referenceFile": "model-samples/desktop/chatterbox-reference-input.wav", "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe" }, { "id": "spanish", "label": "Spanish speech", "text": "Hola. Esta es una prueba de voz.", "language": "es", "reference": false, "source": "Authored text for reproducible local synthesis; public-domain test text", "referenceFile": null, "referenceSha256": null }, { "id": "french", "label": "French speech", "text": "Bonjour. Ceci est un test de synthèse vocale.", "language": "fr", "reference": false, "source": "Authored text for reproducible local synthesis; public-domain test text", "referenceFile": null, "referenceSha256": null }, { "id": "spanish-reference", "label": "Spanish reference voice", "text": "Hola. Esta es una prueba de voz.", "language": "es", "reference": true, "source": "Authored text for reproducible local synthesis; public-domain test text", "referenceFile": "model-samples/desktop/chatterbox-reference-input.wav", "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe" } ], "maximumWordErrorRate": 0.35, "maximumChineseCharacterErrorRate": 0.25, "maximumHindiCharacterErrorRate": 0.35, "maximumRealTimeFactor": 5 }
- Tested
- 2026-11-06T18:47:28.176753+00:00
- Environment
- { "os": "macos", "arch": "aarch64", "hardware": "Apple M3 Max", "runtimeProvisioning": "App-owned CPython3.13.18; model-owned pinned packages", "concurrentUploads": true, "concurrentActivity": "Background source/backup transfers active; synthesis/ASR/builds run sequentially", "measurementScope": "Apple M3 Max/macOS27.2 current-device scope; private seeded local-cache loads are not network-download benchmarks" }
- Runtime
- chatterbox-tts 0.1.7
- Artifact revision
- 5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18
- Fixture
{ "file": "model-samples/desktop/chatterbox-multilingual-family/v2-short-input.json", "size": 210, "sha1": "f3a85e4a376c7206afbdcf3dc4c22285d3471bae", "sha256": "340f4333ceb6314b66737590e92755ab95dc01e61122b774b8e75c97681285bc", "url": "https://assets.localai.tools/samples/v1/files/340f4333ceb6314b66737590e92755ab95dc01e61122b774b8e75c97681285bc/v2-short-input.json" }- Rerun when
- artifact revision or required file integrity; runtime/helper/model/processor/decoder semantics; fixture/config/checksum or quality gate; relevant backend/OS behavior
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hello. This is a local speech synthesis test.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.5766565799713135,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:35.703157+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 15229.973666999285,
"inferenceMs": 15186.179583997728,
"audioSeconds": 3.08,
"realTimeFactor": 4.930577787012249,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"cpu": 292
},
"s3gen": {
"cpu": 2122
},
"ve": {
"cpu": 16
}
},
"rms": 0.118342325091362,
"peak": 0.6355761289596558,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 18790.382791998127,
"totalMs": 34020.35645899741,
"initReuse": false,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 6594674688,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"performanceGrade": "acceptable",
"engine": "chatterbox-tts",
"grade": "acceptable",
"audioSecondsPerSecond": 0.2028159869283725,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hello. This is a local speech synthesis test.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.5766565799713135,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:35.704063+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 11286.465082997893,
"inferenceMs": 11270.644959000492,
"audioSeconds": 3.08,
"realTimeFactor": 3.659300311363796,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"cpu": 292
},
"s3gen": {
"cpu": 2122
},
"ve": {
"cpu": 16
}
},
"rms": 0.118342325091362,
"peak": 0.6355761289596558,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 8,
"loadMs": 12106.912000002922,
"totalMs": 23393.377083000814,
"initReuse": false,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 6511034368,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"performanceGrade": "acceptable",
"engine": "chatterbox-tts",
"grade": "acceptable",
"audioSecondsPerSecond": 0.273276286424086,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"transcript": "The meeting starts at 9:30. Please bring free notebooks.",
"metric": "wordErrorRate",
"errorRate": 0.3,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.5161579847335815,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:35.823581+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 10899.954083000921,
"inferenceMs": 10883.645833000628,
"audioSeconds": 2.88,
"realTimeFactor": 3.779043692014107,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"cpu": 292
},
"s3gen": {
"cpu": 2122
},
"ve": {
"cpu": 16
}
},
"rms": 0.11960388720035553,
"peak": 0.9257550239562988,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 8,
"loadMs": 12106.912000002922,
"totalMs": 23006.866083003843,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 6511034368,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"performanceGrade": "acceptable",
"engine": "chatterbox-tts",
"grade": "acceptable",
"audioSecondsPerSecond": 0.26461721046337855,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hello, this is a local speech synthesis test.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.7722642421722412,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:35.937826+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 12662.473749998753,
"inferenceMs": 12605.21579199849,
"audioSeconds": 3.04,
"realTimeFactor": 4.146452563157398,
"seed": 42,
"voiceMode": "reference",
"placement": {
"t3": {
"cpu": 292
},
"s3gen": {
"cpu": 2122
},
"ve": {
"cpu": 16
}
},
"rms": 0.02826353907585144,
"peak": 0.27316316962242126,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 8,
"loadMs": 12106.912000002922,
"totalMs": 24769.385750001675,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 6511034368,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"performanceGrade": "acceptable",
"engine": "chatterbox-tts",
"grade": "acceptable",
"audioSecondsPerSecond": 0.24117000852375128,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hola, esta es una prueba de voz.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.44670432806015015,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.067533+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 7808.177957998851,
"inferenceMs": 7794.4381660017825,
"audioSeconds": 2.24,
"realTimeFactor": 3.4796598955365097,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"cpu": 292
},
"s3gen": {
"cpu": 2122
},
"ve": {
"cpu": 16
}
},
"rms": 0.13252228498458862,
"peak": 0.9293280243873596,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 8,
"loadMs": 12106.912000002922,
"totalMs": 19915.089958001772,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 6511034368,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"performanceGrade": "acceptable",
"engine": "chatterbox-tts",
"grade": "acceptable",
"audioSecondsPerSecond": 0.28738440825286904,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Bonjour. Ceci est un test de synthèse vocale.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.5150325894355774,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.195575+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 10841.79475000201,
"inferenceMs": 10825.251209000271,
"audioSeconds": 3.12,
"realTimeFactor": 3.469631797756497,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"cpu": 292
},
"s3gen": {
"cpu": 2122
},
"ve": {
"cpu": 16
}
},
"rms": 0.11220623552799225,
"peak": 0.998170793056488,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 8,
"loadMs": 12106.912000002922,
"totalMs": 22948.70675000493,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 6511034368,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"performanceGrade": "acceptable",
"engine": "chatterbox-tts",
"grade": "acceptable",
"audioSecondsPerSecond": 0.2882150205813226,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hola, esta es una prueba de voz.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.7209250926971436,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.290783+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 8508.216041998821,
"inferenceMs": 8455.653040997277,
"audioSeconds": 2.24,
"realTimeFactor": 3.7748451075880696,
"seed": 42,
"voiceMode": "reference",
"placement": {
"t3": {
"cpu": 292
},
"s3gen": {
"cpu": 2122
},
"ve": {
"cpu": 16
}
},
"rms": 0.03092443384230137,
"peak": 0.2860814332962036,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 8,
"loadMs": 12106.912000002922,
"totalMs": 20615.128042001743,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 6511034368,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"performanceGrade": "acceptable",
"engine": "chatterbox-tts",
"grade": "acceptable",
"audioSecondsPerSecond": 0.26491153186387245,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hello, this is a local speech synthesis test.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.577829897403717,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.402579+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 10090.318624999782,
"inferenceMs": 10073.302625001816,
"audioSeconds": 3.32,
"realTimeFactor": 3.034127296687294,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.09951025247573853,
"peak": 0.9306827783584595,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9038102528,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 11929.695417002222,
"totalMs": 22020.014042002003,
"initReuse": false,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4529291264,
"performanceGrade": "acceptable",
"engine": "chatterbox-tts",
"grade": "acceptable",
"audioSecondsPerSecond": 0.32958406230741044,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "The meeting starts at 9:30. Please bring three notebooks.",
"metric": "wordErrorRate",
"errorRate": 0.2,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.5202886462211609,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.528345+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 7005.092916999274,
"inferenceMs": 6989.820791000966,
"audioSeconds": 3.12,
"realTimeFactor": 2.240327176602874,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.11682448536157608,
"peak": 0.8752297163009644,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9067413504,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 11929.695417002222,
"totalMs": 18934.788334001496,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4529291264,
"performanceGrade": "good",
"engine": "chatterbox-tts",
"grade": "good",
"audioSecondsPerSecond": 0.446363375155031,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hello, this is a local speech synthesis test.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.7841492295265198,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.639077+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 8307.971417001681,
"inferenceMs": 8253.344667002239,
"audioSeconds": 3.04,
"realTimeFactor": 2.7149160088823154,
"seed": 42,
"voiceMode": "reference",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.028858361765742302,
"peak": 0.3309638202190399,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9106489344,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 11929.695417002222,
"totalMs": 20237.666834003903,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4529291264,
"performanceGrade": "good",
"engine": "chatterbox-tts",
"grade": "good",
"audioSecondsPerSecond": 0.3683355200412564,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hola, esta es una prueba de voz.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.4228832721710205,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.736851+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 6931.710000000749,
"inferenceMs": 6918.076000001747,
"audioSeconds": 2.32,
"realTimeFactor": 2.981929310345581,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.1399175524711609,
"peak": 0.8493221998214722,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9132851200,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 11929.695417002222,
"totalMs": 18861.40541700297,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4529291264,
"performanceGrade": "good",
"engine": "chatterbox-tts",
"grade": "good",
"audioSecondsPerSecond": 0.3353533554704247,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Bonjour, Ceci est un test de synthèse vocale.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.49774327874183655,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.861687+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 7598.932832999708,
"inferenceMs": 7584.032667000429,
"audioSeconds": 3,
"realTimeFactor": 2.528010889000143,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.12023390829563141,
"peak": 0.9020614624023438,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9156870144,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 11929.695417002222,
"totalMs": 19528.62825000193,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4529291264,
"performanceGrade": "good",
"engine": "chatterbox-tts",
"grade": "good",
"audioSecondsPerSecond": 0.3955679164006732,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hola, esta es una prueba de voz.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.7357518672943115,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.963104+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 6312.739499997406,
"inferenceMs": 6264.004874999955,
"audioSeconds": 2.2,
"realTimeFactor": 2.8472749431817976,
"seed": 42,
"voiceMode": "reference",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.033110324293375015,
"peak": 0.3247736692428589,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9182937088,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 11929.695417002222,
"totalMs": 18242.434916999628,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4529291264,
"performanceGrade": "good",
"engine": "chatterbox-tts",
"grade": "good",
"audioSecondsPerSecond": 0.35121300891388846,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hello, this is a local speech synthesis test.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.577829897403717,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.964059+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 6639.387709001312,
"inferenceMs": 6623.728000002302,
"audioSeconds": 3.32,
"realTimeFactor": 1.9950987951814163,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.09951025247573853,
"peak": 0.9306827783584595,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9185034240,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 11929.695417002222,
"totalMs": 18569.083126003534,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4529291264,
"performanceGrade": "good",
"engine": "chatterbox-tts",
"grade": "good",
"audioSecondsPerSecond": 0.501228311307295,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hello, this is a local speech synthesis test.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.577829897403717,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.964690+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 6401.477457999135,
"inferenceMs": 6385.374292000051,
"audioSeconds": 3.32,
"realTimeFactor": 1.9233055096385698,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.09951025247573853,
"peak": 0.9306827783584595,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9185034240,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 11929.695417002222,
"totalMs": 18331.172875001357,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4529291264,
"performanceGrade": "good",
"engine": "chatterbox-tts",
"grade": "good",
"audioSecondsPerSecond": 0.5199381975398809,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hello, this is a local speech synthesis test.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.577829897403717,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.965264+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 9332.807041999331,
"inferenceMs": 9313.795750000281,
"audioSeconds": 3.32,
"realTimeFactor": 2.8053601656627354,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.09951025247573853,
"peak": 0.9306827783584595,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9185034240,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 11929.695417002222,
"totalMs": 21262.502459001553,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4529291264,
"performanceGrade": "good",
"engine": "chatterbox-tts",
"grade": "good",
"audioSecondsPerSecond": 0.3564604688695154,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hello, this is a local speech synthesis test.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.577829897403717,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.965829+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 9347.76737500215,
"inferenceMs": 9331.241791998764,
"audioSeconds": 3.32,
"realTimeFactor": 2.8106149975899894,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.09951025247573853,
"peak": 0.9306827783584595,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9185034240,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 11929.695417002222,
"totalMs": 21277.46279200437,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4529291264,
"performanceGrade": "good",
"engine": "chatterbox-tts",
"grade": "good",
"audioSecondsPerSecond": 0.3557940169171044,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hello, this is a local speech synthesis test.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.577829897403717,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.966413+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 10082.314166000288,
"inferenceMs": 10066.106291000324,
"audioSeconds": 3.32,
"realTimeFactor": 3.031959726204917,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.09951025247573853,
"peak": 0.9306827783584595,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9185034240,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 11929.695417002222,
"totalMs": 22012.00958300251,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4529291264,
"performanceGrade": "acceptable",
"engine": "chatterbox-tts",
"grade": "acceptable",
"audioSecondsPerSecond": 0.32981968439656456,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hello, this is a local speech synthesis test.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.577829897403717,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.966994+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 10772.990333000052,
"inferenceMs": 10751.09424999755,
"audioSeconds": 3.32,
"realTimeFactor": 3.238281400601672,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.09951025247573853,
"peak": 0.9306827783584595,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9038102528,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 13865.599500000826,
"totalMs": 24638.58983300088,
"initReuse": false,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4699602944,
"performanceGrade": "acceptable",
"engine": "chatterbox-tts",
"grade": "acceptable",
"audioSecondsPerSecond": 0.30880577574703677,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "The meeting starts at 9:30. Please bring three notebooks.",
"metric": "wordErrorRate",
"errorRate": 0.2,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.5202886462211609,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.967648+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 12762.80379200034,
"inferenceMs": 12739.659250000841,
"audioSeconds": 3.12,
"realTimeFactor": 4.083224118590013,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.11682448536157608,
"peak": 0.8752297163009644,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9067413504,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 13865.599500000826,
"totalMs": 26628.403292001167,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4699602944,
"performanceGrade": "acceptable",
"engine": "chatterbox-tts",
"grade": "acceptable",
"audioSecondsPerSecond": 0.2449045095142395,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hello, this is a local speech synthesis test.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.7841492295265198,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.968272+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 13039.415833998646,
"inferenceMs": 12970.430208002654,
"audioSeconds": 3.04,
"realTimeFactor": 4.266588884211399,
"seed": 42,
"voiceMode": "reference",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.028858361765742302,
"peak": 0.3309638202190399,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9102295040,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 13865.599500000826,
"totalMs": 26905.015333999472,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4699602944,
"performanceGrade": "acceptable",
"engine": "chatterbox-tts",
"grade": "acceptable",
"audioSecondsPerSecond": 0.2343792727957739,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hola, esta es una prueba de voz.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.4228832721710205,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.968853+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 6377.454583001963,
"inferenceMs": 6364.350957999704,
"audioSeconds": 2.32,
"realTimeFactor": 2.7432547232757347,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.1399175524711609,
"peak": 0.8493221998214722,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9128656896,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 13865.599500000826,
"totalMs": 20243.05408300279,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4699602944,
"performanceGrade": "good",
"engine": "chatterbox-tts",
"grade": "good",
"audioSecondsPerSecond": 0.3645304942028478,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Bonjour, Ceci est un test de synthèse vocale.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.49774327874183655,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.969458+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 7218.576250001206,
"inferenceMs": 7203.765916998236,
"audioSeconds": 3,
"realTimeFactor": 2.4012553056660786,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.12023390829563141,
"peak": 0.9020614624023438,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9156870144,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 13865.599500000826,
"totalMs": 21084.175750002032,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4699602944,
"performanceGrade": "good",
"engine": "chatterbox-tts",
"grade": "good",
"audioSecondsPerSecond": 0.4164488455852104,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hola, esta es una prueba de voz.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.7357518672943115,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.970049+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 6009.385875000589,
"inferenceMs": 5959.751624999626,
"audioSeconds": 2.2,
"realTimeFactor": 2.7089780113634663,
"seed": 42,
"voiceMode": "reference",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.033110324293375015,
"peak": 0.3247736692428589,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9182937088,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 13865.599500000826,
"totalMs": 19874.985375001415,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4699602944,
"performanceGrade": "good",
"engine": "chatterbox-tts",
"grade": "good",
"audioSecondsPerSecond": 0.3691429003134234,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hello, this is a local speech synthesis test.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.577829897403717,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.970648+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 6506.637167000008,
"inferenceMs": 6490.405584001564,
"audioSeconds": 3.32,
"realTimeFactor": 1.9549414409643266,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.09951025247573853,
"peak": 0.9306827783584595,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9185034240,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 13865.599500000826,
"totalMs": 20372.236667000834,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4699602944,
"performanceGrade": "good",
"engine": "chatterbox-tts",
"grade": "good",
"audioSecondsPerSecond": 0.5115242733341023,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hello, this is a local speech synthesis test.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.577829897403717,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.971220+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 8833.460875001037,
"inferenceMs": 8816.811541997595,
"audioSeconds": 3.32,
"realTimeFactor": 2.6556661271077093,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.09951025247573853,
"peak": 0.9306827783584595,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9185034240,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 13865.599500000826,
"totalMs": 22699.060375001864,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4699602944,
"performanceGrade": "good",
"engine": "chatterbox-tts",
"grade": "good",
"audioSecondsPerSecond": 0.37655335879480517,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hello, this is a local speech synthesis test.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.577829897403717,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.971826+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 9451.99345799847,
"inferenceMs": 9435.7496670018,
"audioSeconds": 3.32,
"realTimeFactor": 2.8420932731933135,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.09951025247573853,
"peak": 0.9306827783584595,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9185034240,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 13865.599500000826,
"totalMs": 23317.592957999295,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4699602944,
"performanceGrade": "good",
"engine": "chatterbox-tts",
"grade": "good",
"audioSecondsPerSecond": 0.35185333621243964,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hello, this is a local speech synthesis test.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.577829897403717,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.972407+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 9151.975082997524,
"inferenceMs": 9136.381249998522,
"audioSeconds": 3.32,
"realTimeFactor": 2.7519220632525667,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.09951025247573853,
"peak": 0.9306827783584595,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9185034240,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 13865.599500000826,
"totalMs": 23017.57458299835,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4699602944,
"performanceGrade": "good",
"engine": "chatterbox-tts",
"grade": "good",
"audioSecondsPerSecond": 0.36338238402655726,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hello, this is a local speech synthesis test.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.577829897403717,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.972983+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 9120.517250001285,
"inferenceMs": 9104.256999999052,
"audioSeconds": 3.32,
"realTimeFactor": 2.742246084337064,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.09951025247573853,
"peak": 0.9306827783584595,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9185034240,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 13865.599500000826,
"totalMs": 22986.11675000211,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4699602944,
"performanceGrade": "good",
"engine": "chatterbox-tts",
"grade": "good",
"audioSecondsPerSecond": 0.36466457394605023,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hello, this is a local speech synthesis test.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.577829897403717,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.973557+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 9296.401916999457,
"inferenceMs": 9278.146667002147,
"audioSeconds": 3.32,
"realTimeFactor": 2.794622490060888,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.09951025247573853,
"peak": 0.9306827783584595,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9038102528,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 14436.594375001732,
"totalMs": 23732.99629200119,
"initReuse": false,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4591222784,
"performanceGrade": "good",
"engine": "chatterbox-tts",
"grade": "good",
"audioSecondsPerSecond": 0.35783008386875625,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "The meeting starts at 9:30. Please bring three notebooks.",
"metric": "wordErrorRate",
"errorRate": 0.2,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.5202886462211609,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.974149+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 6970.175250000466,
"inferenceMs": 6954.817750000075,
"audioSeconds": 3.12,
"realTimeFactor": 2.229108253205152,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.11682448536157608,
"peak": 0.8752297163009644,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9067413504,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 14436.594375001732,
"totalMs": 21406.769625002198,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4591222784,
"performanceGrade": "good",
"engine": "chatterbox-tts",
"grade": "good",
"audioSecondsPerSecond": 0.44860988629068915,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hello, this is a local speech synthesis test.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.7841492295265198,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.974765+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 7790.901540996856,
"inferenceMs": 7738.773250002851,
"audioSeconds": 3.04,
"realTimeFactor": 2.5456490953956745,
"seed": 42,
"voiceMode": "reference",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.028858361765742302,
"peak": 0.3309638202190399,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9106489344,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 14436.594375001732,
"totalMs": 22227.49591599859,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4591222784,
"performanceGrade": "good",
"engine": "chatterbox-tts",
"grade": "good",
"audioSecondsPerSecond": 0.39282711894923145,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hola, esta es una prueba de voz.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.4228832721710205,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.975384+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 5864.892166999198,
"inferenceMs": 5851.9009170013305,
"audioSeconds": 2.32,
"realTimeFactor": 2.522371084914367,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.1399175524711609,
"peak": 0.8493221998214722,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9132851200,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 14436.594375001732,
"totalMs": 20301.48654200093,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4591222784,
"performanceGrade": "good",
"engine": "chatterbox-tts",
"grade": "good",
"audioSecondsPerSecond": 0.3964523721274538,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Bonjour, Ceci est un test de synthèse vocale.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.49774327874183655,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.975995+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 7014.547999999195,
"inferenceMs": 6998.86725000033,
"audioSeconds": 3,
"realTimeFactor": 2.33295575000011,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.12023390829563141,
"peak": 0.9020614624023438,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9163161600,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 14436.594375001732,
"totalMs": 21451.142375000927,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4591222784,
"performanceGrade": "good",
"engine": "chatterbox-tts",
"grade": "good",
"audioSecondsPerSecond": 0.42864079183668735,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hola, esta es una prueba de voz.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.7357518672943115,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.976601+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 5933.50945900238,
"inferenceMs": 5883.3488340023905,
"audioSeconds": 2.2,
"realTimeFactor": 2.6742494700010866,
"seed": 42,
"voiceMode": "reference",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.033110324293375015,
"peak": 0.3247736692428589,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9189228544,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 14436.594375001732,
"totalMs": 20370.103834004112,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4591222784,
"performanceGrade": "good",
"engine": "chatterbox-tts",
"grade": "good",
"audioSecondsPerSecond": 0.37393669185231015,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hello, this is a local speech synthesis test.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.577829897403717,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.977384+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 8109.675749998132,
"inferenceMs": 8094.165583002905,
"audioSeconds": 3.32,
"realTimeFactor": 2.438001681627381,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.09951025247573853,
"peak": 0.9306827783584595,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9185034240,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 14436.594375001732,
"totalMs": 22546.270124999864,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4591222784,
"performanceGrade": "good",
"engine": "chatterbox-tts",
"grade": "good",
"audioSecondsPerSecond": 0.41017198943541905,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hello, this is a local speech synthesis test.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.577829897403717,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.978112+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 6724.580250000145,
"inferenceMs": 6707.832583000709,
"audioSeconds": 3.32,
"realTimeFactor": 2.020431500903828,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.09951025247573853,
"peak": 0.9306827783584595,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9185034240,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 14436.594375001732,
"totalMs": 21161.174625001877,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4591222784,
"performanceGrade": "good",
"engine": "chatterbox-tts",
"grade": "good",
"audioSecondsPerSecond": 0.4949437778774761,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hello, this is a local speech synthesis test.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.577829897403717,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.978764+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 8963.364167000691,
"inferenceMs": 8947.375874999125,
"audioSeconds": 3.32,
"realTimeFactor": 2.6949927334334713,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.09951025247573853,
"peak": 0.9306827783584595,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9185034240,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 14436.594375001732,
"totalMs": 23399.958542002423,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4591222784,
"performanceGrade": "good",
"engine": "chatterbox-tts",
"grade": "good",
"audioSecondsPerSecond": 0.3710585144049651,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hello, this is a local speech synthesis test.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.577829897403717,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.979394+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 9165.169583000534,
"inferenceMs": 9149.020249999012,
"audioSeconds": 3.32,
"realTimeFactor": 2.755728990963558,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.09951025247573853,
"peak": 0.9306827783584595,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9185034240,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 14436.594375001732,
"totalMs": 23601.763958002266,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4591222784,
"performanceGrade": "good",
"engine": "chatterbox-tts",
"grade": "good",
"audioSecondsPerSecond": 0.36288038601732886,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hello, this is a local speech synthesis test.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.577829897403717,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.980001+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 9036.908457997924,
"inferenceMs": 9020.83287500136,
"audioSeconds": 3.32,
"realTimeFactor": 2.7171183358437836,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"mps:0": 292
},
"s3gen": {
"mps:0": 2122
},
"ve": {
"mps:0": 16
}
},
"rms": 0.09951025247573853,
"peak": 0.9306827783584595,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"driverAllocatedMemoryBytes": 9185034240,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 14436.594375001732,
"totalMs": 23473.502832999657,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 4591222784,
"performanceGrade": "good",
"engine": "chatterbox-tts",
"grade": "good",
"audioSecondsPerSecond": 0.3680369702004372,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hello. This is a local speech synthesis test.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.5766565799713135,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.981552+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 11375.838709001982,
"inferenceMs": 11359.081375001551,
"audioSeconds": 3.08,
"realTimeFactor": 3.688013433442062,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"cpu": 292
},
"s3gen": {
"cpu": 2122
},
"ve": {
"cpu": 16
}
},
"rms": 0.118342325091362,
"peak": 0.6355761289596558,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 14120.21787499907,
"totalMs": 25496.056584001053,
"initReuse": false,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 6968475648,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"performanceGrade": "acceptable",
"engine": "chatterbox-tts",
"grade": "acceptable",
"audioSecondsPerSecond": 0.27114868696849875,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"transcript": "The meeting starts at 9:30. Please bring free notebooks.",
"metric": "wordErrorRate",
"errorRate": 0.3,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.5161579847335815,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.981752+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 10815.8710409989,
"inferenceMs": 10800.798166997993,
"audioSeconds": 2.88,
"realTimeFactor": 3.7502771413187475,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"cpu": 292
},
"s3gen": {
"cpu": 2122
},
"ve": {
"cpu": 16
}
},
"rms": 0.11960388720035553,
"peak": 0.9257550239562988,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 14120.21787499907,
"totalMs": 24936.08891599797,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 6968475648,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"performanceGrade": "acceptable",
"engine": "chatterbox-tts",
"grade": "acceptable",
"audioSecondsPerSecond": 0.2666469602959423,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "fail",
"quality": {
"passed": false,
"transcript": "Hello, this is a local speech synthesis test.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.7722642421722412,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:36.981923+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 17689.037500000268,
"inferenceMs": 17633.481666998705,
"audioSeconds": 3.04,
"realTimeFactor": 5.8004873904601,
"seed": 42,
"voiceMode": "reference",
"placement": {
"t3": {
"cpu": 292
},
"s3gen": {
"cpu": 2122
},
"ve": {
"cpu": 16
}
},
"rms": 0.02826353907585144,
"peak": 0.27316316962242126,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 14120.21787499907,
"totalMs": 31809.25537499934,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 6968475648,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"performanceGrade": "slow",
"engine": "chatterbox-tts",
"grade": "slow",
"audioSecondsPerSecond": 0.17239930590051314,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "fail",
"quality": {
"passed": false,
"transcript": "Hola, esta es una prueba de voz.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.44670596718788147,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:37.078805+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 18170.535916000517,
"inferenceMs": 18153.540833001898,
"audioSeconds": 2.24,
"realTimeFactor": 8.104259300447275,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"cpu": 292
},
"s3gen": {
"cpu": 2122
},
"ve": {
"cpu": 16
}
},
"rms": 0.13252225518226624,
"peak": 0.9293292164802551,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 14120.21787499907,
"totalMs": 32290.753790999588,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 6968475648,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"performanceGrade": "slow",
"engine": "chatterbox-tts",
"grade": "slow",
"audioSecondsPerSecond": 0.12339190577784324,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "fail",
"quality": {
"passed": false,
"transcript": "Bonjour. Ceci est un test de synthèse vocale.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.5150325894355774,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:37.079241+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 20956.80116600124,
"inferenceMs": 20940.608832999715,
"audioSeconds": 3.12,
"realTimeFactor": 6.7117336003204215,
"seed": 42,
"voiceMode": "built-in",
"placement": {
"t3": {
"cpu": 292
},
"s3gen": {
"cpu": 2122
},
"ve": {
"cpu": 16
}
},
"rms": 0.11220623552799225,
"peak": 0.998170793056488,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 14120.21787499907,
"totalMs": 35077.01904100031,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 6968475648,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"performanceGrade": "slow",
"engine": "chatterbox-tts",
"grade": "slow",
"audioSecondsPerSecond": 0.14899280268696294,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"transcript": "Hola, esta es una prueba de voz.",
"metric": "wordErrorRate",
"errorRate": 0,
"maximumErrorRate": 0.35,
"repetitive": false,
"speakerCosineDiagnostic": 0.7209261655807495,
"speakerIdentityCertified": false,
"evaluatedAt": "2026-11-06T18:56:37.174806+00:00",
"evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
},
"runtime": {
"durationMs": 8580.21779200135,
"inferenceMs": 8530.776999999944,
"audioSeconds": 2.24,
"realTimeFactor": 3.8083825892856886,
"seed": 42,
"voiceMode": "reference",
"placement": {
"t3": {
"cpu": 292
},
"s3gen": {
"cpu": 2122
},
"ve": {
"cpu": 16
}
},
"rms": 0.03092443384230137,
"peak": 0.28608158230781555,
"clippedFraction": 0,
"watermark": "Resemble Perth applied by official runtime",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"loadMs": 14120.21787499907,
"totalMs": 22700.43566700042,
"initReuse": true,
"version": "0.1.7",
"artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
"peakHelperRssBytes": 6968475648,
"memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
"performanceGrade": "acceptable",
"engine": "chatterbox-tts",
"grade": "acceptable",
"audioSecondsPerSecond": 0.2625786607714649,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"fallback": false
}
}
]Release validation still required
- Complete public B2 dependency closure pending
- Separate original-model and runtime/package-source outage acceptance pending