A model is still running

A model is still running or downloading. Leaving will stop the current operation. Stay on this page to let it finish.

Skip to content
LocalAI.toolsBeta

Join the waitlist

Get an email when the new apps and model runs launch.

No account needed.

Back to models

Chatterbox Multilingual V2 Desktop

Generate English, Spanish or French speech from text, optionally conditioned on a reference WAV. Returns mono24kHz WAV with official Perth watermark.

Desktop inferencePrivate · Runs on your computer
About this model

Generate English, Spanish or French speech from text, optionally conditioned on a reference WAV. Returns mono24kHz WAV with official Perth watermark.

Created by
Resemble AI
License
MIT
Model released
Sep 23, 2025
Source repository created
Apr 24, 2025
Model weights · FP32
3.2 GB

Best for

  • Local short-text offline narration
  • Reference-conditioned speech experiments with authorized synthetic/reference audio

Keep in mind

  • Names, numbers, punctuation, unfamiliar words and paralinguistic tags may be mispronounced or produce unexpected sounds.
  • Long or repetitive text may skip or repeat words; this adapter limits input to 400 characters.
  • Review generated speech; do not use outputs as authoritative safety-critical instructions.
  • The app downloads its own pinned CPython and isolated packages on request; installed Python, user packages and Python/pip configuration are not used. Automatic model-package provisioning is verified on Apple Silicon Mac; other platform stacks remain unverified.
  • Windows/Intel Mac/older macOS coverage and broad perceptual quality tests remain unverified.
  • Reference conditioning approximates a supplied voice; tests use synthetic audio and do not certify speaker identity fidelity.
  • Quality scope is the authored short-text suite for the declared language selections; not broad text/language, perceptual naturalness, accent/dialect or speaker identity certification.
  • Speech generation is offline narration speed, not realtime streaming. CPU preprocessing and Perth watermarking remain.
  • Accepted reference WAVs are6–30seconds; the pinned runtime uses the first6seconds for encoder conditioning and up to10seconds for decoder reference, following upstream behavior.
  • V2 upstream23language capability is separate from this implementation: only independently tested English/Spanish/French selections are enabled.
  • CPU speed scope: select cpuThreads=8 for the retained multilingual/reference suite (RTF below 5). Four-thread reference, Spanish and French cases exceeded RTF 5 despite correct transcripts. CPU fallback is not guaranteed to meet that speed gate for every thread count.

Processed on your deviceYour input is processed locally in the desktop app. Model and runtime files download from external hosts.

Target platforms · verification required

  • macos · aarch64, x86_64
  • windows · x86_64

Recommended configuration

FP32 · mps (verified platform only)

Sources & technical details
Original model
https://huggingface.co/ResembleAI/chatterbox
Release verification
Verified
Release evidence
Official immutable Multilingual V2 update explicitly publishes this checkpoint.
Source updated
Jun 10, 2026
Native model files
https://huggingface.co/ResembleAI/chatterbox
Files updated
Jun 10, 2026
Artifact revision
5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18

Desktop app

Sample result

Chatterbox Multilingual V2 Desktop

Run Chatterbox Multilingual V2 Desktop on your computer

Download the desktop app to load this model, provide input and view results locally.

Public desktop downloads are coming soon.

Device requirements

macOS Apple SiliconCPU / FP32Tested16.0 GiBRAM estimate
macOS Apple SiliconMPS / FP32Tested16.0 GiBRAM estimate
Windows Intel / AMDCPU / FP32Unverified16.0 GiBRAM estimate
macOS Intel / AMDCPU / FP32Unverified16.0 GiBRAM estimate
If your device falls short

MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.

GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.

PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.

Benchmark evidence

Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.

Chatterbox Multilingual V2 Desktop

46 configurations tested
Passed43
Failed3
TestedNov 6, 2026
Runtimechatterbox-tts 0.1.7

Quality criteria

{ "scope": "Frozen authored language/mode suite; complete waveform, independent ASR agreement, no repetition, RTF<=5 offline narration. Not subjective voice/locale identity certification.", "cases": [ { "id": "short", "label": "Short speech", "text": "Hello. This is a local speech synthesis test.", "language": "en", "reference": false, "source": "Authored text for reproducible local synthesis; public-domain test text", "referenceFile": null, "referenceSha256": null }, { "id": "numbers", "label": "Numbers and instructions", "text": "The meeting starts at nine thirty. Please bring three notebooks.", "language": "en", "reference": false, "source": "Authored text for reproducible local synthesis; public-domain test text", "referenceFile": null, "referenceSha256": null }, { "id": "reference", "label": "Reference voice", "text": "Hello. This is a local speech synthesis test.", "language": "en", "reference": true, "source": "Authored text for reproducible local synthesis; public-domain test text", "referenceFile": "model-samples/desktop/chatterbox-reference-input.wav", "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe" }, { "id": "spanish", "label": "Spanish speech", "text": "Hola. Esta es una prueba de voz.", "language": "es", "reference": false, "source": "Authored text for reproducible local synthesis; public-domain test text", "referenceFile": null, "referenceSha256": null }, { "id": "french", "label": "French speech", "text": "Bonjour. Ceci est un test de synthèse vocale.", "language": "fr", "reference": false, "source": "Authored text for reproducible local synthesis; public-domain test text", "referenceFile": null, "referenceSha256": null }, { "id": "spanish-reference", "label": "Spanish reference voice", "text": "Hola. Esta es una prueba de voz.", "language": "es", "reference": true, "source": "Authored text for reproducible local synthesis; public-domain test text", "referenceFile": "model-samples/desktop/chatterbox-reference-input.wav", "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe" } ], "maximumWordErrorRate": 0.35, "maximumChineseCharacterErrorRate": 0.25, "maximumHindiCharacterErrorRate": 0.35, "maximumRealTimeFactor": 5 }

PrecisionDeviceResultPlatformInference / loadTask metric
FP32mpsAcceleratedPassedFastmacos · aarch646385 ms / 11930 ms1.923 RTF
FP32mpsAcceleratedPassedFastmacos · aarch646490 ms / 13866 ms1.955 RTF
FP32mpsAcceleratedPassedFastmacos · aarch646624 ms / 11930 ms1.995 RTF
FP32mpsAcceleratedPassedFastmacos · aarch646708 ms / 14437 ms2.020 RTF
FP32mpsAcceleratedPassedFastmacos · aarch646955 ms / 14437 ms2.229 RTF
FP32mpsAcceleratedPassedFastmacos · aarch646990 ms / 11930 ms2.240 RTF
FP32mpsAcceleratedPassedFastmacos · aarch646999 ms / 14437 ms2.333 RTF
FP32mpsAcceleratedPassedFastmacos · aarch647204 ms / 13866 ms2.401 RTF
FP32mpsAcceleratedPassedFastmacos · aarch648094 ms / 14437 ms2.438 RTF
FP32mpsAcceleratedPassedFastmacos · aarch645852 ms / 14437 ms2.522 RTF
FP32mpsAcceleratedPassedFastmacos · aarch647584 ms / 11930 ms2.528 RTF
FP32mpsAcceleratedPassedFastmacos · aarch647739 ms / 14437 ms2.546 RTF
FP32mpsAcceleratedPassedFastmacos · aarch648817 ms / 13866 ms2.656 RTF
FP32mpsAcceleratedPassedFastmacos · aarch645883 ms / 14437 ms2.674 RTF
FP32mpsAcceleratedPassedFastmacos · aarch648947 ms / 14437 ms2.695 RTF
FP32mpsAcceleratedPassedFastmacos · aarch645960 ms / 13866 ms2.709 RTF
FP32mpsAcceleratedPassedFastmacos · aarch648253 ms / 11930 ms2.715 RTF
FP32mpsAcceleratedPassedFastmacos · aarch649021 ms / 14437 ms2.717 RTF
FP32mpsAcceleratedPassedFastmacos · aarch649104 ms / 13866 ms2.742 RTF
FP32mpsAcceleratedPassedFastmacos · aarch646364 ms / 13866 ms2.743 RTF
FP32mpsAcceleratedPassedFastmacos · aarch649136 ms / 13866 ms2.752 RTF
FP32mpsAcceleratedPassedFastmacos · aarch649149 ms / 14437 ms2.756 RTF
FP32mpsAcceleratedPassedFastmacos · aarch649278 ms / 14437 ms2.795 RTF
FP32mpsAcceleratedPassedFastmacos · aarch649314 ms / 11930 ms2.805 RTF
FP32mpsAcceleratedPassedFastmacos · aarch649331 ms / 11930 ms2.811 RTF
FP32mpsAcceleratedPassedFastmacos · aarch649436 ms / 13866 ms2.842 RTF
FP32mpsAcceleratedPassedFastmacos · aarch646264 ms / 11930 ms2.847 RTF
FP32mpsAcceleratedPassedFastmacos · aarch646918 ms / 11930 ms2.982 RTF
FP32mpsAcceleratedPassedModeratemacos · aarch6410066 ms / 11930 ms3.032 RTF
FP32mpsAcceleratedPassedModeratemacos · aarch6410073 ms / 11930 ms3.034 RTF
FP32mpsAcceleratedPassedModeratemacos · aarch6410751 ms / 13866 ms3.238 RTF
FP32mpsAcceleratedPassedModeratemacos · aarch6412740 ms / 13866 ms4.083 RTF
FP32mpsAcceleratedPassedModeratemacos · aarch6412970 ms / 13866 ms4.267 RTF
FP32cpuPassedModeratemacos · aarch6410825 ms / 12107 ms3.470 RTF
FP32cpuPassedModeratemacos · aarch647794 ms / 12107 ms3.480 RTF
FP32cpuPassedModeratemacos · aarch6411271 ms / 12107 ms3.659 RTF
FP32cpuPassedModeratemacos · aarch6411359 ms / 14120 ms3.688 RTF
FP32cpuPassedModeratemacos · aarch6410801 ms / 14120 ms3.750 RTF
FP32cpuPassedModeratemacos · aarch648456 ms / 12107 ms3.775 RTF
FP32cpuPassedModeratemacos · aarch6410884 ms / 12107 ms3.779 RTF
FP32cpuPassedModeratemacos · aarch648531 ms / 14120 ms3.808 RTF
FP32cpuPassedModeratemacos · aarch6412605 ms / 12107 ms4.146 RTF
FP32cpuPassedModeratemacos · aarch6415186 ms / 18790 ms4.931 RTF
FP32cpuFailed—macos · aarch6417633 ms / 14120 ms5.800 RTF
FP32cpuFailed—macos · aarch6418154 ms / 14120 ms8.104 RTF
FP32cpuFailed—macos · aarch6420941 ms / 14120 ms6.712 RTF
Test setup & sample details
Quality gate
{ "scope": "Frozen authored language/mode suite; complete waveform, independent ASR agreement, no repetition, RTF<=5 offline narration. Not subjective voice/locale identity certification.", "cases": [ { "id": "short", "label": "Short speech", "text": "Hello. This is a local speech synthesis test.", "language": "en", "reference": false, "source": "Authored text for reproducible local synthesis; public-domain test text", "referenceFile": null, "referenceSha256": null }, { "id": "numbers", "label": "Numbers and instructions", "text": "The meeting starts at nine thirty. Please bring three notebooks.", "language": "en", "reference": false, "source": "Authored text for reproducible local synthesis; public-domain test text", "referenceFile": null, "referenceSha256": null }, { "id": "reference", "label": "Reference voice", "text": "Hello. This is a local speech synthesis test.", "language": "en", "reference": true, "source": "Authored text for reproducible local synthesis; public-domain test text", "referenceFile": "model-samples/desktop/chatterbox-reference-input.wav", "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe" }, { "id": "spanish", "label": "Spanish speech", "text": "Hola. Esta es una prueba de voz.", "language": "es", "reference": false, "source": "Authored text for reproducible local synthesis; public-domain test text", "referenceFile": null, "referenceSha256": null }, { "id": "french", "label": "French speech", "text": "Bonjour. Ceci est un test de synthèse vocale.", "language": "fr", "reference": false, "source": "Authored text for reproducible local synthesis; public-domain test text", "referenceFile": null, "referenceSha256": null }, { "id": "spanish-reference", "label": "Spanish reference voice", "text": "Hola. Esta es una prueba de voz.", "language": "es", "reference": true, "source": "Authored text for reproducible local synthesis; public-domain test text", "referenceFile": "model-samples/desktop/chatterbox-reference-input.wav", "referenceSha256": "a890ca57ba62dc2159b6139e77d3c821a790db3813cb8cb4f0bab9ecee5177fe" } ], "maximumWordErrorRate": 0.35, "maximumChineseCharacterErrorRate": 0.25, "maximumHindiCharacterErrorRate": 0.35, "maximumRealTimeFactor": 5 }
Tested
2026-11-06T18:47:28.176753+00:00
Environment
{ "os": "macos", "arch": "aarch64", "hardware": "Apple M3 Max", "runtimeProvisioning": "App-owned CPython3.13.18; model-owned pinned packages", "concurrentUploads": true, "concurrentActivity": "Background source/backup transfers active; synthesis/ASR/builds run sequentially", "measurementScope": "Apple M3 Max/macOS27.2 current-device scope; private seeded local-cache loads are not network-download benchmarks" }
Runtime
chatterbox-tts 0.1.7
Artifact revision
5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18
Fixture
{
  "file": "model-samples/desktop/chatterbox-multilingual-family/v2-short-input.json",
  "size": 210,
  "sha1": "f3a85e4a376c7206afbdcf3dc4c22285d3471bae",
  "sha256": "340f4333ceb6314b66737590e92755ab95dc01e61122b774b8e75c97681285bc",
  "url": "https://assets.localai.tools/samples/v1/files/340f4333ceb6314b66737590e92755ab95dc01e61122b774b8e75c97681285bc/v2-short-input.json"
}
Rerun when
artifact revision or required file integrity; runtime/helper/model/processor/decoder semantics; fixture/config/checksum or quality gate; relevant backend/OS behavior
Per-case quality & failure details
[
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hello. This is a local speech synthesis test.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.5766565799713135,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:35.703157+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 15229.973666999285,
      "inferenceMs": 15186.179583997728,
      "audioSeconds": 3.08,
      "realTimeFactor": 4.930577787012249,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "cpu": 292
        },
        "s3gen": {
          "cpu": 2122
        },
        "ve": {
          "cpu": 16
        }
      },
      "rms": 0.118342325091362,
      "peak": 0.6355761289596558,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 18790.382791998127,
      "totalMs": 34020.35645899741,
      "initReuse": false,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 6594674688,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "performanceGrade": "acceptable",
      "engine": "chatterbox-tts",
      "grade": "acceptable",
      "audioSecondsPerSecond": 0.2028159869283725,
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hello. This is a local speech synthesis test.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.5766565799713135,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:35.704063+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 11286.465082997893,
      "inferenceMs": 11270.644959000492,
      "audioSeconds": 3.08,
      "realTimeFactor": 3.659300311363796,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "cpu": 292
        },
        "s3gen": {
          "cpu": 2122
        },
        "ve": {
          "cpu": 16
        }
      },
      "rms": 0.118342325091362,
      "peak": 0.6355761289596558,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 8,
      "loadMs": 12106.912000002922,
      "totalMs": 23393.377083000814,
      "initReuse": false,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 6511034368,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "performanceGrade": "acceptable",
      "engine": "chatterbox-tts",
      "grade": "acceptable",
      "audioSecondsPerSecond": 0.273276286424086,
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "The meeting starts at 9:30. Please bring free notebooks.",
      "metric": "wordErrorRate",
      "errorRate": 0.3,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.5161579847335815,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:35.823581+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 10899.954083000921,
      "inferenceMs": 10883.645833000628,
      "audioSeconds": 2.88,
      "realTimeFactor": 3.779043692014107,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "cpu": 292
        },
        "s3gen": {
          "cpu": 2122
        },
        "ve": {
          "cpu": 16
        }
      },
      "rms": 0.11960388720035553,
      "peak": 0.9257550239562988,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 8,
      "loadMs": 12106.912000002922,
      "totalMs": 23006.866083003843,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 6511034368,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "performanceGrade": "acceptable",
      "engine": "chatterbox-tts",
      "grade": "acceptable",
      "audioSecondsPerSecond": 0.26461721046337855,
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hello, this is a local speech synthesis test.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.7722642421722412,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:35.937826+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 12662.473749998753,
      "inferenceMs": 12605.21579199849,
      "audioSeconds": 3.04,
      "realTimeFactor": 4.146452563157398,
      "seed": 42,
      "voiceMode": "reference",
      "placement": {
        "t3": {
          "cpu": 292
        },
        "s3gen": {
          "cpu": 2122
        },
        "ve": {
          "cpu": 16
        }
      },
      "rms": 0.02826353907585144,
      "peak": 0.27316316962242126,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 8,
      "loadMs": 12106.912000002922,
      "totalMs": 24769.385750001675,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 6511034368,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "performanceGrade": "acceptable",
      "engine": "chatterbox-tts",
      "grade": "acceptable",
      "audioSecondsPerSecond": 0.24117000852375128,
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hola, esta es una prueba de voz.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.44670432806015015,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.067533+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 7808.177957998851,
      "inferenceMs": 7794.4381660017825,
      "audioSeconds": 2.24,
      "realTimeFactor": 3.4796598955365097,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "cpu": 292
        },
        "s3gen": {
          "cpu": 2122
        },
        "ve": {
          "cpu": 16
        }
      },
      "rms": 0.13252228498458862,
      "peak": 0.9293280243873596,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 8,
      "loadMs": 12106.912000002922,
      "totalMs": 19915.089958001772,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 6511034368,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "performanceGrade": "acceptable",
      "engine": "chatterbox-tts",
      "grade": "acceptable",
      "audioSecondsPerSecond": 0.28738440825286904,
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Bonjour. Ceci est un test de synthèse vocale.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.5150325894355774,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.195575+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 10841.79475000201,
      "inferenceMs": 10825.251209000271,
      "audioSeconds": 3.12,
      "realTimeFactor": 3.469631797756497,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "cpu": 292
        },
        "s3gen": {
          "cpu": 2122
        },
        "ve": {
          "cpu": 16
        }
      },
      "rms": 0.11220623552799225,
      "peak": 0.998170793056488,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 8,
      "loadMs": 12106.912000002922,
      "totalMs": 22948.70675000493,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 6511034368,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "performanceGrade": "acceptable",
      "engine": "chatterbox-tts",
      "grade": "acceptable",
      "audioSecondsPerSecond": 0.2882150205813226,
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hola, esta es una prueba de voz.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.7209250926971436,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.290783+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 8508.216041998821,
      "inferenceMs": 8455.653040997277,
      "audioSeconds": 2.24,
      "realTimeFactor": 3.7748451075880696,
      "seed": 42,
      "voiceMode": "reference",
      "placement": {
        "t3": {
          "cpu": 292
        },
        "s3gen": {
          "cpu": 2122
        },
        "ve": {
          "cpu": 16
        }
      },
      "rms": 0.03092443384230137,
      "peak": 0.2860814332962036,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 8,
      "loadMs": 12106.912000002922,
      "totalMs": 20615.128042001743,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 6511034368,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "performanceGrade": "acceptable",
      "engine": "chatterbox-tts",
      "grade": "acceptable",
      "audioSecondsPerSecond": 0.26491153186387245,
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hello, this is a local speech synthesis test.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.577829897403717,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.402579+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 10090.318624999782,
      "inferenceMs": 10073.302625001816,
      "audioSeconds": 3.32,
      "realTimeFactor": 3.034127296687294,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.09951025247573853,
      "peak": 0.9306827783584595,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9038102528,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 11929.695417002222,
      "totalMs": 22020.014042002003,
      "initReuse": false,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4529291264,
      "performanceGrade": "acceptable",
      "engine": "chatterbox-tts",
      "grade": "acceptable",
      "audioSecondsPerSecond": 0.32958406230741044,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "The meeting starts at 9:30. Please bring three notebooks.",
      "metric": "wordErrorRate",
      "errorRate": 0.2,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.5202886462211609,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.528345+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 7005.092916999274,
      "inferenceMs": 6989.820791000966,
      "audioSeconds": 3.12,
      "realTimeFactor": 2.240327176602874,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.11682448536157608,
      "peak": 0.8752297163009644,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9067413504,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 11929.695417002222,
      "totalMs": 18934.788334001496,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4529291264,
      "performanceGrade": "good",
      "engine": "chatterbox-tts",
      "grade": "good",
      "audioSecondsPerSecond": 0.446363375155031,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hello, this is a local speech synthesis test.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.7841492295265198,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.639077+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 8307.971417001681,
      "inferenceMs": 8253.344667002239,
      "audioSeconds": 3.04,
      "realTimeFactor": 2.7149160088823154,
      "seed": 42,
      "voiceMode": "reference",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.028858361765742302,
      "peak": 0.3309638202190399,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9106489344,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 11929.695417002222,
      "totalMs": 20237.666834003903,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4529291264,
      "performanceGrade": "good",
      "engine": "chatterbox-tts",
      "grade": "good",
      "audioSecondsPerSecond": 0.3683355200412564,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hola, esta es una prueba de voz.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.4228832721710205,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.736851+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 6931.710000000749,
      "inferenceMs": 6918.076000001747,
      "audioSeconds": 2.32,
      "realTimeFactor": 2.981929310345581,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.1399175524711609,
      "peak": 0.8493221998214722,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9132851200,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 11929.695417002222,
      "totalMs": 18861.40541700297,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4529291264,
      "performanceGrade": "good",
      "engine": "chatterbox-tts",
      "grade": "good",
      "audioSecondsPerSecond": 0.3353533554704247,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Bonjour, Ceci est un test de synthèse vocale.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.49774327874183655,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.861687+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 7598.932832999708,
      "inferenceMs": 7584.032667000429,
      "audioSeconds": 3,
      "realTimeFactor": 2.528010889000143,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.12023390829563141,
      "peak": 0.9020614624023438,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9156870144,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 11929.695417002222,
      "totalMs": 19528.62825000193,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4529291264,
      "performanceGrade": "good",
      "engine": "chatterbox-tts",
      "grade": "good",
      "audioSecondsPerSecond": 0.3955679164006732,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hola, esta es una prueba de voz.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.7357518672943115,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.963104+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 6312.739499997406,
      "inferenceMs": 6264.004874999955,
      "audioSeconds": 2.2,
      "realTimeFactor": 2.8472749431817976,
      "seed": 42,
      "voiceMode": "reference",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.033110324293375015,
      "peak": 0.3247736692428589,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9182937088,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 11929.695417002222,
      "totalMs": 18242.434916999628,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4529291264,
      "performanceGrade": "good",
      "engine": "chatterbox-tts",
      "grade": "good",
      "audioSecondsPerSecond": 0.35121300891388846,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hello, this is a local speech synthesis test.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.577829897403717,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.964059+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 6639.387709001312,
      "inferenceMs": 6623.728000002302,
      "audioSeconds": 3.32,
      "realTimeFactor": 1.9950987951814163,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.09951025247573853,
      "peak": 0.9306827783584595,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9185034240,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 11929.695417002222,
      "totalMs": 18569.083126003534,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4529291264,
      "performanceGrade": "good",
      "engine": "chatterbox-tts",
      "grade": "good",
      "audioSecondsPerSecond": 0.501228311307295,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hello, this is a local speech synthesis test.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.577829897403717,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.964690+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 6401.477457999135,
      "inferenceMs": 6385.374292000051,
      "audioSeconds": 3.32,
      "realTimeFactor": 1.9233055096385698,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.09951025247573853,
      "peak": 0.9306827783584595,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9185034240,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 11929.695417002222,
      "totalMs": 18331.172875001357,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4529291264,
      "performanceGrade": "good",
      "engine": "chatterbox-tts",
      "grade": "good",
      "audioSecondsPerSecond": 0.5199381975398809,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hello, this is a local speech synthesis test.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.577829897403717,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.965264+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 9332.807041999331,
      "inferenceMs": 9313.795750000281,
      "audioSeconds": 3.32,
      "realTimeFactor": 2.8053601656627354,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.09951025247573853,
      "peak": 0.9306827783584595,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9185034240,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 11929.695417002222,
      "totalMs": 21262.502459001553,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4529291264,
      "performanceGrade": "good",
      "engine": "chatterbox-tts",
      "grade": "good",
      "audioSecondsPerSecond": 0.3564604688695154,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hello, this is a local speech synthesis test.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.577829897403717,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.965829+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 9347.76737500215,
      "inferenceMs": 9331.241791998764,
      "audioSeconds": 3.32,
      "realTimeFactor": 2.8106149975899894,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.09951025247573853,
      "peak": 0.9306827783584595,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9185034240,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 11929.695417002222,
      "totalMs": 21277.46279200437,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4529291264,
      "performanceGrade": "good",
      "engine": "chatterbox-tts",
      "grade": "good",
      "audioSecondsPerSecond": 0.3557940169171044,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hello, this is a local speech synthesis test.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.577829897403717,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.966413+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 10082.314166000288,
      "inferenceMs": 10066.106291000324,
      "audioSeconds": 3.32,
      "realTimeFactor": 3.031959726204917,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.09951025247573853,
      "peak": 0.9306827783584595,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9185034240,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 11929.695417002222,
      "totalMs": 22012.00958300251,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4529291264,
      "performanceGrade": "acceptable",
      "engine": "chatterbox-tts",
      "grade": "acceptable",
      "audioSecondsPerSecond": 0.32981968439656456,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hello, this is a local speech synthesis test.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.577829897403717,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.966994+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 10772.990333000052,
      "inferenceMs": 10751.09424999755,
      "audioSeconds": 3.32,
      "realTimeFactor": 3.238281400601672,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.09951025247573853,
      "peak": 0.9306827783584595,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9038102528,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 13865.599500000826,
      "totalMs": 24638.58983300088,
      "initReuse": false,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4699602944,
      "performanceGrade": "acceptable",
      "engine": "chatterbox-tts",
      "grade": "acceptable",
      "audioSecondsPerSecond": 0.30880577574703677,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "The meeting starts at 9:30. Please bring three notebooks.",
      "metric": "wordErrorRate",
      "errorRate": 0.2,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.5202886462211609,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.967648+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 12762.80379200034,
      "inferenceMs": 12739.659250000841,
      "audioSeconds": 3.12,
      "realTimeFactor": 4.083224118590013,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.11682448536157608,
      "peak": 0.8752297163009644,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9067413504,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 13865.599500000826,
      "totalMs": 26628.403292001167,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4699602944,
      "performanceGrade": "acceptable",
      "engine": "chatterbox-tts",
      "grade": "acceptable",
      "audioSecondsPerSecond": 0.2449045095142395,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hello, this is a local speech synthesis test.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.7841492295265198,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.968272+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 13039.415833998646,
      "inferenceMs": 12970.430208002654,
      "audioSeconds": 3.04,
      "realTimeFactor": 4.266588884211399,
      "seed": 42,
      "voiceMode": "reference",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.028858361765742302,
      "peak": 0.3309638202190399,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9102295040,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 13865.599500000826,
      "totalMs": 26905.015333999472,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4699602944,
      "performanceGrade": "acceptable",
      "engine": "chatterbox-tts",
      "grade": "acceptable",
      "audioSecondsPerSecond": 0.2343792727957739,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hola, esta es una prueba de voz.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.4228832721710205,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.968853+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 6377.454583001963,
      "inferenceMs": 6364.350957999704,
      "audioSeconds": 2.32,
      "realTimeFactor": 2.7432547232757347,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.1399175524711609,
      "peak": 0.8493221998214722,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9128656896,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 13865.599500000826,
      "totalMs": 20243.05408300279,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4699602944,
      "performanceGrade": "good",
      "engine": "chatterbox-tts",
      "grade": "good",
      "audioSecondsPerSecond": 0.3645304942028478,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Bonjour, Ceci est un test de synthèse vocale.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.49774327874183655,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.969458+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 7218.576250001206,
      "inferenceMs": 7203.765916998236,
      "audioSeconds": 3,
      "realTimeFactor": 2.4012553056660786,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.12023390829563141,
      "peak": 0.9020614624023438,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9156870144,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 13865.599500000826,
      "totalMs": 21084.175750002032,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4699602944,
      "performanceGrade": "good",
      "engine": "chatterbox-tts",
      "grade": "good",
      "audioSecondsPerSecond": 0.4164488455852104,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hola, esta es una prueba de voz.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.7357518672943115,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.970049+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 6009.385875000589,
      "inferenceMs": 5959.751624999626,
      "audioSeconds": 2.2,
      "realTimeFactor": 2.7089780113634663,
      "seed": 42,
      "voiceMode": "reference",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.033110324293375015,
      "peak": 0.3247736692428589,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9182937088,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 13865.599500000826,
      "totalMs": 19874.985375001415,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4699602944,
      "performanceGrade": "good",
      "engine": "chatterbox-tts",
      "grade": "good",
      "audioSecondsPerSecond": 0.3691429003134234,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hello, this is a local speech synthesis test.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.577829897403717,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.970648+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 6506.637167000008,
      "inferenceMs": 6490.405584001564,
      "audioSeconds": 3.32,
      "realTimeFactor": 1.9549414409643266,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.09951025247573853,
      "peak": 0.9306827783584595,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9185034240,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 13865.599500000826,
      "totalMs": 20372.236667000834,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4699602944,
      "performanceGrade": "good",
      "engine": "chatterbox-tts",
      "grade": "good",
      "audioSecondsPerSecond": 0.5115242733341023,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hello, this is a local speech synthesis test.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.577829897403717,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.971220+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 8833.460875001037,
      "inferenceMs": 8816.811541997595,
      "audioSeconds": 3.32,
      "realTimeFactor": 2.6556661271077093,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.09951025247573853,
      "peak": 0.9306827783584595,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9185034240,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 13865.599500000826,
      "totalMs": 22699.060375001864,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4699602944,
      "performanceGrade": "good",
      "engine": "chatterbox-tts",
      "grade": "good",
      "audioSecondsPerSecond": 0.37655335879480517,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hello, this is a local speech synthesis test.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.577829897403717,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.971826+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 9451.99345799847,
      "inferenceMs": 9435.7496670018,
      "audioSeconds": 3.32,
      "realTimeFactor": 2.8420932731933135,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.09951025247573853,
      "peak": 0.9306827783584595,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9185034240,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 13865.599500000826,
      "totalMs": 23317.592957999295,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4699602944,
      "performanceGrade": "good",
      "engine": "chatterbox-tts",
      "grade": "good",
      "audioSecondsPerSecond": 0.35185333621243964,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hello, this is a local speech synthesis test.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.577829897403717,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.972407+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 9151.975082997524,
      "inferenceMs": 9136.381249998522,
      "audioSeconds": 3.32,
      "realTimeFactor": 2.7519220632525667,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.09951025247573853,
      "peak": 0.9306827783584595,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9185034240,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 13865.599500000826,
      "totalMs": 23017.57458299835,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4699602944,
      "performanceGrade": "good",
      "engine": "chatterbox-tts",
      "grade": "good",
      "audioSecondsPerSecond": 0.36338238402655726,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hello, this is a local speech synthesis test.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.577829897403717,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.972983+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 9120.517250001285,
      "inferenceMs": 9104.256999999052,
      "audioSeconds": 3.32,
      "realTimeFactor": 2.742246084337064,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.09951025247573853,
      "peak": 0.9306827783584595,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9185034240,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 13865.599500000826,
      "totalMs": 22986.11675000211,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4699602944,
      "performanceGrade": "good",
      "engine": "chatterbox-tts",
      "grade": "good",
      "audioSecondsPerSecond": 0.36466457394605023,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hello, this is a local speech synthesis test.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.577829897403717,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.973557+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 9296.401916999457,
      "inferenceMs": 9278.146667002147,
      "audioSeconds": 3.32,
      "realTimeFactor": 2.794622490060888,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.09951025247573853,
      "peak": 0.9306827783584595,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9038102528,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 14436.594375001732,
      "totalMs": 23732.99629200119,
      "initReuse": false,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4591222784,
      "performanceGrade": "good",
      "engine": "chatterbox-tts",
      "grade": "good",
      "audioSecondsPerSecond": 0.35783008386875625,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "The meeting starts at 9:30. Please bring three notebooks.",
      "metric": "wordErrorRate",
      "errorRate": 0.2,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.5202886462211609,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.974149+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 6970.175250000466,
      "inferenceMs": 6954.817750000075,
      "audioSeconds": 3.12,
      "realTimeFactor": 2.229108253205152,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.11682448536157608,
      "peak": 0.8752297163009644,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9067413504,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 14436.594375001732,
      "totalMs": 21406.769625002198,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4591222784,
      "performanceGrade": "good",
      "engine": "chatterbox-tts",
      "grade": "good",
      "audioSecondsPerSecond": 0.44860988629068915,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hello, this is a local speech synthesis test.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.7841492295265198,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.974765+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 7790.901540996856,
      "inferenceMs": 7738.773250002851,
      "audioSeconds": 3.04,
      "realTimeFactor": 2.5456490953956745,
      "seed": 42,
      "voiceMode": "reference",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.028858361765742302,
      "peak": 0.3309638202190399,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9106489344,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 14436.594375001732,
      "totalMs": 22227.49591599859,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4591222784,
      "performanceGrade": "good",
      "engine": "chatterbox-tts",
      "grade": "good",
      "audioSecondsPerSecond": 0.39282711894923145,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hola, esta es una prueba de voz.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.4228832721710205,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.975384+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 5864.892166999198,
      "inferenceMs": 5851.9009170013305,
      "audioSeconds": 2.32,
      "realTimeFactor": 2.522371084914367,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.1399175524711609,
      "peak": 0.8493221998214722,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9132851200,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 14436.594375001732,
      "totalMs": 20301.48654200093,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4591222784,
      "performanceGrade": "good",
      "engine": "chatterbox-tts",
      "grade": "good",
      "audioSecondsPerSecond": 0.3964523721274538,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Bonjour, Ceci est un test de synthèse vocale.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.49774327874183655,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.975995+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 7014.547999999195,
      "inferenceMs": 6998.86725000033,
      "audioSeconds": 3,
      "realTimeFactor": 2.33295575000011,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.12023390829563141,
      "peak": 0.9020614624023438,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9163161600,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 14436.594375001732,
      "totalMs": 21451.142375000927,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4591222784,
      "performanceGrade": "good",
      "engine": "chatterbox-tts",
      "grade": "good",
      "audioSecondsPerSecond": 0.42864079183668735,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hola, esta es una prueba de voz.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.7357518672943115,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.976601+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 5933.50945900238,
      "inferenceMs": 5883.3488340023905,
      "audioSeconds": 2.2,
      "realTimeFactor": 2.6742494700010866,
      "seed": 42,
      "voiceMode": "reference",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.033110324293375015,
      "peak": 0.3247736692428589,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9189228544,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 14436.594375001732,
      "totalMs": 20370.103834004112,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4591222784,
      "performanceGrade": "good",
      "engine": "chatterbox-tts",
      "grade": "good",
      "audioSecondsPerSecond": 0.37393669185231015,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hello, this is a local speech synthesis test.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.577829897403717,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.977384+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 8109.675749998132,
      "inferenceMs": 8094.165583002905,
      "audioSeconds": 3.32,
      "realTimeFactor": 2.438001681627381,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.09951025247573853,
      "peak": 0.9306827783584595,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9185034240,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 14436.594375001732,
      "totalMs": 22546.270124999864,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4591222784,
      "performanceGrade": "good",
      "engine": "chatterbox-tts",
      "grade": "good",
      "audioSecondsPerSecond": 0.41017198943541905,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hello, this is a local speech synthesis test.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.577829897403717,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.978112+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 6724.580250000145,
      "inferenceMs": 6707.832583000709,
      "audioSeconds": 3.32,
      "realTimeFactor": 2.020431500903828,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.09951025247573853,
      "peak": 0.9306827783584595,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9185034240,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 14436.594375001732,
      "totalMs": 21161.174625001877,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4591222784,
      "performanceGrade": "good",
      "engine": "chatterbox-tts",
      "grade": "good",
      "audioSecondsPerSecond": 0.4949437778774761,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hello, this is a local speech synthesis test.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.577829897403717,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.978764+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 8963.364167000691,
      "inferenceMs": 8947.375874999125,
      "audioSeconds": 3.32,
      "realTimeFactor": 2.6949927334334713,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.09951025247573853,
      "peak": 0.9306827783584595,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9185034240,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 14436.594375001732,
      "totalMs": 23399.958542002423,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4591222784,
      "performanceGrade": "good",
      "engine": "chatterbox-tts",
      "grade": "good",
      "audioSecondsPerSecond": 0.3710585144049651,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hello, this is a local speech synthesis test.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.577829897403717,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.979394+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 9165.169583000534,
      "inferenceMs": 9149.020249999012,
      "audioSeconds": 3.32,
      "realTimeFactor": 2.755728990963558,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.09951025247573853,
      "peak": 0.9306827783584595,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9185034240,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 14436.594375001732,
      "totalMs": 23601.763958002266,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4591222784,
      "performanceGrade": "good",
      "engine": "chatterbox-tts",
      "grade": "good",
      "audioSecondsPerSecond": 0.36288038601732886,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hello, this is a local speech synthesis test.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.577829897403717,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.980001+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 9036.908457997924,
      "inferenceMs": 9020.83287500136,
      "audioSeconds": 3.32,
      "realTimeFactor": 2.7171183358437836,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "mps:0": 292
        },
        "s3gen": {
          "mps:0": 2122
        },
        "ve": {
          "mps:0": 16
        }
      },
      "rms": 0.09951025247573853,
      "peak": 0.9306827783584595,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "driverAllocatedMemoryBytes": 9185034240,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 14436.594375001732,
      "totalMs": 23473.502832999657,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 4591222784,
      "performanceGrade": "good",
      "engine": "chatterbox-tts",
      "grade": "good",
      "audioSecondsPerSecond": 0.3680369702004372,
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hello. This is a local speech synthesis test.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.5766565799713135,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.981552+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 11375.838709001982,
      "inferenceMs": 11359.081375001551,
      "audioSeconds": 3.08,
      "realTimeFactor": 3.688013433442062,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "cpu": 292
        },
        "s3gen": {
          "cpu": 2122
        },
        "ve": {
          "cpu": 16
        }
      },
      "rms": 0.118342325091362,
      "peak": 0.6355761289596558,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 14120.21787499907,
      "totalMs": 25496.056584001053,
      "initReuse": false,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 6968475648,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "performanceGrade": "acceptable",
      "engine": "chatterbox-tts",
      "grade": "acceptable",
      "audioSecondsPerSecond": 0.27114868696849875,
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "The meeting starts at 9:30. Please bring free notebooks.",
      "metric": "wordErrorRate",
      "errorRate": 0.3,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.5161579847335815,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.981752+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 10815.8710409989,
      "inferenceMs": 10800.798166997993,
      "audioSeconds": 2.88,
      "realTimeFactor": 3.7502771413187475,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "cpu": 292
        },
        "s3gen": {
          "cpu": 2122
        },
        "ve": {
          "cpu": 16
        }
      },
      "rms": 0.11960388720035553,
      "peak": 0.9257550239562988,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 14120.21787499907,
      "totalMs": 24936.08891599797,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 6968475648,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "performanceGrade": "acceptable",
      "engine": "chatterbox-tts",
      "grade": "acceptable",
      "audioSecondsPerSecond": 0.2666469602959423,
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "fail",
    "quality": {
      "passed": false,
      "transcript": "Hello, this is a local speech synthesis test.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.7722642421722412,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:36.981923+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 17689.037500000268,
      "inferenceMs": 17633.481666998705,
      "audioSeconds": 3.04,
      "realTimeFactor": 5.8004873904601,
      "seed": 42,
      "voiceMode": "reference",
      "placement": {
        "t3": {
          "cpu": 292
        },
        "s3gen": {
          "cpu": 2122
        },
        "ve": {
          "cpu": 16
        }
      },
      "rms": 0.02826353907585144,
      "peak": 0.27316316962242126,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 14120.21787499907,
      "totalMs": 31809.25537499934,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 6968475648,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "performanceGrade": "slow",
      "engine": "chatterbox-tts",
      "grade": "slow",
      "audioSecondsPerSecond": 0.17239930590051314,
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "fail",
    "quality": {
      "passed": false,
      "transcript": "Hola, esta es una prueba de voz.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.44670596718788147,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:37.078805+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 18170.535916000517,
      "inferenceMs": 18153.540833001898,
      "audioSeconds": 2.24,
      "realTimeFactor": 8.104259300447275,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "cpu": 292
        },
        "s3gen": {
          "cpu": 2122
        },
        "ve": {
          "cpu": 16
        }
      },
      "rms": 0.13252225518226624,
      "peak": 0.9293292164802551,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 14120.21787499907,
      "totalMs": 32290.753790999588,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 6968475648,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "performanceGrade": "slow",
      "engine": "chatterbox-tts",
      "grade": "slow",
      "audioSecondsPerSecond": 0.12339190577784324,
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "fail",
    "quality": {
      "passed": false,
      "transcript": "Bonjour. Ceci est un test de synthèse vocale.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.5150325894355774,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:37.079241+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 20956.80116600124,
      "inferenceMs": 20940.608832999715,
      "audioSeconds": 3.12,
      "realTimeFactor": 6.7117336003204215,
      "seed": 42,
      "voiceMode": "built-in",
      "placement": {
        "t3": {
          "cpu": 292
        },
        "s3gen": {
          "cpu": 2122
        },
        "ve": {
          "cpu": 16
        }
      },
      "rms": 0.11220623552799225,
      "peak": 0.998170793056488,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 14120.21787499907,
      "totalMs": 35077.01904100031,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 6968475648,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "performanceGrade": "slow",
      "engine": "chatterbox-tts",
      "grade": "slow",
      "audioSecondsPerSecond": 0.14899280268696294,
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "transcript": "Hola, esta es una prueba de voz.",
      "metric": "wordErrorRate",
      "errorRate": 0,
      "maximumErrorRate": 0.35,
      "repetitive": false,
      "speakerCosineDiagnostic": 0.7209261655807495,
      "speakerIdentityCertified": false,
      "evaluatedAt": "2026-11-06T18:56:37.174806+00:00",
      "evaluator": "Qwen3-ASR0.6B MLX4bit revision313d850181767edf09f00a9c289becca70e58cd0 / mlx-audio0.6.3+mlx0.32.4, Resemblyzer0.1.4 CPU speaker diagnostic"
    },
    "runtime": {
      "durationMs": 8580.21779200135,
      "inferenceMs": 8530.776999999944,
      "audioSeconds": 2.24,
      "realTimeFactor": 3.8083825892856886,
      "seed": 42,
      "voiceMode": "reference",
      "placement": {
        "t3": {
          "cpu": 292
        },
        "s3gen": {
          "cpu": 2122
        },
        "ve": {
          "cpu": 16
        }
      },
      "rms": 0.03092443384230137,
      "peak": 0.28608158230781555,
      "clippedFraction": 0,
      "watermark": "Resemble Perth applied by official runtime",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "loadMs": 14120.21787499907,
      "totalMs": 22700.43566700042,
      "initReuse": true,
      "version": "0.1.7",
      "artifactRevision": "5bb1f6ee58e50c3b8d408bc82a6d3740c2db6e18",
      "peakHelperRssBytes": 6968475648,
      "memoryMeasurementScope": "ps sampled helper RSS every500ms; MPS allocation after inference is not peak VRAM",
      "performanceGrade": "acceptable",
      "engine": "chatterbox-tts",
      "grade": "acceptable",
      "audioSecondsPerSecond": 0.2625786607714649,
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false
    }
  }
]
Release validation still required
  • Complete public B2 dependency closure pending
  • Separate original-model and runtime/package-source outage acceptance pending

Something not quite right?

Tell us what happened with Chatterbox Multilingual V2 Desktop. Loading, results, or the page itself—we’re here for all of it.

Attachments Optional

Up to 3 files · 50 MB each

Browser, OS, CPU/GPU, memory, screen, storage, and network details are included automatically. Model inputs, results, and browsing history are not collected.