A model is still running

A model is still running or downloading. Leaving will stop the current operation. Stay on this page to let it finish.

Skip to content
LocalAI.toolsBeta

Join the waitlist

Get an email when the new apps and model runs launch.

No account needed.

Moonshine Desktop

Transcribe complete English WAV recordings locally with the original offline Moonshine Base checkpoint. Returns complete native text, token IDs, duration and sample rate; supports genuine incremental decoder text from the supplied complete recording.

Desktop inferencePrivate · Runs on your computer
About this model

Transcribe complete English WAV recordings locally with the original offline Moonshine Base checkpoint. Returns complete native text, token IDs, duration and sample rate; supports genuine incremental decoder text from the supplied complete recording.

License
MIT
Model released
Unknown
Source repository created
Nov 2, 2024
Model weights · FP32
246.1 MB

Best for

  • Short English speech recordings.
  • Private local transcription and incremental decoder text from complete audio input.

Keep in mind

  • Only retained short read-speech, controlled noise, authored speech and exact-silence fixtures were measured; not broad accent, demographic, conversation, microphone or subtitle-task quality certification.
  • No speaker identification, word timestamps, translation, live audio ingestion or other language support is advertised.
  • Background noise, quiet/truncated speech and out-of-domain audio may produce errors or hallucinations. Raw outputs must be reviewed.
  • Whole WAV input only, 0.25–30 seconds and at most 6 MB; decoder generation is incremental but audio input is not streamed.
  • Windows, Intel Mac and other hardware/OS/provider combinations remain unverified.

Processed on your deviceYour input is processed locally in the desktop app. Model and runtime files download from external hosts.

Target platforms · verification required

  • macos · aarch64, x86_64
  • windows · x86_64

Recommended configuration

FP32 · cpu (verified platform only)

Sources & technical details
Original model
https://huggingface.co/moonshine-ai/moonshine-base
Release verification
Unknown
Release evidence
Exact original checkpoint public release day not established by bounded official model-card review. Repository creation, paper and conversion dates are not substituted. This is the explicitly requested original offline family; newer streaming releases remain a separate family.
Source updated
Jan 30, 2025
Native model files
https://huggingface.co/moonshine-ai/moonshine-base
Files updated
Jan 30, 2025
Artifact revision
7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf

Desktop app

Sample result

Moonshine Base — English Speech Recognition Desktop

Run Moonshine Desktop on your computer

Download the desktop app to load this model, provide input and view results locally.

Public desktop downloads are coming soon.

Device requirements

macOS Apple SiliconCPU / FP32Tested8.0 GiBRAM estimate
macOS Apple SiliconMPS / FP32Tested8.0 GiBRAM estimate
macOS Apple SiliconMPS / FP16Tested8.0 GiBRAM estimate
macOS Apple SiliconMPS / BF16Tested8.0 GiBRAM estimate
Windows Intel / AMDCPU / FP32Unverified8.0 GiBRAM estimate
macOS Intel / AMDCPU / FP32Unverified8.0 GiBRAM estimate
If your device falls short

MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.

GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.

PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.

Benchmark evidence

Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.

Moonshine Base — English Speech Recognition Desktop

96 configurations tested
Passed96
Failed0
TestedNov 13, 2026
Runtimetransformers 5.22.1

Quality criteria

English WER <=0.20 clean/independent/longer, <=0.30 noisy, exact empty silence, EOS/no loops, warm RTF <=1; controlled fixtures only.

PrecisionDeviceResultPlatformInference / loadTask metric
BF16mpsAcceleratedPassedVery fastmacos · aarch64181 ms / 1950 ms0.016 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64181 ms / 2009 ms0.016 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64182 ms / 2009 ms0.017 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64182 ms / 2005 ms0.017 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64183 ms / 1950 ms0.017 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64183 ms / 1967 ms0.017 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64184 ms / 2009 ms0.017 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64185 ms / 2009 ms0.017 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64185 ms / 1928 ms0.017 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64185 ms / 1950 ms0.017 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64187 ms / 1967 ms0.017 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64187 ms / 1950 ms0.017 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64187 ms / 1941 ms0.017 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64188 ms / 1928 ms0.017 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64188 ms / 1928 ms0.017 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64188 ms / 2005 ms0.017 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64190 ms / 1941 ms0.017 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64190 ms / 1967 ms0.017 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64191 ms / 2048 ms0.017 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64191 ms / 1967 ms0.017 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64191 ms / 2097 ms0.017 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64192 ms / 2048 ms0.017 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64193 ms / 1950 ms0.018 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64196 ms / 1960 ms0.018 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64196 ms / 2048 ms0.018 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64197 ms / 1960 ms0.018 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64201 ms / 1928 ms0.018 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64206 ms / 2097 ms0.019 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64210 ms / 2009 ms0.019 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64212 ms / 2048 ms0.019 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64214 ms / 1967 ms0.019 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64217 ms / 1950 ms0.020 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64224 ms / 1928 ms0.020 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64226 ms / 2005 ms0.021 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64226 ms / 1928 ms0.021 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64226 ms / 1960 ms0.021 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64226 ms / 2048 ms0.021 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64227 ms / 2005 ms0.021 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64227 ms / 1941 ms0.021 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64230 ms / 2005 ms0.021 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64231 ms / 2097 ms0.021 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64235 ms / 1941 ms0.021 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64236 ms / 2097 ms0.021 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64238 ms / 1941 ms0.022 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64246 ms / 1960 ms0.022 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64247 ms / 2048 ms0.022 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64247 ms / 2097 ms0.022 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64261 ms / 1960 ms0.024 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch6466 ms / 1950 ms0.033 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch6470 ms / 2005 ms0.035 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch6470 ms / 2097 ms0.035 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch6470 ms / 1967 ms0.035 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch6471 ms / 2009 ms0.035 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch6471 ms / 1960 ms0.035 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch6472 ms / 1928 ms0.036 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch6472 ms / 2048 ms0.036 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch6473 ms / 1941 ms0.037 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64417 ms / 1967 ms0.038 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64421 ms / 2009 ms0.038 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64436 ms / 2097 ms0.040 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64453 ms / 2005 ms0.041 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64460 ms / 1941 ms0.042 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch641011 ms / 1950 ms0.045 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64517 ms / 1960 ms0.047 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch641191 ms / 2048 ms0.053 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch641239 ms / 1928 ms0.055 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64890 ms / 2048 ms0.081 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64915 ms / 1950 ms0.083 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64921 ms / 1928 ms0.084 RTF
FP32mpsAcceleratedPassedFastmacos · aarch64381 ms / 2048 ms0.112 RTF
BF16mpsAcceleratedPassedFastmacos · aarch64413 ms / 1950 ms0.121 RTF
FP16mpsAcceleratedPassedFastmacos · aarch64422 ms / 1928 ms0.124 RTF
FP32cpuPassedVery fastmacos · aarch6417 ms / 1846 ms0.009 RTF
FP32cpuPassedVery fastmacos · aarch6418 ms / 1828 ms0.009 RTF
FP32cpuPassedVery fastmacos · aarch6419 ms / 1858 ms0.009 RTF
FP32cpuPassedVery fastmacos · aarch64145 ms / 1828 ms0.013 RTF
FP32cpuPassedVery fastmacos · aarch64147 ms / 1846 ms0.013 RTF
FP32cpuPassedVery fastmacos · aarch64150 ms / 1858 ms0.014 RTF
FP32cpuPassedVery fastmacos · aarch64150 ms / 1846 ms0.014 RTF
FP32cpuPassedVery fastmacos · aarch64151 ms / 1846 ms0.014 RTF
FP32cpuPassedVery fastmacos · aarch64151 ms / 1828 ms0.014 RTF
FP32cpuPassedVery fastmacos · aarch64153 ms / 1828 ms0.014 RTF
FP32cpuPassedVery fastmacos · aarch64153 ms / 1846 ms0.014 RTF
FP32cpuPassedVery fastmacos · aarch64156 ms / 1858 ms0.014 RTF
FP32cpuPassedVery fastmacos · aarch64157 ms / 1846 ms0.014 RTF
FP32cpuPassedVery fastmacos · aarch64158 ms / 1858 ms0.014 RTF
FP32cpuPassedVery fastmacos · aarch64324 ms / 1846 ms0.014 RTF
FP32cpuPassedVery fastmacos · aarch64158 ms / 1858 ms0.014 RTF
FP32cpuPassedVery fastmacos · aarch64158 ms / 1828 ms0.014 RTF
FP32cpuPassedVery fastmacos · aarch64169 ms / 1828 ms0.015 RTF
FP32cpuPassedVery fastmacos · aarch64175 ms / 1828 ms0.016 RTF
FP32cpuPassedVery fastmacos · aarch64177 ms / 1858 ms0.016 RTF
FP32cpuPassedVery fastmacos · aarch64180 ms / 1858 ms0.016 RTF
FP32cpuPassedVery fastmacos · aarch64187 ms / 1846 ms0.017 RTF
FP32cpuPassedVery fastmacos · aarch6479 ms / 1846 ms0.023 RTF
FP32cpuPassedVery fastmacos · aarch64451 ms / 1846 ms0.041 RTF
Test setup & sample details
Quality gate
English WER <=0.20 clean/independent/longer, <=0.30 noisy, exact empty silence, EOS/no loops, warm RTF <=1; controlled fixtures only.
Tested
2026-11-13T00:50:56.047743+00:00
Environment
{ "os": "macos", "arch": "aarch64", "hardware": "Apple M3 Max", "osVersion": "27.2", "runtime": "Transformers5.22.1/Torch2.10.0", "interpreter": "App-ownedCPython3.13.18 pinned development venv" }
Runtime
transformers 5.22.1
Artifact revision
7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf
Fixture
{
  "file": "model-samples/desktop/granite-speech5/granite-speech5-jfk.wav",
  "size": 3880888,
  "sha1": "6fb9dfd0ec18bb61a6af995c0df0cd32ee2afe34",
  "sha256": "c72e27f68334ae37e037ef819fa5aa1fc1552aa840b93e308df4ffe52317bedb",
  "url": "https://assets.localai.tools/samples/v1/files/c72e27f68334ae37e037ef819fa5aa1fc1552aa840b93e308df4ffe52317bedb/granite-speech5-jfk.wav"
}
Rerun when
artifact revision change; runtime version change; fixture or frozen quality gate change; relevant backend behavior change
Per-case quality & failure details
[
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 451.71866699820384,
      "inferenceMs": 451.324666995788,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 24.372698423998745,
      "realTimeFactor": 0.04102951518143527,
      "firstChunkMs": 343.7532500247471,
      "chunkCount": 22,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1845.5714579904452,
      "totalMs": 2297.290124988649,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 779943936,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 79.66775001841597,
      "inferenceMs": 79.46929198806174,
      "audioSeconds": 3.4,
      "audioSecondsPerSecond": 42.78382146037949,
      "realTimeFactor": 0.023373321172959337,
      "firstChunkMs": 27.60625001974404,
      "chunkCount": 9,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1845.5714579904452,
      "totalMs": 1925.2392080088612,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 781205504,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 17.553916986798868,
      "inferenceMs": 17.379124998115003,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 115.08059238983128,
      "realTimeFactor": 0.008689562499057502,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1845.5714579904452,
      "totalMs": 1863.125374977244,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 781385728,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.3,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 150.72183299344033,
      "inferenceMs": 150.50837499438785,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 73.08563394170037,
      "realTimeFactor": 0.01368257954494435,
      "firstChunkMs": 46.03724999469705,
      "chunkCount": 22,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1845.5714579904452,
      "totalMs": 1996.2932909838855,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 795705344,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 323.7916659854818,
      "inferenceMs": 323.5266249976121,
      "audioSeconds": 22.5,
      "audioSecondsPerSecond": 69.546053590384,
      "realTimeFactor": 0.014378961111004982,
      "firstChunkMs": 82.49416598118842,
      "chunkCount": 44,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1845.5714579904452,
      "totalMs": 2169.363123975927,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 871792640,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 150.36812500329688,
      "inferenceMs": 150.1362500130199,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 73.26678266605217,
      "realTimeFactor": 0.013648750001183626,
      "firstChunkMs": 47.022624989040196,
      "chunkCount": 22,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1845.5714579904452,
      "totalMs": 1995.939582993742,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 152.96700000180863,
      "inferenceMs": 152.6665419805795,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 72.0524605934894,
      "realTimeFactor": 0.013878776543689046,
      "firstChunkMs": 46.23149998951703,
      "chunkCount": 22,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1845.5714579904452,
      "totalMs": 1998.5384579922538,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 186.78816698957235,
      "inferenceMs": 186.5783749963157,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 58.95645730764465,
      "realTimeFactor": 0.016961670454210518,
      "firstChunkMs": 45.072542008711025,
      "chunkCount": 22,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1845.5714579904452,
      "totalMs": 2032.3596249800175,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 147.3795420024544,
      "inferenceMs": 147.14658298180439,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 74.75538865459227,
      "realTimeFactor": 0.013376962089254945,
      "firstChunkMs": 46.26945802010596,
      "chunkCount": 22,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1845.5714579904452,
      "totalMs": 1992.9509999928996,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 157.66329198959284,
      "inferenceMs": 157.44608402019367,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 69.86518634905626,
      "realTimeFactor": 0.014313280365472152,
      "firstChunkMs": 44.81329201371409,
      "chunkCount": 22,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1845.5714579904452,
      "totalMs": 2003.234749980038,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 179.93758301599883,
      "inferenceMs": 179.5301669917535,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 61.271039760717606,
      "realTimeFactor": 0.01632092427197759,
      "firstChunkMs": 61.65008302195929,
      "chunkCount": 22,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1858.0356250167824,
      "totalMs": 2037.9732080327813,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 780812288,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 19.166499987477437,
      "inferenceMs": 18.951833015307784,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 105.53068921536818,
      "realTimeFactor": 0.009475916507653892,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1858.0356250167824,
      "totalMs": 1877.2021250042599,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 784498688,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 156.07100000488572,
      "inferenceMs": 155.8352500142064,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 70.58736710081453,
      "realTimeFactor": 0.0141668409103824,
      "firstChunkMs": 48.464041989063844,
      "chunkCount": 22,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1858.0356250167824,
      "totalMs": 2014.1066250216682,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 158.42270900611766,
      "inferenceMs": 158.20420798263513,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 69.53038822587693,
      "realTimeFactor": 0.014382200725694102,
      "firstChunkMs": 47.80033399583772,
      "chunkCount": 22,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1858.0356250167824,
      "totalMs": 2016.4583340229,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 177.27912499685772,
      "inferenceMs": 177.01800001668744,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 62.1405732691762,
      "realTimeFactor": 0.016092545456062493,
      "firstChunkMs": 47.23583298618905,
      "chunkCount": 22,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1858.0356250167824,
      "totalMs": 2035.3147500136402,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 157.76716597611085,
      "inferenceMs": 157.54591699806042,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 69.82091449653642,
      "realTimeFactor": 0.014322356090732765,
      "firstChunkMs": 46.572707971790805,
      "chunkCount": 22,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1858.0356250167824,
      "totalMs": 2015.8027909928933,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 150.3929590107873,
      "inferenceMs": 150.12808400206268,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 73.27076791207743,
      "realTimeFactor": 0.013648007636551152,
      "firstChunkMs": 47.13099999935366,
      "chunkCount": 22,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1858.0356250167824,
      "totalMs": 2008.4285840275697,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 169.07916602212936,
      "inferenceMs": 168.72575000161305,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 65.19455388341636,
      "realTimeFactor": 0.015338704545601186,
      "firstChunkMs": 59.81387500651181,
      "chunkCount": 22,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1828.2938749762252,
      "totalMs": 1997.3730409983546,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 779845632,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 17.782708018785343,
      "inferenceMs": 17.59479200700298,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 113.66999957737332,
      "realTimeFactor": 0.00879739600350149,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1828.2938749762252,
      "totalMs": 1846.0765829950105,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 779943936,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 152.8752500016708,
      "inferenceMs": 152.64774998649955,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 72.06133074986602,
      "realTimeFactor": 0.013877068180590868,
      "firstChunkMs": 46.32862500147894,
      "chunkCount": 22,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1828.2938749762252,
      "totalMs": 1981.169124977896,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 158.6986249894835,
      "inferenceMs": 158.43254199717194,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 69.43018057613665,
      "realTimeFactor": 0.014402958363379266,
      "firstChunkMs": 47.57637498551048,
      "chunkCount": 22,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1828.2938749762252,
      "totalMs": 1986.9924999657087,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 175.66387500846758,
      "inferenceMs": 175.3907919919584,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 62.71708950663924,
      "realTimeFactor": 0.0159446174538144,
      "firstChunkMs": 45.91725001228042,
      "chunkCount": 22,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1828.2938749762252,
      "totalMs": 2003.9577499846928,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 151.5978749957867,
      "inferenceMs": 151.37820798554458,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 72.66567722251285,
      "realTimeFactor": 0.013761655271413143,
      "firstChunkMs": 45.41975000756793,
      "chunkCount": 22,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1828.2938749762252,
      "totalMs": 1979.891749972012,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 145.10262498515658,
      "inferenceMs": 144.8713330028113,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 75.92944561217325,
      "realTimeFactor": 0.013170121182073754,
      "firstChunkMs": 44.36008300399408,
      "chunkCount": 22,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1828.2938749762252,
      "totalMs": 1973.3964999613818,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 891.5877910039853,
      "inferenceMs": 890.3341249970254,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 12.35491226401858,
      "realTimeFactor": 0.0809394659088205,
      "firstChunkMs": 624.9610829981975,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1287192576,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2047.769833006896,
      "totalMs": 2939.3576240108814,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 649035776,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 381.6677920112852,
      "inferenceMs": 380.6656670058146,
      "audioSeconds": 3.4,
      "audioSecondsPerSecond": 8.931722229491386,
      "realTimeFactor": 0.11196049029582783,
      "firstChunkMs": 306.10454198904335,
      "chunkCount": 9,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1288880128,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2047.769833006896,
      "totalMs": 2429.4376250181813,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 665239552,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 72.9295409983024,
      "inferenceMs": 72.0365830056835,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 27.763671131405626,
      "realTimeFactor": 0.03601829150284175,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1289650176,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2047.769833006896,
      "totalMs": 2120.6993740051985,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 680738816,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.3,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 191.63295900216326,
      "inferenceMs": 190.52466700668447,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 57.735306261493534,
      "realTimeFactor": 0.017320424273334953,
      "firstChunkMs": 48.369083990110084,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1289650176,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2047.769833006896,
      "totalMs": 2239.4027920090593,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 690913280,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 1192.016082990449,
      "inferenceMs": 1190.7150410115719,
      "audioSeconds": 22.5,
      "audioSecondsPerSecond": 18.89620876955172,
      "realTimeFactor": 0.052920668489403196,
      "firstChunkMs": 737.3255410057027,
      "chunkCount": 44,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1387331584,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2047.769833006896,
      "totalMs": 3239.785915997345,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 772849664,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 193.39520897483453,
      "inferenceMs": 192.0949589984957,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 57.26334546908199,
      "realTimeFactor": 0.017463178090772337,
      "firstChunkMs": 48.921374982455745,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1387331584,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2047.769833006896,
      "totalMs": 2241.1650419817306,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 213.59625001787208,
      "inferenceMs": 212.32166601112112,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 51.808184283104836,
      "realTimeFactor": 0.01930196963737465,
      "firstChunkMs": 51.86566701740958,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1387331584,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2047.769833006896,
      "totalMs": 2261.366083024768,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 228.3357080013957,
      "inferenceMs": 226.20045801158994,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 48.629432922882884,
      "realTimeFactor": 0.02056367800105363,
      "firstChunkMs": 81.09029199113138,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1387331584,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2047.769833006896,
      "totalMs": 2276.1055410082918,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 248.34604101488367,
      "inferenceMs": 247.00529102119617,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 44.533458998074906,
      "realTimeFactor": 0.02245502645647238,
      "firstChunkMs": 60.342000011587515,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1387331584,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2047.769833006896,
      "totalMs": 2296.1158740217797,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 197.4353750119917,
      "inferenceMs": 196.24808299704455,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 56.0515029345059,
      "realTimeFactor": 0.01784073481791314,
      "firstChunkMs": 50.854959001298994,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1387331584,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2047.769833006896,
      "totalMs": 2245.205208018888,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 518.205999978818,
      "inferenceMs": 516.5339579980355,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 21.295792521818743,
      "realTimeFactor": 0.046957632545275955,
      "firstChunkMs": 209.410207986366,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1287192576,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1960.441000002902,
      "totalMs": 2478.64699998172,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 641368064,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 72.01816601445898,
      "inferenceMs": 70.73237499571405,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 28.275595158810766,
      "realTimeFactor": 0.03536618749785703,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1287962624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1960.441000002902,
      "totalMs": 2032.459166017361,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 657047552,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 197.3151659767609,
      "inferenceMs": 196.0242919740267,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 56.11549410140201,
      "realTimeFactor": 0.017820390179456972,
      "firstChunkMs": 51.281958003528416,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1287962624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1960.441000002902,
      "totalMs": 2157.756165979663,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 261.70549998641945,
      "inferenceMs": 260.58745800401084,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 42.2123155283655,
      "realTimeFactor": 0.02368976890945553,
      "firstChunkMs": 44.72337500192225,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1287962624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1960.441000002902,
      "totalMs": 2222.1464999893215,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 227.18229200108908,
      "inferenceMs": 226.1059159936849,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 48.649766423215695,
      "realTimeFactor": 0.020555083272153173,
      "firstChunkMs": 52.35087499022484,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1287962624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1960.441000002902,
      "totalMs": 2187.623292003991,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 247.13537498610094,
      "inferenceMs": 246.14083301275969,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 44.68986256916491,
      "realTimeFactor": 0.022376439364796333,
      "firstChunkMs": 57.06704099429771,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1287962624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1960.441000002902,
      "totalMs": 2207.576374989003,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 198.12124999589287,
      "inferenceMs": 196.92162499995902,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 55.85978685683855,
      "realTimeFactor": 0.017901965909087183,
      "firstChunkMs": 52.99900000682101,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1287962624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1960.441000002902,
      "totalMs": 2158.562249998795,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 437.53066600766033,
      "inferenceMs": 436.21295801131055,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 25.217040892477986,
      "realTimeFactor": 0.03965572345557369,
      "firstChunkMs": 177.54070801311173,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1287192576,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2097.0099580008537,
      "totalMs": 2534.540624008514,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 638763008,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 71.40208399505354,
      "inferenceMs": 69.92087501566857,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 28.603761030619538,
      "realTimeFactor": 0.034960437507834285,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1287962624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2097.0099580008537,
      "totalMs": 2168.412041995907,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 654426112,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 193.05295799858868,
      "inferenceMs": 191.28216701210476,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 57.50666762000817,
      "realTimeFactor": 0.017389287910191342,
      "firstChunkMs": 47.11949999909848,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1287962624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2097.0099580008537,
      "totalMs": 2290.0629159994423,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 237.62962501496077,
      "inferenceMs": 236.21054098475724,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 46.56862455901083,
      "realTimeFactor": 0.02147368554406884,
      "firstChunkMs": 43.506457994226366,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1287962624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2097.0099580008537,
      "totalMs": 2334.6395830158144,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 232.34320798655972,
      "inferenceMs": 230.88416701648384,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 47.64293776460931,
      "realTimeFactor": 0.02098946972877126,
      "firstChunkMs": 54.68404199928045,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1287962624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2097.0099580008537,
      "totalMs": 2329.3531659874134,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 250.2754170272965,
      "inferenceMs": 247.28549999417737,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 44.4829963756832,
      "realTimeFactor": 0.02248049999947067,
      "firstChunkMs": 54.214000003412366,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1287962624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2097.0099580008537,
      "totalMs": 2347.28537502815,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 206.83154099970125,
      "inferenceMs": 205.61549998819828,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 53.49791236862672,
      "realTimeFactor": 0.018692318180745297,
      "firstChunkMs": 56.84129099245183,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1287962624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2097.0099580008537,
      "totalMs": 2303.841499000555,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 922.3894169845153,
      "inferenceMs": 921.094165998511,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 11.942318609819294,
      "realTimeFactor": 0.08373583327259192,
      "firstChunkMs": 660.8417499810457,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1207500800,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1927.5395839940757,
      "totalMs": 2849.929000978591,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp16",
      "cpuThreads": 4,
      "rssBytes": 736100352,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 424.0240420040209,
      "inferenceMs": 422.3643750010524,
      "audioSeconds": 3.4,
      "audioSecondsPerSecond": 8.04992135047263,
      "realTimeFactor": 0.12422481617678012,
      "firstChunkMs": 350.2127920219209,
      "chunkCount": 9,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1209188352,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1927.5395839940757,
      "totalMs": 2351.5636259980965,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp16",
      "cpuThreads": 4,
      "rssBytes": 752762880,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 72.45920901186764,
      "inferenceMs": 71.54370899661444,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 27.954938708791897,
      "realTimeFactor": 0.03577185449830722,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1211006976,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1927.5395839940757,
      "totalMs": 1999.9987930059433,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp16",
      "cpuThreads": 4,
      "rssBytes": 768180224,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.3,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 187.30887499987148,
      "inferenceMs": 184.66475000604987,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 59.567405255413526,
      "realTimeFactor": 0.016787704546004534,
      "firstChunkMs": 45.476874976884574,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1211006976,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1927.5395839940757,
      "totalMs": 2114.848458993947,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp16",
      "cpuThreads": 4,
      "rssBytes": 773931008,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 1240.63237500377,
      "inferenceMs": 1239.4249580102041,
      "audioSeconds": 22.5,
      "audioSecondsPerSecond": 18.153579895729965,
      "realTimeFactor": 0.055085553689342405,
      "firstChunkMs": 666.9738750206307,
      "chunkCount": 44,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1324417024,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1927.5395839940757,
      "totalMs": 3168.1719589978456,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp16",
      "cpuThreads": 4,
      "rssBytes": 853917696,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 189.12075000116602,
      "inferenceMs": 187.87483300548047,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 58.54961957400181,
      "realTimeFactor": 0.017079530273225497,
      "firstChunkMs": 47.18033300014213,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1324417024,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1927.5395839940757,
      "totalMs": 2116.6603339952417,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 202.55449999240227,
      "inferenceMs": 201.39149998431094,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 54.6199814831159,
      "realTimeFactor": 0.018308318180391903,
      "firstChunkMs": 49.949334003031254,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1324417024,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1927.5395839940757,
      "totalMs": 2130.094083986478,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 225.47095801564865,
      "inferenceMs": 224.261833995115,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 49.049808449526935,
      "realTimeFactor": 0.020387439454101364,
      "firstChunkMs": 81.61583301261999,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1324417024,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1927.5395839940757,
      "totalMs": 2153.0105420097243,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 227.19333300483413,
      "inferenceMs": 226.1052080139052,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 48.649918755181936,
      "realTimeFactor": 0.02055501891035502,
      "firstChunkMs": 60.11291698087007,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1324417024,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1927.5395839940757,
      "totalMs": 2154.73291699891,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 188.9327079989016,
      "inferenceMs": 187.7489170001354,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 58.588886560618974,
      "realTimeFactor": 0.017068083363648675,
      "firstChunkMs": 48.78195800120011,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1324417024,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1927.5395839940757,
      "totalMs": 2116.4722919929773,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 454.8513329937123,
      "inferenceMs": 453.49641700158827,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 24.255979953997024,
      "realTimeFactor": 0.04122694700014439,
      "firstChunkMs": 191.5866250055842,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1207500800,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2004.9734579806682,
      "totalMs": 2459.8247909743804,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp16",
      "cpuThreads": 4,
      "rssBytes": 737214464,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 70.96812501549721,
      "inferenceMs": 69.60837499354966,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 28.732174830763284,
      "realTimeFactor": 0.03480418749677483,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1208270848,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2004.9734579806682,
      "totalMs": 2075.9415829961654,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp16",
      "cpuThreads": 4,
      "rssBytes": 753074176,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 183.04974999045953,
      "inferenceMs": 181.93004201748408,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 60.46280140441491,
      "realTimeFactor": 0.01653909472886219,
      "firstChunkMs": 42.76770900469273,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1208270848,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2004.9734579806682,
      "totalMs": 2188.0232079711277,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 231.28508299123496,
      "inferenceMs": 229.581124993274,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 47.913346536315935,
      "realTimeFactor": 0.020871011363024907,
      "firstChunkMs": 47.811999975237995,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1208270848,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2004.9734579806682,
      "totalMs": 2236.258540971903,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 227.43379199528135,
      "inferenceMs": 225.85441698902287,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 48.70394011614406,
      "realTimeFactor": 0.020532219726274805,
      "firstChunkMs": 51.238957996247336,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1208270848,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2004.9734579806682,
      "totalMs": 2232.4072499759495,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 227.6656659960281,
      "inferenceMs": 226.59095900598913,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 48.54562621675145,
      "realTimeFactor": 0.02059917809145356,
      "firstChunkMs": 54.429749987320974,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1208270848,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2004.9734579806682,
      "totalMs": 2232.6391239766963,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 189.8243750038091,
      "inferenceMs": 188.45587500254624,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 58.369100989031935,
      "realTimeFactor": 0.01713235227295875,
      "firstChunkMs": 47.76279200450517,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1208270848,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2004.9734579806682,
      "totalMs": 2194.7978329844773,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 461.5715419931803,
      "inferenceMs": 460.31283400952816,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 23.89679189299403,
      "realTimeFactor": 0.04184662127359347,
      "firstChunkMs": 193.72966699302197,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1207500800,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1940.6594579922967,
      "totalMs": 2402.230999985477,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp16",
      "cpuThreads": 4,
      "rssBytes": 739098624,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 74.92391698178835,
      "inferenceMs": 73.08724999893457,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 27.3645540094771,
      "realTimeFactor": 0.036543624999467283,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1208270848,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1940.6594579922967,
      "totalMs": 2015.583374974085,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp16",
      "cpuThreads": 4,
      "rssBytes": 755400704,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 188.90529198688455,
      "inferenceMs": 187.48845800291747,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 58.670278251628865,
      "realTimeFactor": 0.0170444052729925,
      "firstChunkMs": 46.44325000117533,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1208270848,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1940.6594579922967,
      "totalMs": 2129.564749979181,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 238.1661250256002,
      "inferenceMs": 234.51358400052413,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 46.90559844062344,
      "realTimeFactor": 0.021319416727320375,
      "firstChunkMs": 62.1513330261223,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1208270848,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1940.6594579922967,
      "totalMs": 2178.825583017897,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 228.42912501073442,
      "inferenceMs": 227.0145840011537,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 48.45503670347495,
      "realTimeFactor": 0.020637689454650335,
      "firstChunkMs": 52.65337499440648,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1208270848,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1940.6594579922967,
      "totalMs": 2169.088583003031,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 240.52033401676454,
      "inferenceMs": 238.07900000247173,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 46.203151054422264,
      "realTimeFactor": 0.021643545454770156,
      "firstChunkMs": 47.10812499979511,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1208270848,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1940.6594579922967,
      "totalMs": 2181.179792009061,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 190.95641700550914,
      "inferenceMs": 189.6230409911368,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 58.00982803832448,
      "realTimeFactor": 0.01723845827192153,
      "firstChunkMs": 49.79045799700543,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1208270848,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1940.6594579922967,
      "totalMs": 2131.615874997806,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 918.5327920131385,
      "inferenceMs": 915.0745420192834,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 12.020878622332164,
      "realTimeFactor": 0.08318859472902576,
      "firstChunkMs": 656.6329170018435,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1207500800,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1950.3151249955408,
      "totalMs": 2868.8479170086794,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "bf16",
      "cpuThreads": 4,
      "rssBytes": 733839360,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 414.0096250048373,
      "inferenceMs": 412.6669999968726,
      "audioSeconds": 3.4,
      "audioSecondsPerSecond": 8.239088659926203,
      "realTimeFactor": 0.12137264705790371,
      "firstChunkMs": 338.4208749921527,
      "chunkCount": 9,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1209188352,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1950.3151249955408,
      "totalMs": 2364.324750000378,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "bf16",
      "cpuThreads": 4,
      "rssBytes": 750288896,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 67.1778749965597,
      "inferenceMs": 65.83841700921766,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 30.377401080587816,
      "realTimeFactor": 0.03291920850460883,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1211006976,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1950.3151249955408,
      "totalMs": 2017.4929999921005,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "bf16",
      "cpuThreads": 4,
      "rssBytes": 766001152,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.3,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 184.46133300312795,
      "inferenceMs": 183.02387499716133,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 60.10144851413843,
      "realTimeFactor": 0.01663853409065103,
      "firstChunkMs": 43.56570800882764,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1211006976,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1950.3151249955408,
      "totalMs": 2134.776457998669,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "bf16",
      "cpuThreads": 4,
      "rssBytes": 771735552,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 1012.6601249794476,
      "inferenceMs": 1010.9351669962052,
      "audioSeconds": 22.5,
      "audioSecondsPerSecond": 22.256620141976384,
      "realTimeFactor": 0.04493045186649801,
      "firstChunkMs": 589.5544159866404,
      "chunkCount": 44,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1324417024,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1950.3151249955408,
      "totalMs": 2962.9752499749884,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "bf16",
      "cpuThreads": 4,
      "rssBytes": 851820544,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 191.21408398495987,
      "inferenceMs": 187.45816600858234,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 58.67975897884539,
      "realTimeFactor": 0.017041651455325667,
      "firstChunkMs": 48.5489169950597,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1324417024,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1950.3151249955408,
      "totalMs": 2141.5292089805007,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 182.11200000951067,
      "inferenceMs": 180.8744169829879,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 60.81567633212939,
      "realTimeFactor": 0.016443128816635264,
      "firstChunkMs": 42.31375001836568,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1324417024,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1950.3151249955408,
      "totalMs": 2132.4271250050515,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 218.20729100727476,
      "inferenceMs": 216.6311670152936,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 50.77755039386105,
      "realTimeFactor": 0.019693742455935782,
      "firstChunkMs": 75.11658300063573,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1324417024,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1950.3151249955408,
      "totalMs": 2168.5224160028156,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 186.13054198794998,
      "inferenceMs": 184.90187500719912,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 59.49101381244358,
      "realTimeFactor": 0.01680926136429083,
      "firstChunkMs": 45.258166996063665,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1324417024,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1950.3151249955408,
      "totalMs": 2136.445666983491,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 195.10008301585913,
      "inferenceMs": 193.2125419843942,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 56.93212193693136,
      "realTimeFactor": 0.017564776544035834,
      "firstChunkMs": 42.9368750192225,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1324417024,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1950.3151249955408,
      "totalMs": 2145.4152080114,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 422.9795830033254,
      "inferenceMs": 420.9224170190282,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 26.133081905929316,
      "realTimeFactor": 0.03826567427445711,
      "firstChunkMs": 172.01999999815598,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1207500800,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2009.3027089897078,
      "totalMs": 2432.282291993033,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "bf16",
      "cpuThreads": 4,
      "rssBytes": 736690176,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 73.18700000178069,
      "inferenceMs": 70.62741700792685,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 28.317614953630976,
      "realTimeFactor": 0.035313708503963426,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1208270848,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2009.3027089897078,
      "totalMs": 2082.4897089914884,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "bf16",
      "cpuThreads": 4,
      "rssBytes": 752664576,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 185.46379197505303,
      "inferenceMs": 183.88962498283945,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 59.81849166871985,
      "realTimeFactor": 0.016717238634803587,
      "firstChunkMs": 42.63095898204483,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1208270848,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2009.3027089897078,
      "totalMs": 2194.766500964761,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 182.24883297807537,
      "inferenceMs": 180.9931249881629,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 60.775789139611845,
      "realTimeFactor": 0.016453920453469353,
      "firstChunkMs": 42.964457999914885,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1208270848,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2009.3027089897078,
      "totalMs": 2191.551541967783,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 212.60629099560902,
      "inferenceMs": 210.13337501790375,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 52.3477053517214,
      "realTimeFactor": 0.019103034092536705,
      "firstChunkMs": 46.16233299020678,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1208270848,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2009.3027089897078,
      "totalMs": 2221.9089999853168,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 186.02920800913125,
      "inferenceMs": 184.5597499923315,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 59.601294434225515,
      "realTimeFactor": 0.016778159090211953,
      "firstChunkMs": 45.07812499650754,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1208270848,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2009.3027089897078,
      "totalMs": 2195.331916998839,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 183.19491698639467,
      "inferenceMs": 181.86204199446365,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 60.48540904613217,
      "realTimeFactor": 0.016532912908587605,
      "firstChunkMs": 43.16145897610113,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1208270848,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 2009.3027089897078,
      "totalMs": 2192.4976259761024,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 418.46654200344346,
      "inferenceMs": 416.8922500102781,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 26.38571477337083,
      "realTimeFactor": 0.03789929545547983,
      "firstChunkMs": 173.85699998703785,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1207500800,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1966.6534999851137,
      "totalMs": 2385.120041988557,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "bf16",
      "cpuThreads": 4,
      "rssBytes": 734330880,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 71.40712498221546,
      "inferenceMs": 70.13725000433624,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 28.51551778657347,
      "realTimeFactor": 0.03506862500216812,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1208270848,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1966.6534999851137,
      "totalMs": 2038.0606249673292,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "bf16",
      "cpuThreads": 4,
      "rssBytes": 750223360,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 187.88204100565054,
      "inferenceMs": 186.59820800530724,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 58.95019098836757,
      "realTimeFactor": 0.016963473455027932,
      "firstChunkMs": 45.76124998857267,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1208270848,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1966.6534999851137,
      "totalMs": 2154.5355409907643,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 190.90654197498225,
      "inferenceMs": 189.62499999906868,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 58.009228741220966,
      "realTimeFactor": 0.017238636363551697,
      "firstChunkMs": 43.36045897798613,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1208270848,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1966.6534999851137,
      "totalMs": 2157.560041960096,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 214.85429201857187,
      "inferenceMs": 213.61499998602085,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 51.49451115661283,
      "realTimeFactor": 0.019419545453274623,
      "firstChunkMs": 46.32258301717229,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1208270848,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1966.6534999851137,
      "totalMs": 2181.5077920036856,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 192.6054159994237,
      "inferenceMs": 191.1454580258578,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 57.547796916586634,
      "realTimeFactor": 0.01737685982053253,
      "firstChunkMs": 44.72033301135525,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1208270848,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1966.6534999851137,
      "totalMs": 2159.2589159845375,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 184.90808398928493,
      "inferenceMs": 183.30345800495706,
      "audioSeconds": 11,
      "audioSecondsPerSecond": 60.009778973741604,
      "realTimeFactor": 0.016663950727723368,
      "firstChunkMs": 43.15554199274629,
      "chunkCount": 22,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1208270848,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1966.6534999851137,
      "totalMs": 2151.5615839743987,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
    }
  }
]

Moonshine Base — Spanish Speech Recognition Desktop

48 configurations tested
Passed48
Failed0
TestedNov 13, 2026
Runtimeonnxruntime 1.31.1

Quality criteria

WER <=0.20 three frozen Spanish FLEURS clips, <=0.30 deterministic noisy clip, empty real-neural silence, EOS/no loops/gibberish, warmRTF<=1; controlled read-speech only.

PrecisionDeviceResultPlatformInference / loadTask metric
Q8cpuPassedVery fastmacos · aarch6415 ms / 609 ms0.008 RTF
Q8cpuPassedVery fastmacos · aarch6415 ms / 623 ms0.008 RTF
Q8cpuPassedVery fastmacos · aarch6416 ms / 633 ms0.008 RTF
FP32cpuPassedVery fastmacos · aarch6418 ms / 1774 ms0.009 RTF
FP32cpuPassedVery fastmacos · aarch6418 ms / 707 ms0.009 RTF
FP32cpuPassedVery fastmacos · aarch6418 ms / 690 ms0.009 RTF
FP32cpuPassedVery fastmacos · aarch64162 ms / 1774 ms0.018 RTF
FP32cpuPassedVery fastmacos · aarch64152 ms / 707 ms0.018 RTF
FP32cpuPassedVery fastmacos · aarch64152 ms / 690 ms0.018 RTF
FP32cpuPassedVery fastmacos · aarch64152 ms / 707 ms0.018 RTF
FP32cpuPassedVery fastmacos · aarch64153 ms / 690 ms0.018 RTF
FP32cpuPassedVery fastmacos · aarch64153 ms / 707 ms0.018 RTF
FP32cpuPassedVery fastmacos · aarch64153 ms / 690 ms0.018 RTF
FP32cpuPassedVery fastmacos · aarch64153 ms / 690 ms0.018 RTF
FP32cpuPassedVery fastmacos · aarch64153 ms / 707 ms0.018 RTF
FP32cpuPassedVery fastmacos · aarch64153 ms / 1774 ms0.018 RTF
FP32cpuPassedVery fastmacos · aarch64153 ms / 690 ms0.018 RTF
FP32cpuPassedVery fastmacos · aarch64154 ms / 707 ms0.018 RTF
FP32cpuPassedVery fastmacos · aarch64154 ms / 690 ms0.018 RTF
FP32cpuPassedVery fastmacos · aarch64155 ms / 707 ms0.018 RTF
FP32cpuPassedVery fastmacos · aarch64155 ms / 1774 ms0.018 RTF
FP32cpuPassedVery fastmacos · aarch64155 ms / 1774 ms0.019 RTF
FP32cpuPassedVery fastmacos · aarch64157 ms / 1774 ms0.019 RTF
FP32cpuPassedVery fastmacos · aarch64158 ms / 1774 ms0.019 RTF
FP32cpuPassedVery fastmacos · aarch64159 ms / 1774 ms0.019 RTF
FP32cpuPassedVery fastmacos · aarch64166 ms / 1774 ms0.020 RTF
FP32cpuPassedVery fastmacos · aarch64244 ms / 1774 ms0.020 RTF
Q8cpuPassedVery fastmacos · aarch64207 ms / 623 ms0.023 RTF
Q8cpuPassedVery fastmacos · aarch64197 ms / 623 ms0.023 RTF
Q8cpuPassedVery fastmacos · aarch64197 ms / 633 ms0.023 RTF
Q8cpuPassedVery fastmacos · aarch64197 ms / 623 ms0.023 RTF
Q8cpuPassedVery fastmacos · aarch64198 ms / 623 ms0.024 RTF
Q8cpuPassedVery fastmacos · aarch64199 ms / 633 ms0.024 RTF
Q8cpuPassedVery fastmacos · aarch64199 ms / 633 ms0.024 RTF
Q8cpuPassedVery fastmacos · aarch64200 ms / 609 ms0.024 RTF
Q8cpuPassedVery fastmacos · aarch64200 ms / 623 ms0.024 RTF
Q8cpuPassedVery fastmacos · aarch64201 ms / 623 ms0.024 RTF
Q8cpuPassedVery fastmacos · aarch64201 ms / 609 ms0.024 RTF
Q8cpuPassedVery fastmacos · aarch64201 ms / 623 ms0.024 RTF
Q8cpuPassedVery fastmacos · aarch64202 ms / 623 ms0.024 RTF
Q8cpuPassedVery fastmacos · aarch64202 ms / 609 ms0.024 RTF
Q8cpuPassedVery fastmacos · aarch64203 ms / 633 ms0.024 RTF
Q8cpuPassedVery fastmacos · aarch64206 ms / 609 ms0.024 RTF
Q8cpuPassedVery fastmacos · aarch64206 ms / 609 ms0.025 RTF
Q8cpuPassedVery fastmacos · aarch64206 ms / 609 ms0.025 RTF
Q8cpuPassedVery fastmacos · aarch64211 ms / 633 ms0.025 RTF
Q8cpuPassedVery fastmacos · aarch64314 ms / 623 ms0.026 RTF
Q8cpuPassedVery fastmacos · aarch64222 ms / 633 ms0.026 RTF
Test setup & sample details
Quality gate
WER <=0.20 three frozen Spanish FLEURS clips, <=0.30 deterministic noisy clip, empty real-neural silence, EOS/no loops/gibberish, warmRTF<=1; controlled read-speech only.
Tested
2026-11-13T01:30:49.985923+00:00
Environment
{ "os": "macos", "arch": "aarch64", "hardware": "Apple M3 Max", "osVersion": "27.2", "runtime": "ONNX Runtime1.31.1", "interpreter": "App-ownedCPython3.13.18 private locked environment" }
Runtime
onnxruntime 1.31.1
Artifact revision
661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c
Fixture
{
  "file": "model-samples/desktop/moonshine-family/es_419-clean-0.wav",
  "size": 268844,
  "sha1": "4fcd501f4204aadfdb6bdd8741626548612ecadd",
  "sha256": "6137763a726844a7dfdd853ee2211bcd97a171c9d5abdab740789b9b3d1d49e5",
  "url": "https://assets.localai.tools/samples/v1/files/6137763a726844a7dfdd853ee2211bcd97a171c9d5abdab740789b9b3d1d49e5/es_419-clean-0.wav"
}
Rerun when
artifact revision change; runtime version change; fixture or frozen quality gate change; relevant backend behavior change
Per-case quality & failure details
[
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 168.26145799132064,
      "inferenceMs": 155.44549998594448,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 54.03823205406098,
      "realTimeFactor": 0.01850541666499339,
      "firstChunkMs": 81.73437498044223,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 1774.2630419961642,
      "totalMs": 1942.524499987485,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 750469120,
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0.03333333333333333,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 260.8217500091996,
      "inferenceMs": 243.57854199479334,
      "audioSeconds": 12.12,
      "audioSecondsPerSecond": 49.758077623516904,
      "realTimeFactor": 0.0200972394385143,
      "firstChunkMs": 113.49212500499561,
      "chunkCount": 44,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 1774.2630419961642,
      "totalMs": 2035.0847920053639,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 766066688,
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 175.4053749900777,
      "inferenceMs": 162.19941701274365,
      "audioSeconds": 9.18,
      "audioSecondsPerSecond": 56.596997505106614,
      "realTimeFactor": 0.017668781809667064,
      "firstChunkMs": 87.88916698540561,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 1774.2630419961642,
      "totalMs": 1949.668416986242,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 767934464,
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.3,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 165.65137499128468,
      "inferenceMs": 153.47774999099784,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 54.73106036863779,
      "realTimeFactor": 0.018271160713214028,
      "firstChunkMs": 80.16295899869874,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 1774.2630419961642,
      "totalMs": 1939.914416987449,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 774307840,
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 23.898917017504573,
      "inferenceMs": 18.227749998914078,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 109.72281275084146,
      "realTimeFactor": 0.009113874999457039,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 1774.2630419961642,
      "totalMs": 1798.1619590136688,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 774488064,
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 168.84600001503713,
      "inferenceMs": 156.8394170026295,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 53.55796495889277,
      "realTimeFactor": 0.0186713591669797,
      "firstChunkMs": 81.71791600761935,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 1774.2630419961642,
      "totalMs": 1943.1090420112014,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 178.14870798611082,
      "inferenceMs": 166.19583399733528,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 50.54278316106698,
      "realTimeFactor": 0.019785218333016105,
      "firstChunkMs": 83.80362499156035,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 1774.2630419961642,
      "totalMs": 1952.411749982275,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 171.04766599368304,
      "inferenceMs": 158.68837499874644,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 52.93393419692121,
      "realTimeFactor": 0.018891473214136482,
      "firstChunkMs": 82.98954099882394,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 1774.2630419961642,
      "totalMs": 1945.3107079898473,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 169.80183401028626,
      "inferenceMs": 157.85491702263243,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 53.213420008929155,
      "realTimeFactor": 0.01879225202650386,
      "firstChunkMs": 82.5876249873545,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 1774.2630419961642,
      "totalMs": 1944.0648760064505,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 167.7440839994233,
      "inferenceMs": 155.38312497665174,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 54.0599244690323,
      "realTimeFactor": 0.018497991068649015,
      "firstChunkMs": 81.90870902035385,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 1774.2630419961642,
      "totalMs": 1942.0071259955876,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 167.47358298744075,
      "inferenceMs": 154.90783299901523,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 54.22579244300319,
      "realTimeFactor": 0.018441408690358957,
      "firstChunkMs": 81.52058298583142,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 707.048374984879,
      "totalMs": 874.5219579723198,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 749322240,
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 24.126125004841015,
      "inferenceMs": 18.30766597413458,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 109.24385461399821,
      "realTimeFactor": 0.00915383298706729,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 707.048374984879,
      "totalMs": 731.1744999897201,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 749355008,
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 165.8224999846425,
      "inferenceMs": 153.76329098944552,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 54.629423875797414,
      "realTimeFactor": 0.018305153689219707,
      "firstChunkMs": 80.7481249794364,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 707.048374984879,
      "totalMs": 872.8708749695215,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 165.3967919992283,
      "inferenceMs": 153.36520798155107,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 54.77122295566848,
      "realTimeFactor": 0.018257762854946555,
      "firstChunkMs": 80.2894170046784,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 707.048374984879,
      "totalMs": 872.4451669841073,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 164.52320900862105,
      "inferenceMs": 152.4867090047337,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 55.086768249023166,
      "realTimeFactor": 0.01815317964342068,
      "firstChunkMs": 79.73566700820811,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 707.048374984879,
      "totalMs": 871.5715839935001,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 164.03795898077078,
      "inferenceMs": 152.12066698586568,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 55.21932138767501,
      "realTimeFactor": 0.01810960321260306,
      "firstChunkMs": 79.584666993469,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 707.048374984879,
      "totalMs": 871.0863339656498,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 164.8820000118576,
      "inferenceMs": 152.9333330108784,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 54.92589375138051,
      "realTimeFactor": 0.018206349167961718,
      "firstChunkMs": 79.61629101191647,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 707.048374984879,
      "totalMs": 871.9303749967366,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 165.3670840023551,
      "inferenceMs": 153.2138749898877,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 54.8253217964392,
      "realTimeFactor": 0.01823974702260568,
      "firstChunkMs": 80.44983400031924,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 690.1585830200929,
      "totalMs": 855.525667022448,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 793952256,
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 24.13487498415634,
      "inferenceMs": 18.46337501774542,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 108.32255739147207,
      "realTimeFactor": 0.00923168750887271,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 690.1585830200929,
      "totalMs": 714.2934580042493,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 794771456,
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 165.13158299494535,
      "inferenceMs": 153.01366697531193,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 54.897057014882876,
      "realTimeFactor": 0.018215912735156183,
      "firstChunkMs": 80.61216599890031,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 690.1585830200929,
      "totalMs": 855.2901660150383,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 165.47287499997765,
      "inferenceMs": 153.48800001083873,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 54.72740539590603,
      "realTimeFactor": 0.01827238095367128,
      "firstChunkMs": 80.14449998154305,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 690.1585830200929,
      "totalMs": 855.6314580200706,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 164.56266600289382,
      "inferenceMs": 152.89516700431705,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 54.93960446612955,
      "realTimeFactor": 0.01820180559575203,
      "firstChunkMs": 80.64929099055007,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 690.1585830200929,
      "totalMs": 854.7212490229867,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 164.03787498711608,
      "inferenceMs": 152.28608399047516,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 55.15934076107298,
      "realTimeFactor": 0.018129295713151805,
      "firstChunkMs": 80.58208398870192,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 690.1585830200929,
      "totalMs": 854.196458007209,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 166.80295899277553,
      "inferenceMs": 154.1861669975333,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 54.47959543695243,
      "realTimeFactor": 0.018355496071134916,
      "firstChunkMs": 81.67895898805,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 690.1585830200929,
      "totalMs": 856.9615420128684,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 212.41149998968467,
      "inferenceMs": 200.24491698131897,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 41.94863034043278,
      "realTimeFactor": 0.023838680593014163,
      "firstChunkMs": 65.70208398625255,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 622.5357079820242,
      "totalMs": 834.9472079717088,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "q8",
      "cpuThreads": 4,
      "rssBytes": 373374976,
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0.03333333333333333,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 331.0624579899013,
      "inferenceMs": 313.9106250018813,
      "audioSeconds": 12.12,
      "audioSecondsPerSecond": 38.60971574290409,
      "realTimeFactor": 0.025900216584313636,
      "firstChunkMs": 84.0985830000136,
      "chunkCount": 44,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 622.5357079820242,
      "totalMs": 953.5981659719255,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "q8",
      "cpuThreads": 4,
      "rssBytes": 437878784,
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 219.82570897671394,
      "inferenceMs": 206.73433298361488,
      "audioSeconds": 9.18,
      "audioSecondsPerSecond": 44.40481591767139,
      "realTimeFactor": 0.02252007984570968,
      "firstChunkMs": 69.25449997652322,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 622.5357079820242,
      "totalMs": 842.3614169587381,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "q8",
      "cpuThreads": 4,
      "rssBytes": 441778176,
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.3,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 212.77612500125542,
      "inferenceMs": 200.7085420191288,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 41.8517314484773,
      "realTimeFactor": 0.023893874049896284,
      "firstChunkMs": 63.9805420069024,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 622.5357079820242,
      "totalMs": 835.3118329832796,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "q8",
      "cpuThreads": 4,
      "rssBytes": 447758336,
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 20.97654200042598,
      "inferenceMs": 15.38199998321943,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 130.02210389948283,
      "realTimeFactor": 0.007690999991609715,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 622.5357079820242,
      "totalMs": 643.5122499824502,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "q8",
      "cpuThreads": 4,
      "rssBytes": 447791104,
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 213.0418749875389,
      "inferenceMs": 201.061750005465,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 41.778209926908936,
      "realTimeFactor": 0.023935922619698215,
      "firstChunkMs": 62.30220798170194,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 622.5357079820242,
      "totalMs": 835.5775829695631,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 214.1593330015894,
      "inferenceMs": 202.2890000080224,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 41.52474924324542,
      "realTimeFactor": 0.02408202381047886,
      "firstChunkMs": 61.888958007330075,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 622.5357079820242,
      "totalMs": 836.6950409836136,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 208.93104202696122,
      "inferenceMs": 196.94591700681485,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 42.65130309713066,
      "realTimeFactor": 0.023445942500811293,
      "firstChunkMs": 62.21241701859981,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 622.5357079820242,
      "totalMs": 831.4667500089854,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 208.59716698760167,
      "inferenceMs": 196.68987501063384,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 42.70682463724105,
      "realTimeFactor": 0.023415461310789743,
      "firstChunkMs": 61.833082989323884,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 622.5357079820242,
      "totalMs": 831.1328749696258,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 209.66624998254701,
      "inferenceMs": 197.66333300503902,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 42.49650085474305,
      "realTimeFactor": 0.02353134916726655,
      "firstChunkMs": 62.85599997499958,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 622.5357079820242,
      "totalMs": 832.2019579645712,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 223.13474997645244,
      "inferenceMs": 210.5831670050975,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 39.889228182215845,
      "realTimeFactor": 0.025069424643463987,
      "firstChunkMs": 68.26662499224767,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 633.0684589920565,
      "totalMs": 856.203208968509,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "q8",
      "cpuThreads": 4,
      "rssBytes": 374030336,
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 21.26337500521913,
      "inferenceMs": 15.579458995489404,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 128.37416245192108,
      "realTimeFactor": 0.007789729497744702,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 633.0684589920565,
      "totalMs": 654.3318339972757,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "q8",
      "cpuThreads": 4,
      "rssBytes": 375947264,
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 234.22983300406486,
      "inferenceMs": 222.10425001685508,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 37.82007773089682,
      "realTimeFactor": 0.0264409821448637,
      "firstChunkMs": 65.08812500396743,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 633.0684589920565,
      "totalMs": 867.2982919961214,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 208.49375001853332,
      "inferenceMs": 196.75316600478254,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 42.693086828375705,
      "realTimeFactor": 0.023422995952950304,
      "firstChunkMs": 62.93733301572502,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 633.0684589920565,
      "totalMs": 841.5622090105899,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 210.57829199708067,
      "inferenceMs": 198.6737079860177,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 42.28038065606133,
      "realTimeFactor": 0.023651631903097343,
      "firstChunkMs": 62.73308300296776,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 633.0684589920565,
      "totalMs": 843.6467509891372,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 210.2537500031758,
      "inferenceMs": 198.66170900058933,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 42.2829343523622,
      "realTimeFactor": 0.02365020345245111,
      "firstChunkMs": 61.67666698456742,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 633.0684589920565,
      "totalMs": 843.3222089952324,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 214.61870800703764,
      "inferenceMs": 202.88720799726434,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 41.40231453189135,
      "realTimeFactor": 0.024153239047293374,
      "firstChunkMs": 62.48629098990932,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 633.0684589920565,
      "totalMs": 847.6871669990942,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 218.07691699359566,
      "inferenceMs": 205.81566699547693,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 40.81321953097284,
      "realTimeFactor": 0.02450186511850916,
      "firstChunkMs": 66.04149998747744,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 609.3802499817684,
      "totalMs": 827.4571669753641,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "q8",
      "cpuThreads": 4,
      "rssBytes": 373293056,
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "WER",
      "errorRate": 0,
      "maximumErrorRate": 0,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 21.076542005175725,
      "inferenceMs": 15.12220801669173,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 132.25581858101816,
      "realTimeFactor": 0.007561104008345865,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 609.3802499817684,
      "totalMs": 630.4567919869442,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "q8",
      "cpuThreads": 4,
      "rssBytes": 373440512,
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 219.02304200921208,
      "inferenceMs": 205.9895839774981,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 40.77876093442472,
      "realTimeFactor": 0.024522569521130726,
      "firstChunkMs": 65.22441701963544,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 609.3802499817684,
      "totalMs": 828.4032919909805,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 217.75520898518153,
      "inferenceMs": 205.55762498406693,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 40.86445346238602,
      "realTimeFactor": 0.02447114583143654,
      "firstChunkMs": 64.72500000381842,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 609.3802499817684,
      "totalMs": 827.13545896695,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 214.55624999362044,
      "inferenceMs": 202.43412497802638,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 41.49498016162935,
      "realTimeFactor": 0.024099300592622188,
      "firstChunkMs": 63.2570419984404,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 609.3802499817684,
      "totalMs": 823.9364999753889,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 212.93716700165533,
      "inferenceMs": 201.0554579901509,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 41.77951737282104,
      "realTimeFactor": 0.023935173570256058,
      "firstChunkMs": 63.24950000271201,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 609.3802499817684,
      "totalMs": 822.3174169834238,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  },
  {
    "precision": "q8",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 212.37945900065824,
      "inferenceMs": 200.08795900503173,
      "audioSeconds": 8.4,
      "audioSecondsPerSecond": 41.98153672899807,
      "realTimeFactor": 0.023819995119646636,
      "firstChunkMs": 63.54195898165926,
      "chunkCount": 28,
      "placement": {
        "encoder": "CPUExecutionProvider",
        "decoder": "CPUExecutionProvider"
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitCpuFallback": false,
      "streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
      "loadMs": 609.3802499817684,
      "totalMs": 821.7597089824267,
      "grade": "fast",
      "engine": "onnxruntime",
      "version": "1.31.1",
      "artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
    }
  }
]

Moonshine Base — Mandarin Speech Recognition Desktop

96 configurations tested
Passed96
Failed0
TestedNov 13, 2026
Runtimetransformers 5.22.1

Quality criteria

Mandarin CER <=0.20 on three independent Google FLEURS read clips, <=0.30 controlled noise, exact empty silence, EOS/no loops, warm RTF <=1; not broad Mandarin quality.

PrecisionDeviceResultPlatformInference / loadTask metric
BF16mpsAcceleratedPassedVery fastmacos · aarch6459 ms / 1922 ms0.030 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch6463 ms / 1963 ms0.031 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch6463 ms / 1857 ms0.032 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch6465 ms / 1959 ms0.032 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch6465 ms / 1919 ms0.033 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch6465 ms / 1859 ms0.033 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch6468 ms / 1994 ms0.034 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch6469 ms / 1899 ms0.034 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch6471 ms / 1867 ms0.035 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64354 ms / 1919 ms0.037 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64384 ms / 1963 ms0.040 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64504 ms / 1857 ms0.052 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64461 ms / 1919 ms0.061 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64468 ms / 1963 ms0.062 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64606 ms / 1857 ms0.080 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64608 ms / 1959 ms0.082 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64615 ms / 1963 ms0.083 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64616 ms / 1994 ms0.083 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64616 ms / 1919 ms0.083 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64616 ms / 1899 ms0.083 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64617 ms / 1899 ms0.083 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64618 ms / 1994 ms0.083 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64618 ms / 1919 ms0.083 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64618 ms / 1994 ms0.083 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64619 ms / 1994 ms0.083 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64619 ms / 1963 ms0.083 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64621 ms / 1959 ms0.083 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64623 ms / 1959 ms0.084 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64623 ms / 1919 ms0.084 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64623 ms / 1919 ms0.084 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64624 ms / 1899 ms0.084 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64627 ms / 1963 ms0.084 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64629 ms / 1919 ms0.085 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64630 ms / 1919 ms0.085 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64630 ms / 1959 ms0.085 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64633 ms / 1867 ms0.085 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64634 ms / 1857 ms0.085 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64635 ms / 1859 ms0.085 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64637 ms / 1994 ms0.086 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64638 ms / 1867 ms0.086 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64638 ms / 1857 ms0.086 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64639 ms / 1963 ms0.086 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64640 ms / 1857 ms0.086 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64640 ms / 1922 ms0.086 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64647 ms / 1899 ms0.087 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64647 ms / 1922 ms0.087 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64650 ms / 1963 ms0.087 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64650 ms / 1859 ms0.087 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64652 ms / 1857 ms0.088 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64653 ms / 1857 ms0.088 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64653 ms / 1859 ms0.088 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64655 ms / 1922 ms0.088 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64659 ms / 1959 ms0.089 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64665 ms / 1859 ms0.089 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64667 ms / 1867 ms0.090 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64676 ms / 1867 ms0.091 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64676 ms / 1859 ms0.091 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64677 ms / 1867 ms0.091 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64680 ms / 1857 ms0.091 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64688 ms / 1922 ms0.092 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64690 ms / 1963 ms0.093 RTF
FP16mpsAcceleratedPassedVery fastmacos · aarch64693 ms / 1899 ms0.093 RTF
BF16mpsAcceleratedPassedVery fastmacos · aarch64698 ms / 1922 ms0.094 RTF
BF16mpsAcceleratedPassedFastmacos · aarch641262 ms / 1922 ms0.170 RTF
FP16mpsAcceleratedPassedFastmacos · aarch641273 ms / 1899 ms0.171 RTF
FP32mpsAcceleratedPassedFastmacos · aarch641286 ms / 1859 ms0.173 RTF
BF16mpsAcceleratedPassedFastmacos · aarch641299 ms / 1994 ms0.175 RTF
FP32mpsAcceleratedPassedFastmacos · aarch641315 ms / 1867 ms0.177 RTF
FP16mpsAcceleratedPassedFastmacos · aarch641362 ms / 1959 ms0.183 RTF
BF16mpsAcceleratedPassedFastmacos · aarch641532 ms / 1919 ms0.206 RTF
FP16mpsAcceleratedPassedFastmacos · aarch641593 ms / 1963 ms0.214 RTF
FP32mpsAcceleratedPassedFastmacos · aarch641634 ms / 1857 ms0.220 RTF
FP32cpuPassedVery fastmacos · aarch6418 ms / 1802 ms0.009 RTF
FP32cpuPassedVery fastmacos · aarch6418 ms / 1807 ms0.009 RTF
FP32cpuPassedVery fastmacos · aarch6418 ms / 1868 ms0.009 RTF
FP32cpuPassedVery fastmacos · aarch64165 ms / 1802 ms0.017 RTF
FP32cpuPassedVery fastmacos · aarch64325 ms / 1802 ms0.043 RTF
FP32cpuPassedVery fastmacos · aarch64478 ms / 1807 ms0.064 RTF
FP32cpuPassedVery fastmacos · aarch64482 ms / 1807 ms0.065 RTF
FP32cpuPassedVery fastmacos · aarch64482 ms / 1802 ms0.065 RTF
FP32cpuPassedVery fastmacos · aarch64485 ms / 1868 ms0.065 RTF
FP32cpuPassedVery fastmacos · aarch64485 ms / 1868 ms0.065 RTF
FP32cpuPassedVery fastmacos · aarch64488 ms / 1807 ms0.066 RTF
FP32cpuPassedVery fastmacos · aarch64488 ms / 1802 ms0.066 RTF
FP32cpuPassedVery fastmacos · aarch64489 ms / 1807 ms0.066 RTF
FP32cpuPassedVery fastmacos · aarch64496 ms / 1802 ms0.067 RTF
FP32cpuPassedVery fastmacos · aarch64496 ms / 1807 ms0.067 RTF
FP32cpuPassedVery fastmacos · aarch64497 ms / 1868 ms0.067 RTF
FP32cpuPassedVery fastmacos · aarch64500 ms / 1868 ms0.067 RTF
FP32cpuPassedVery fastmacos · aarch64500 ms / 1807 ms0.067 RTF
FP32cpuPassedVery fastmacos · aarch64500 ms / 1802 ms0.067 RTF
FP32cpuPassedVery fastmacos · aarch64500 ms / 1868 ms0.067 RTF
FP32cpuPassedVery fastmacos · aarch64501 ms / 1802 ms0.067 RTF
FP32cpuPassedVery fastmacos · aarch64505 ms / 1802 ms0.068 RTF
FP32cpuPassedVery fastmacos · aarch64532 ms / 1868 ms0.072 RTF
FP32cpuPassedFastmacos · aarch64792 ms / 1802 ms0.106 RTF
Test setup & sample details
Quality gate
Mandarin CER <=0.20 on three independent Google FLEURS read clips, <=0.30 controlled noise, exact empty silence, EOS/no loops, warm RTF <=1; not broad Mandarin quality.
Tested
2026-11-13T00:52:18.125959+00:00
Environment
{ "os": "macos", "arch": "aarch64", "hardware": "Apple M3 Max", "osVersion": "27.2", "runtime": "Transformers5.22.1/Torch2.10.0", "interpreter": "App-ownedCPython3.13.18 pinned development venv" }
Runtime
transformers 5.22.1
Artifact revision
438855be0ca8ccc32da89997f85f9cad4ed1b40b
Fixture
{
  "file": "model-samples/desktop/moonshine-streaming-family/cmn_hans_cn-clean-0.wav",
  "size": 238124,
  "sha1": "4128ee721c81ed07ea55512c7d8eedead80886f7",
  "sha256": "89bbbd987fc42bf2d3f6ead3a38cdc5f5132a2a528702c444f9639dd45ca97c4",
  "url": "https://assets.localai.tools/samples/v1/files/89bbbd987fc42bf2d3f6ead3a38cdc5f5132a2a528702c444f9639dd45ca97c4/cmn_hans_cn-clean-0.wav"
}
Rerun when
artifact revision change; runtime version change; fixture or frozen quality gate change; relevant backend behavior change
Per-case quality & failure details
[
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0.08571428571428572,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 792.4022920196876,
      "inferenceMs": 791.9555830012541,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 9.39446625504529,
      "realTimeFactor": 0.10644564287651265,
      "firstChunkMs": 334.65054200496525,
      "chunkCount": 69,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1802.4603330122773,
      "totalMs": 2594.862625031965,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 668549120,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 325.2719170122873,
      "inferenceMs": 325.0333329779096,
      "audioSeconds": 7.56,
      "audioSecondsPerSecond": 23.25915293282798,
      "realTimeFactor": 0.042993827113480106,
      "firstChunkMs": 45.77395800151862,
      "chunkCount": 50,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1802.4603330122773,
      "totalMs": 2127.7322500245646,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 672497664,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0.06666666666666667,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 165.2684590080753,
      "inferenceMs": 165.0502079864964,
      "audioSeconds": 9.66,
      "audioSecondsPerSecond": 58.527645119903966,
      "realTimeFactor": 0.017085942855744968,
      "firstChunkMs": 51.30137500236742,
      "chunkCount": 16,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1802.4603330122773,
      "totalMs": 1967.7287920203526,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 692551680,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0.08571428571428572,
      "maximumErrorRate": 0.3,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 496.1740830040071,
      "inferenceMs": 495.941250002943,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 15.001776924093026,
      "realTimeFactor": 0.06665877016168588,
      "firstChunkMs": 36.329208000097424,
      "chunkCount": 69,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1802.4603330122773,
      "totalMs": 2298.6344160162844,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 695074816,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0,
      "maximumErrorRate": 0,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 17.758041998604313,
      "inferenceMs": 17.54349999828264,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 114.00233705906933,
      "realTimeFactor": 0.00877174999914132,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1802.4603330122773,
      "totalMs": 1820.2183750108816,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 695107584,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 500.55416600662284,
      "inferenceMs": 500.3281249955762,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 14.870241404210054,
      "realTimeFactor": 0.06724840389725487,
      "firstChunkMs": 36.76333301700652,
      "chunkCount": 69,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1802.4603330122773,
      "totalMs": 2303.0144990189,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 488.4615000046324,
      "inferenceMs": 488.2290839741472,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 15.23874804720557,
      "realTimeFactor": 0.06562218870620258,
      "firstChunkMs": 36.07787500368431,
      "chunkCount": 69,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1802.4603330122773,
      "totalMs": 2290.9218330169097,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 500.90570902102627,
      "inferenceMs": 500.69645800977014,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 14.859302239870894,
      "realTimeFactor": 0.06729791102281857,
      "firstChunkMs": 34.89245902164839,
      "chunkCount": 69,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1802.4603330122773,
      "totalMs": 2303.3660420333035,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 482.25066700251773,
      "inferenceMs": 482.03566699521616,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 15.434542523331238,
      "realTimeFactor": 0.06478974018752906,
      "firstChunkMs": 36.13300001597963,
      "chunkCount": 69,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1802.4603330122773,
      "totalMs": 2284.711000014795,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 505.150709010195,
      "inferenceMs": 504.9496659776196,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 14.734141838861532,
      "realTimeFactor": 0.06786957876043274,
      "firstChunkMs": 37.1455000131391,
      "chunkCount": 69,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1802.4603330122773,
      "totalMs": 2307.6110420224722,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0.08571428571428572,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 532.7741669898387,
      "inferenceMs": 532.2790000063833,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 13.977632031154295,
      "realTimeFactor": 0.071542876344944,
      "firstChunkMs": 51.93208300624974,
      "chunkCount": 69,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1868.3132500154898,
      "totalMs": 2401.0874170053285,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 668663808,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0,
      "maximumErrorRate": 0,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 18.5442499932833,
      "inferenceMs": 18.330958992009982,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 109.1050392329038,
      "realTimeFactor": 0.009165479496004991,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1868.3132500154898,
      "totalMs": 1886.857500008773,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 669237248,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 500.7474579906557,
      "inferenceMs": 500.48987500485964,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 14.865435589336867,
      "realTimeFactor": 0.06727014448990049,
      "firstChunkMs": 36.380917008500546,
      "chunkCount": 69,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1868.3132500154898,
      "totalMs": 2369.0607080061454,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 485.31474999617785,
      "inferenceMs": 485.1087910064962,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 15.336765974831344,
      "realTimeFactor": 0.06520279449012045,
      "firstChunkMs": 36.865125002805144,
      "chunkCount": 69,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1868.3132500154898,
      "totalMs": 2353.6280000116676,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 497.30166600784287,
      "inferenceMs": 497.0900419866666,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 14.967107307692883,
      "realTimeFactor": 0.06681317768637993,
      "firstChunkMs": 37.20583298127167,
      "chunkCount": 69,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1868.3132500154898,
      "totalMs": 2365.6149160233326,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 485.2708750113379,
      "inferenceMs": 485.06158401141874,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 15.33825857424499,
      "realTimeFactor": 0.06519644946390037,
      "firstChunkMs": 37.568416009889916,
      "chunkCount": 69,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1868.3132500154898,
      "totalMs": 2353.5841250268277,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 499.9074999941513,
      "inferenceMs": 499.68258300214075,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 14.889452330517043,
      "realTimeFactor": 0.06716163750028774,
      "firstChunkMs": 36.00066699436866,
      "chunkCount": 69,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1868.3132500154898,
      "totalMs": 2368.220750009641,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0.08571428571428572,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 500.3781659761444,
      "inferenceMs": 499.9287080136128,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 14.882121952071241,
      "realTimeFactor": 0.06719471881903398,
      "firstChunkMs": 48.72174997581169,
      "chunkCount": 69,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1806.9622500042897,
      "totalMs": 2307.340415980434,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 668008448,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0,
      "maximumErrorRate": 0,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 17.84670798224397,
      "inferenceMs": 17.64295800239779,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 113.35967583940217,
      "realTimeFactor": 0.008821479001198895,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1806.9622500042897,
      "totalMs": 1824.8089579865336,
      "grade": "fast",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 668123136,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 482.1556670067366,
      "inferenceMs": 481.9297919748351,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 15.437933333634819,
      "realTimeFactor": 0.06477550967403697,
      "firstChunkMs": 35.97754199290648,
      "chunkCount": 69,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1806.9622500042897,
      "totalMs": 2289.1179170110263,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 489.3932919949293,
      "inferenceMs": 489.17516600340605,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 15.209275770855868,
      "realTimeFactor": 0.065749350269275,
      "firstChunkMs": 35.8150829852093,
      "chunkCount": 69,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1806.9622500042897,
      "totalMs": 2296.355541999219,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 496.47800001548603,
      "inferenceMs": 496.2295409932267,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 14.993061447144989,
      "realTimeFactor": 0.06669751895070251,
      "firstChunkMs": 36.45433302153833,
      "chunkCount": 69,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1806.9622500042897,
      "totalMs": 2303.4402500197757,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 478.0478329921607,
      "inferenceMs": 477.8297909942921,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 15.570397953879093,
      "realTimeFactor": 0.06422443427342636,
      "firstChunkMs": 36.1024999874644,
      "chunkCount": 69,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1806.9622500042897,
      "totalMs": 2285.0100829964504,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 488.4470420074649,
      "inferenceMs": 488.21674997452646,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 15.239133029311663,
      "realTimeFactor": 0.06562053091055463,
      "firstChunkMs": 35.69504202459939,
      "chunkCount": 69,
      "placement": {
        "cpu/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "cpu",
        "logits": "cpu"
      },
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": null,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1806.9622500042897,
      "totalMs": 2295.4092920117546,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0.08571428571428572,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 1635.9869579900987,
      "inferenceMs": 1634.309083019616,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 4.552382457701057,
      "realTimeFactor": 0.21966519933059356,
      "firstChunkMs": 463.93462500418536,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1274642432,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1857.3121250083204,
      "totalMs": 3493.299082998419,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 675086336,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 607.6802500174381,
      "inferenceMs": 606.0242080129683,
      "audioSeconds": 7.56,
      "audioSecondsPerSecond": 12.474749193250418,
      "realTimeFactor": 0.08016193227684766,
      "firstChunkMs": 219.8224160238169,
      "chunkCount": 50,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1281769472,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1857.3121250083204,
      "totalMs": 2464.9923750257585,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 690356224,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0.06666666666666667,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 505.4510830086656,
      "inferenceMs": 504.3968340032734,
      "audioSeconds": 9.66,
      "audioSecondsPerSecond": 19.151587299489886,
      "realTimeFactor": 0.05221499316804072,
      "firstChunkMs": 346.65437499643303,
      "chunkCount": 16,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1309687808,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1857.3121250083204,
      "totalMs": 2362.763208016986,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 705740800,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0.08571428571428572,
      "maximumErrorRate": 0.3,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 641.7787919926923,
      "inferenceMs": 640.1542919920757,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.622198106096738,
      "realTimeFactor": 0.08604224354732201,
      "firstChunkMs": 34.69604201382026,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1309687808,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1857.3121250083204,
      "totalMs": 2499.0909170010127,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 706543616,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0,
      "maximumErrorRate": 0,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 64.2633750103414,
      "inferenceMs": 63.2681249990128,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 31.61149473026436,
      "realTimeFactor": 0.0316340624995064,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1311457280,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1857.3121250083204,
      "totalMs": 1921.5755000186618,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 720404480,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 682.1881669748109,
      "inferenceMs": 680.2302919968497,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 10.93747233478755,
      "realTimeFactor": 0.09142880268774861,
      "firstChunkMs": 39.87629199400544,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1311457280,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1857.3121250083204,
      "totalMs": 2539.5002919831313,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 640.0353330245707,
      "inferenceMs": 638.4824590058997,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.652630225086972,
      "realTimeFactor": 0.08581753481262093,
      "firstChunkMs": 41.147375013679266,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1311457280,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1857.3121250083204,
      "totalMs": 2497.347458032891,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 653.2571669958998,
      "inferenceMs": 651.880749996053,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.413130392399296,
      "realTimeFactor": 0.08761838037581358,
      "firstChunkMs": 34.98287498950958,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1311457280,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1857.3121250083204,
      "totalMs": 2510.56929200422,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 635.5329170182813,
      "inferenceMs": 633.9898750011344,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.735203184414717,
      "realTimeFactor": 0.08521369287649655,
      "firstChunkMs": 36.533125006826594,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1311457280,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1857.3121250083204,
      "totalMs": 2492.8450420266017,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 654.2144999839365,
      "inferenceMs": 652.7482920209877,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.397961650676802,
      "realTimeFactor": 0.0877349854866919,
      "firstChunkMs": 34.13108398672193,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1311457280,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1857.3121250083204,
      "totalMs": 2511.526624992257,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0.08571428571428572,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 1316.1509159835987,
      "inferenceMs": 1314.7572499874514,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 5.658839302898699,
      "realTimeFactor": 0.1767146841380983,
      "firstChunkMs": 170.7142079831101,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1274642432,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1867.0895420073066,
      "totalMs": 3183.2404579909053,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 672481280,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0,
      "maximumErrorRate": 0,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 72.37562499358319,
      "inferenceMs": 70.93970800633542,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 28.19295506293014,
      "realTimeFactor": 0.03546985400316771,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1275494400,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1867.0895420073066,
      "totalMs": 1939.4651670008898,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 686866432,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 678.5197909921408,
      "inferenceMs": 677.3631670221221,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 10.98376817964331,
      "realTimeFactor": 0.09104343642770459,
      "firstChunkMs": 46.32291599409655,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1275494400,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1867.0895420073066,
      "totalMs": 2545.6093329994474,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 676.8669169978239,
      "inferenceMs": 675.7897499774117,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.009341293277506,
      "realTimeFactor": 0.09083195564212523,
      "firstChunkMs": 38.85650000302121,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1275494400,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1867.0895420073066,
      "totalMs": 2543.9564590051305,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 634.7340420179535,
      "inferenceMs": 633.2601670001168,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.748725701862483,
      "realTimeFactor": 0.08511561384410171,
      "firstChunkMs": 36.24983300687745,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1275494400,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1867.0895420073066,
      "totalMs": 2501.82358402526,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 668.3532500173897,
      "inferenceMs": 667.0127919933293,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.154208868717479,
      "realTimeFactor": 0.0896522569883507,
      "firstChunkMs": 35.577167000155896,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1275494400,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1867.0895420073066,
      "totalMs": 2535.4427920246962,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 638.9905829855707,
      "inferenceMs": 637.9504590004217,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.662347593036346,
      "realTimeFactor": 0.08574602943554055,
      "firstChunkMs": 36.951791000319645,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1275494400,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1867.0895420073066,
      "totalMs": 2506.0801249928772,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0.08571428571428572,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 1287.4344580050092,
      "inferenceMs": 1286.2701250123791,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 5.784166059153708,
      "realTimeFactor": 0.17288576949091117,
      "firstChunkMs": 157.33295801328495,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1274642432,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1859.1165420075413,
      "totalMs": 3146.5510000125505,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 670547968,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0,
      "maximumErrorRate": 0,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 66.7213749838993,
      "inferenceMs": 65.40495800436474,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 30.578721568272112,
      "realTimeFactor": 0.03270247900218237,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1275494400,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1859.1165420075413,
      "totalMs": 1925.8379169914406,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "cpuThreads": 4,
      "rssBytes": 685129728,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 651.4430410170462,
      "inferenceMs": 650.0531669880729,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.445217680381685,
      "realTimeFactor": 0.0873727374983969,
      "firstChunkMs": 41.652957996120676,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1275494400,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1859.1165420075413,
      "totalMs": 2510.5595830245875,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 677.7122909843456,
      "inferenceMs": 675.821792014176,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.008819318812288,
      "realTimeFactor": 0.09083626236749678,
      "firstChunkMs": 38.76216599019244,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1275494400,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1859.1165420075413,
      "totalMs": 2536.828832991887,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 636.2853329919744,
      "inferenceMs": 635.1216670009308,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.714290956458736,
      "realTimeFactor": 0.08536581545711434,
      "firstChunkMs": 37.48108298168518,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1275494400,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1859.1165420075413,
      "totalMs": 2495.4018749995157,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 654.8187920125201,
      "inferenceMs": 653.3792499976698,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.38695481992508,
      "realTimeFactor": 0.08781979166635347,
      "firstChunkMs": 36.38645799946971,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1275494400,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1859.1165420075413,
      "totalMs": 2513.9353340200614,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 667.6545419904869,
      "inferenceMs": 665.2057080063969,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.18451016046972,
      "realTimeFactor": 0.0894093693556985,
      "firstChunkMs": 39.493958989623934,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float32": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1275494400,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1859.1165420075413,
      "totalMs": 2526.771083998028,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0.08571428571428572,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 1594.4152499723714,
      "inferenceMs": 1592.7153750089929,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 4.67126777121618,
      "realTimeFactor": 0.21407464717862806,
      "firstChunkMs": 426.2779999990016,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1194950656,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1963.2111669925507,
      "totalMs": 3557.626416964922,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp16",
      "cpuThreads": 4,
      "rssBytes": 762626048,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 469.1172919992823,
      "inferenceMs": 467.66858402406797,
      "audioSeconds": 7.56,
      "audioSecondsPerSecond": 16.165293667899945,
      "realTimeFactor": 0.06186092381270741,
      "firstChunkMs": 91.1362079787068,
      "chunkCount": 50,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1202077696,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1963.2111669925507,
      "totalMs": 2432.328458991833,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp16",
      "cpuThreads": 4,
      "rssBytes": 779878400,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0.06666666666666667,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 385.37929102312773,
      "inferenceMs": 383.7704580218997,
      "audioSeconds": 9.66,
      "audioSecondsPerSecond": 25.171296534369397,
      "realTimeFactor": 0.03972779068549686,
      "firstChunkMs": 203.52387501043268,
      "chunkCount": 16,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1221607424,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1963.2111669925507,
      "totalMs": 2348.5904580156785,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp16",
      "cpuThreads": 4,
      "rssBytes": 796065792,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0.08571428571428572,
      "maximumErrorRate": 0.3,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 620.6530409981497,
      "inferenceMs": 619.3394589936361,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 12.012798299803547,
      "realTimeFactor": 0.08324455094000485,
      "firstChunkMs": 32.34049997990951,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1221607424,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1963.2111669925507,
      "totalMs": 2583.8642079907004,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp16",
      "cpuThreads": 4,
      "rssBytes": 796950528,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0,
      "maximumErrorRate": 0,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 64.26920901867561,
      "inferenceMs": 62.91562499245629,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 31.788605775430256,
      "realTimeFactor": 0.031457812496228144,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1223376896,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1963.2111669925507,
      "totalMs": 2027.4803760112263,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp16",
      "cpuThreads": 4,
      "rssBytes": 811024384,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 651.0692499869037,
      "inferenceMs": 649.9482920044102,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.44706446886011,
      "realTimeFactor": 0.08735864139844222,
      "firstChunkMs": 35.27854199637659,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1223376896,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1963.2111669925507,
      "totalMs": 2614.2804169794545,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 616.8102090014145,
      "inferenceMs": 615.1399590016808,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 12.094808492159215,
      "realTimeFactor": 0.08268010201635495,
      "firstChunkMs": 38.78820899990387,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1223376896,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1963.2111669925507,
      "totalMs": 2580.021375993965,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 628.6654580035247,
      "inferenceMs": 627.2297499817796,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.861682262705372,
      "realTimeFactor": 0.0843050739222822,
      "firstChunkMs": 34.320542006753385,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1223376896,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1963.2111669925507,
      "totalMs": 2591.8766249960754,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 691.9874580053147,
      "inferenceMs": 690.2382919797674,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 10.77888619980835,
      "realTimeFactor": 0.09277396397577518,
      "firstChunkMs": 39.35820801416412,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1223376896,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1963.2111669925507,
      "totalMs": 2655.1986249978654,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 640.8292499836534,
      "inferenceMs": 638.9600410184357,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.643920624741128,
      "realTimeFactor": 0.08588172594333814,
      "firstChunkMs": 36.812499980442226,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1223376896,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1963.2111669925507,
      "totalMs": 2604.040416976204,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0.08571428571428572,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 1364.658500009682,
      "inferenceMs": 1362.4806669831742,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 5.460627941586697,
      "realTimeFactor": 0.18312912190634062,
      "firstChunkMs": 197.15333302156068,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1194950656,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1959.1342500061728,
      "totalMs": 3323.792750015855,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp16",
      "cpuThreads": 4,
      "rssBytes": 784154624,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0,
      "maximumErrorRate": 0,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 66.60904199816287,
      "inferenceMs": 64.5622499869205,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 30.977854712392684,
      "realTimeFactor": 0.03228112499346025,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1195802624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1959.1342500061728,
      "totalMs": 2025.7432920043357,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp16",
      "cpuThreads": 4,
      "rssBytes": 799080448,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 622.7425840042997,
      "inferenceMs": 621.1962910019793,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.976890570288829,
      "realTimeFactor": 0.08349412513467463,
      "firstChunkMs": 36.17995901731774,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1195802624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1959.1342500061728,
      "totalMs": 2581.8768340104725,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 660.923332994571,
      "inferenceMs": 659.3525000207592,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.28379736145045,
      "realTimeFactor": 0.08862264785225257,
      "firstChunkMs": 34.1675829840824,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1195802624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1959.1342500061728,
      "totalMs": 2620.0575830007438,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 609.1323329892475,
      "inferenceMs": 608.1653330184054,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 12.233515453888652,
      "realTimeFactor": 0.08174265228742007,
      "firstChunkMs": 30.94358299858868,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1195802624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1959.1342500061728,
      "totalMs": 2568.2665829954203,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 624.0923750156071,
      "inferenceMs": 622.6542909862474,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.948845623813952,
      "realTimeFactor": 0.08369009287449561,
      "firstChunkMs": 29.835708992322907,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1195802624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1959.1342500061728,
      "totalMs": 2583.22662502178,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 631.3593329978175,
      "inferenceMs": 630.35600000876,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.802854259968347,
      "realTimeFactor": 0.08472526881838173,
      "firstChunkMs": 42.955415992764756,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1195802624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1959.1342500061728,
      "totalMs": 2590.4935830039904,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0.08571428571428572,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 1274.7179589932784,
      "inferenceMs": 1273.089541005902,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 5.844050838813316,
      "realTimeFactor": 0.17111418561907285,
      "firstChunkMs": 171.57566698733717,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1194950656,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1899.092165986076,
      "totalMs": 3173.8101249793544,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp16",
      "cpuThreads": 4,
      "rssBytes": 760020992,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0,
      "maximumErrorRate": 0,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 69.57058300031349,
      "inferenceMs": 68.53320798836648,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 29.182932751951434,
      "realTimeFactor": 0.03426660399418324,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1195802624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1899.092165986076,
      "totalMs": 1968.6627489863895,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "fp16",
      "cpuThreads": 4,
      "rssBytes": 774619136,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 618.2227919925936,
      "inferenceMs": 616.7397920216899,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 12.06343436283149,
      "realTimeFactor": 0.08289513333624865,
      "firstChunkMs": 36.53650000342168,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1195802624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1899.092165986076,
      "totalMs": 2517.3149579786696,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 625.6796660018153,
      "inferenceMs": 623.9317919826135,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.92438034990742,
      "realTimeFactor": 0.0838617999976631,
      "firstChunkMs": 30.994458007626235,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1195802624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1899.092165986076,
      "totalMs": 2524.7718319878913,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 647.6394579804037,
      "inferenceMs": 646.610875002807,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.506147340883654,
      "realTimeFactor": 0.0869100638444633,
      "firstChunkMs": 33.297707996098325,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1195802624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1899.092165986076,
      "totalMs": 2546.7316239664797,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 693.9269579888787,
      "inferenceMs": 692.808083986165,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 10.738904715419823,
      "realTimeFactor": 0.09311936612717271,
      "firstChunkMs": 33.41000000364147,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1195802624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1899.092165986076,
      "totalMs": 2593.0191239749547,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 617.9765419801697,
      "inferenceMs": 616.4422080037184,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 12.06925791810012,
      "realTimeFactor": 0.08285513548437075,
      "firstChunkMs": 35.63420899445191,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.float16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1195802624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1899.092165986076,
      "totalMs": 2517.0687079662457,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0.08571428571428572,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 1533.907208009623,
      "inferenceMs": 1532.1605000062846,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 4.85588813963647,
      "realTimeFactor": 0.20593555107611353,
      "firstChunkMs": 433.8444159948267,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1194950656,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1918.6880000052042,
      "totalMs": 3452.595208014827,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "bf16",
      "cpuThreads": 4,
      "rssBytes": 784793600,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 462.2084579896182,
      "inferenceMs": 461.1729999887757,
      "audioSeconds": 7.56,
      "audioSecondsPerSecond": 16.392980508798214,
      "realTimeFactor": 0.06100171957523488,
      "firstChunkMs": 88.42025001649745,
      "chunkCount": 50,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1202077696,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1918.6880000052042,
      "totalMs": 2380.8964579948224,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "bf16",
      "cpuThreads": 4,
      "rssBytes": 801734656,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0.06666666666666667,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 355.1482080074493,
      "inferenceMs": 353.62583299865946,
      "audioSeconds": 9.66,
      "audioSecondsPerSecond": 27.317008822815893,
      "realTimeFactor": 0.036607229088888145,
      "firstChunkMs": 204.72716700169258,
      "chunkCount": 16,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1221607424,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1918.6880000052042,
      "totalMs": 2273.8362080126535,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "bf16",
      "cpuThreads": 4,
      "rssBytes": 818216960,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0.08571428571428572,
      "maximumErrorRate": 0.3,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 631.1552080151159,
      "inferenceMs": 630.133124999702,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.807028871880872,
      "realTimeFactor": 0.08469531249995994,
      "firstChunkMs": 34.849166026106104,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1221607424,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1918.6880000052042,
      "totalMs": 2549.84320802032,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "bf16",
      "cpuThreads": 4,
      "rssBytes": 819036160,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0,
      "maximumErrorRate": 0,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 67.09908400080167,
      "inferenceMs": 65.16858300892636,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 30.689634600863627,
      "realTimeFactor": 0.03258429150446318,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1223376896,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1918.6880000052042,
      "totalMs": 1985.787084006006,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "bf16",
      "cpuThreads": 4,
      "rssBytes": 833110016,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 617.4187079886906,
      "inferenceMs": 616.3689579989295,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 12.070692242766906,
      "realTimeFactor": 0.08284529005361957,
      "firstChunkMs": 38.533874991117045,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1223376896,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1918.6880000052042,
      "totalMs": 2536.106707993895,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 630.1444999990053,
      "inferenceMs": 628.7825409963261,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.832389601993532,
      "realTimeFactor": 0.08451378239197932,
      "firstChunkMs": 33.044417010387406,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1223376896,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1918.6880000052042,
      "totalMs": 2548.8325000042096,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 624.7813750233036,
      "inferenceMs": 622.9403750039637,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.943358142346545,
      "realTimeFactor": 0.08372854502741447,
      "firstChunkMs": 39.35450001154095,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1223376896,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1918.6880000052042,
      "totalMs": 2543.469375028508,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 624.7998749895487,
      "inferenceMs": 622.7682090247981,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.946659916456566,
      "realTimeFactor": 0.08370540443881695,
      "firstChunkMs": 36.102458980167285,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1223376896,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1918.6880000052042,
      "totalMs": 2543.487874994753,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 619.499916996574,
      "inferenceMs": 617.8061249956954,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 12.042612882887553,
      "realTimeFactor": 0.08303845766071175,
      "firstChunkMs": 38.03287498885766,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1223376896,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1918.6880000052042,
      "totalMs": 2538.1879170017783,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0.08571428571428572,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 1301.104749989463,
      "inferenceMs": 1299.3823339929804,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 5.725797408016933,
      "realTimeFactor": 0.17464816317109952,
      "firstChunkMs": 164.44179098471068,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1194950656,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1994.029291003244,
      "totalMs": 3295.134040992707,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "bf16",
      "cpuThreads": 4,
      "rssBytes": 787480576,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0,
      "maximumErrorRate": 0,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 69.5074170071166,
      "inferenceMs": 68.14654200570658,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 29.34851778440233,
      "realTimeFactor": 0.03407327100285329,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1195802624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1994.029291003244,
      "totalMs": 2063.5367080103606,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "bf16",
      "cpuThreads": 4,
      "rssBytes": 802095104,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 620.2170000178739,
      "inferenceMs": 618.7578329991084,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 12.024090206565065,
      "realTimeFactor": 0.08316637540310597,
      "firstChunkMs": 38.77725001075305,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1195802624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1994.029291003244,
      "totalMs": 2614.246291021118,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 638.6054579925258,
      "inferenceMs": 637.2613749990705,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.674958332459505,
      "realTimeFactor": 0.08565341061815464,
      "firstChunkMs": 35.95799999311566,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1195802624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1994.029291003244,
      "totalMs": 2632.6347489957698,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 618.6861660098657,
      "inferenceMs": 617.6562500186265,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 12.04553503631775,
      "realTimeFactor": 0.08301831317454657,
      "firstChunkMs": 34.09445800934918,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1195802624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1994.029291003244,
      "totalMs": 2612.7154570131097,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 617.6672499859706,
      "inferenceMs": 615.9791250247508,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 12.07833138777398,
      "realTimeFactor": 0.08279289314848802,
      "firstChunkMs": 30.250207986682653,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1195802624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1994.029291003244,
      "totalMs": 2611.6965409892146,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 619.104540994158,
      "inferenceMs": 617.9929170175456,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 12.038972931770301,
      "realTimeFactor": 0.0830635641152615,
      "firstChunkMs": 35.988040996016935,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1195802624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1994.029291003244,
      "totalMs": 2613.133831997402,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0.08571428571428572,
      "maximumErrorRate": 0.2,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 1263.995666988194,
      "inferenceMs": 1262.1014160104096,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 5.8949303959410475,
      "realTimeFactor": 0.16963728709817333,
      "firstChunkMs": 169.99308299273252,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1194950656,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1921.7479170183651,
      "totalMs": 3185.743584006559,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "bf16",
      "cpuThreads": 4,
      "rssBytes": 784891904,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "metric": "CER",
      "errorRate": 0,
      "maximumErrorRate": 0,
      "loop": false,
      "eos": true,
      "passed": true
    },
    "runtime": {
      "durationMs": 60.821082995971665,
      "inferenceMs": 59.45262499153614,
      "audioSeconds": 2,
      "audioSecondsPerSecond": 33.64023035626646,
      "realTimeFactor": 0.02972631249576807,
      "firstChunkMs": null,
      "chunkCount": 0,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1195802624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1921.7479170183651,
      "totalMs": 1982.5690000143368,
      "grade": "fast",
      "actualDevice": "mps",
      "actualPrecision": "bf16",
      "cpuThreads": 4,
      "rssBytes": 799866880,
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 689.3855000089388,
      "inferenceMs": 687.6803750055842,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 10.81897967488106,
      "realTimeFactor": 0.0924301579308581,
      "firstChunkMs": 56.09337502392009,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1195802624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1921.7479170183651,
      "totalMs": 2611.133417027304,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 699.4820000254549,
      "inferenceMs": 697.9427079786547,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 10.659900755389137,
      "realTimeFactor": 0.09380950376057186,
      "firstChunkMs": 31.372625002404675,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1195802624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1921.7479170183651,
      "totalMs": 2621.22991704382,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 641.2821249978151,
      "inferenceMs": 640.1919999916572,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.621513546087668,
      "realTimeFactor": 0.08604731182683564,
      "firstChunkMs": 30.909124994650483,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1195802624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1921.7479170183651,
      "totalMs": 2563.0300420161802,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 656.4791669952683,
      "inferenceMs": 655.020083009731,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.358430364171706,
      "realTimeFactor": 0.08804033373786707,
      "firstChunkMs": 30.96999999252148,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1195802624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1921.7479170183651,
      "totalMs": 2578.2270840136334,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "generateStreamParity": true
    },
    "runtime": {
      "durationMs": 647.7862499887124,
      "inferenceMs": 646.8434999987949,
      "audioSeconds": 7.44,
      "audioSecondsPerSecond": 11.502009373231488,
      "realTimeFactor": 0.08694133064499932,
      "firstChunkMs": 30.969707993790507,
      "chunkCount": 69,
      "placement": {
        "mps:0/torch.bfloat16": 210
      },
      "activationPlacement": {
        "encoder": "mps:0",
        "logits": "mps:0"
      },
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
      "driverAllocatedMemoryBytes": 1195802624,
      "memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
      "loadMs": 1921.7479170183651,
      "totalMs": 2569.5341670070775,
      "grade": "fast",
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
    }
  }
]
Release validation still required
  • Sample publication, full dependency backup and both model/runtime-source outage gates pending under upload exclusion.

Something not quite right?

Tell us what happened with Moonshine Desktop. Loading, results, or the page itself—we’re here for all of it.

Attachments Optional

Up to 3 files · 50 MB each

Browser, OS, CPU/GPU, memory, screen, storage, and network details are included automatically. Model inputs, results, and browsing history are not collected.