Moonshine Streaming
Transcribe short English WAV recordings locally with incremental decoder text. Compact Moonshine Streaming Tiny checkpoint; CPU is the measured recommendation on this Mac.
Desktop app
Run Moonshine Streaming on your computer
Download the desktop app to load this model, provide input and view results locally.
Public desktop downloads are coming soon.Device requirements
If your device falls short
MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.
GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.
PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.
Benchmark evidence
Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.
Moonshine Streaming Tiny · English
88 configurations testedQuality criteria
No explicit quality gate recorded. Review per-case evidence; full certification is pending.
| Precision | Device | Result | Platform | Inference / load | Task metric | |
|---|---|---|---|---|---|---|
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 168 ms / 0 ms | 0.015 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 171 ms / 0 ms | 0.016 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 176 ms / 0 ms | 0.016 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 176 ms / 0 ms | 0.016 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 177 ms / 0 ms | 0.016 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 178 ms / 0 ms | 0.016 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 178 ms / 0 ms | 0.016 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 181 ms / 0 ms | 0.016 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 181 ms / 0 ms | 0.016 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 182 ms / 0 ms | 0.017 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 183 ms / 0 ms | 0.017 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 183 ms / 0 ms | 0.017 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 185 ms / 0 ms | 0.017 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 186 ms / 0 ms | 0.017 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 187 ms / 0 ms | 0.017 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 189 ms / 0 ms | 0.017 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 191 ms / 0 ms | 0.017 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 191 ms / 0 ms | 0.017 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 194 ms / 0 ms | 0.018 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 196 ms / 0 ms | 0.018 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 197 ms / 0 ms | 0.018 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 197 ms / 0 ms | 0.018 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 198 ms / 0 ms | 0.018 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 199 ms / 0 ms | 0.018 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 199 ms / 0 ms | 0.018 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 201 ms / 0 ms | 0.018 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 203 ms / 0 ms | 0.018 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 203 ms / 0 ms | 0.018 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 203 ms / 0 ms | 0.018 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 204 ms / 0 ms | 0.019 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 205 ms / 0 ms | 0.019 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 206 ms / 0 ms | 0.019 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 207 ms / 0 ms | 0.019 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 208 ms / 0 ms | 0.019 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 208 ms / 0 ms | 0.019 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 208 ms / 0 ms | 0.019 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 208 ms / 0 ms | 0.019 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 210 ms / 0 ms | 0.019 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 212 ms / 0 ms | 0.019 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 212 ms / 0 ms | 0.019 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 214 ms / 0 ms | 0.019 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 220 ms / 0 ms | 0.020 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 229 ms / 0 ms | 0.021 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 230 ms / 0 ms | 0.021 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 232 ms / 0 ms | 0.021 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 235 ms / 0 ms | 0.021 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 238 ms / 0 ms | 0.022 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 239 ms / 0 ms | 0.022 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 662 ms / 0 ms | 0.029 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 730 ms / 0 ms | 0.032 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 766 ms / 0 ms | 0.034 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 503 ms / 182 ms | 0.046 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 506 ms / 245 ms | 0.046 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 509 ms / 266 ms | 0.046 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 510 ms / 207 ms | 0.046 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 512 ms / 198 ms | 0.047 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 524 ms / 186 ms | 0.048 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 541 ms / 235 ms | 0.049 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 611 ms / 191 ms | 0.056 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 112 ms / 0 ms | 0.056 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 652 ms / 250 ms | 0.059 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 127 ms / 0 ms | 0.064 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 219 ms / 0 ms | 0.064 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 135 ms / 0 ms | 0.067 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 238 ms / 0 ms | 0.070 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 250 ms / 0 ms | 0.074 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 18 ms / 0 ms | 0.009 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 257 ms / 0 ms | 0.011 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 129 ms / 0 ms | 0.012 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 129 ms / 0 ms | 0.012 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 130 ms / 0 ms | 0.012 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 130 ms / 0 ms | 0.012 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 131 ms / 117 ms | 0.012 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 131 ms / 0 ms | 0.012 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 132 ms / 0 ms | 0.012 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 132 ms / 0 ms | 0.012 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 132 ms / 0 ms | 0.012 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 133 ms / 0 ms | 0.012 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 134 ms / 0 ms | 0.012 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 136 ms / 0 ms | 0.012 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 136 ms / 0 ms | 0.012 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 137 ms / 125 ms | 0.012 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 138 ms / 0 ms | 0.013 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 141 ms / 0 ms | 0.013 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 143 ms / 0 ms | 0.013 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 183 ms / 0 ms | 0.017 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 95 ms / 0 ms | 0.028 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 345 ms / 163 ms | 0.031 RTF |
Test setup & sample details
- Quality gate
- No explicit quality gate recorded. Review the per-case quality evidence; full certification is pending.
- Tested
- 2026-11-04T21:39:01.623926+00:00
- Environment
- { "os": "macos", "arch": "aarch64", "hardware": "Apple M3 Max", "osVersion": "27.2", "runtime": "Transformers5.22.1/Torch2.10.0", "interpreter": "App-ownedCPython3.13.18 pinned development venv" }
- Runtime
- transformers 5.22.1
- Artifact revision
- f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a
- Fixture
{ "file": "model-samples/desktop/granite-speech5/granite-speech5-jfk.wav", "size": 3880888, "sha1": "6fb9dfd0ec18bb61a6af995c0df0cd32ee2afe34", "sha256": "c72e27f68334ae37e037ef819fa5aa1fc1552aa840b93e308df4ffe52317bedb", "url": "https://assets.localai.tools/samples/v1/files/c72e27f68334ae37e037ef819fa5aa1fc1552aa840b93e308df4ffe52317bedb/granite-speech5-jfk.wav" }- Rerun when
- Artifact/runtime/tokenizer revision; Audio decode/resampling, generation/stream decoding or input bounds; Fixture/reference/quality thresholds; Relevant OS/backend behavior
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 346.2197909830138,
"inferenceMs": 344.97662499779835,
"audioSeconds": 11,
"audioSecondsPerSecond": 31.886218378042866,
"realTimeFactor": 0.03136151136343621,
"firstChunkMs": 263.22491600876674,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 161
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 162.65875002136454,
"totalMs": 508.87854100437835,
"grade": "fast",
"device": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 133.80012498237193,
"inferenceMs": 133.5025830194354,
"audioSeconds": 11,
"audioSecondsPerSecond": 82.39540952101737,
"realTimeFactor": 0.01213659845631231,
"firstChunkMs": 53.6281670210883,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 161
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 133.80012498237193,
"grade": "fast",
"device": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 129.1437919717282,
"inferenceMs": 128.87037498876452,
"audioSeconds": 11,
"audioSecondsPerSecond": 85.3570884771541,
"realTimeFactor": 0.01171548863534223,
"firstChunkMs": 47.82533296383917,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 161
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 129.1437919717282,
"grade": "fast",
"device": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 131.37333397753537,
"inferenceMs": 131.13645801786333,
"audioSeconds": 11,
"audioSecondsPerSecond": 83.88208867515384,
"realTimeFactor": 0.011921496183442121,
"firstChunkMs": 47.596291988156736,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 161
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 131.37333397753537,
"grade": "fast",
"device": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 183.66054201032966,
"inferenceMs": 183.34983300883323,
"audioSeconds": 11,
"audioSecondsPerSecond": 59.99460059213718,
"realTimeFactor": 0.016668166637166658,
"firstChunkMs": 66.9083750108257,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 161
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 183.66054201032966,
"grade": "fast",
"device": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 130.12191699817777,
"inferenceMs": 129.86029201420024,
"audioSeconds": 11,
"audioSecondsPerSecond": 84.70641663732859,
"realTimeFactor": 0.011805481092200022,
"firstChunkMs": 51.758125016931444,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 161
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 130.12191699817777,
"grade": "fast",
"device": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 95.00950004439801,
"inferenceMs": 94.8070419835858,
"audioSeconds": 3.4,
"audioSecondsPerSecond": 35.86231495956441,
"realTimeFactor": 0.027884424112819356,
"firstChunkMs": 60.3518330026418,
"chunkCount": 9,
"placement": {
"cpu/torch.float32": 161
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 95.00950004439801,
"grade": "fast",
"device": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 18.621249997522682,
"inferenceMs": 18.4052080148831,
"audioSeconds": 2,
"audioSecondsPerSecond": 108.66489519611675,
"realTimeFactor": 0.00920260400744155,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"cpu/torch.float32": 161
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 18.621249997522682,
"grade": "fast",
"device": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0.13636363636363635,
"maximumWordErrorRate": 0.3,
"passed": true
},
"runtime": {
"durationMs": 129.94916603202,
"inferenceMs": 129.69629204599187,
"audioSeconds": 11,
"audioSecondsPerSecond": 84.81352725256993,
"realTimeFactor": 0.011790572004181078,
"firstChunkMs": 45.528082991950214,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 161
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 129.94916603202,
"grade": "fast",
"device": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 257.1463749627583,
"inferenceMs": 256.8243339774199,
"audioSeconds": 22.5,
"audioSecondsPerSecond": 87.6085207797257,
"realTimeFactor": 0.011414414843440884,
"firstChunkMs": 81.5434159594588,
"chunkCount": 44,
"placement": {
"cpu/torch.float32": 161
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 257.1463749627583,
"grade": "fast",
"device": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 137.43237499147654,
"inferenceMs": 136.78150001214817,
"audioSeconds": 11,
"audioSecondsPerSecond": 80.42023226111017,
"realTimeFactor": 0.012434681819286197,
"firstChunkMs": 53.33554104436189,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 161
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 125.47191703924909,
"totalMs": 262.9042920307256,
"grade": "fast",
"device": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 136.50787499500439,
"inferenceMs": 136.2170419888571,
"audioSeconds": 11,
"audioSecondsPerSecond": 80.75347870863199,
"realTimeFactor": 0.012383367453532463,
"firstChunkMs": 54.16204099310562,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 161
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 136.50787499500439,
"grade": "fast",
"device": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 132.43720796890557,
"inferenceMs": 132.10362498648465,
"audioSeconds": 11,
"audioSecondsPerSecond": 83.26796483537372,
"realTimeFactor": 0.012009420453316787,
"firstChunkMs": 50.465374952182174,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 161
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 132.43720796890557,
"grade": "fast",
"device": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 133.48658400354907,
"inferenceMs": 133.1749579985626,
"audioSeconds": 11,
"audioSecondsPerSecond": 82.59811127643627,
"realTimeFactor": 0.012106814363505691,
"firstChunkMs": 51.33054201724008,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 161
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 133.48658400354907,
"grade": "fast",
"device": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 132.56745802937075,
"inferenceMs": 132.3384580318816,
"audioSeconds": 11,
"audioSecondsPerSecond": 83.12020680602153,
"realTimeFactor": 0.012030768911989237,
"firstChunkMs": 50.02845800481737,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 161
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 132.56745802937075,
"grade": "fast",
"device": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 129.0982500067912,
"inferenceMs": 128.83416697150096,
"audioSeconds": 11,
"audioSecondsPerSecond": 85.38107754003858,
"realTimeFactor": 0.011712196997409179,
"firstChunkMs": 49.230874981731176,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 161
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 129.0982500067912,
"grade": "fast",
"device": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 131.65045803179964,
"inferenceMs": 131.05020800139755,
"audioSeconds": 11,
"audioSecondsPerSecond": 83.93729523788846,
"realTimeFactor": 0.011913655272854323,
"firstChunkMs": 52.85116599407047,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 161
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 116.74729199148715,
"totalMs": 248.3977500232868,
"grade": "fast",
"device": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 141.6144169634208,
"inferenceMs": 141.2481659790501,
"audioSeconds": 11,
"audioSecondsPerSecond": 77.87711736824616,
"realTimeFactor": 0.012840742361731827,
"firstChunkMs": 56.8745419732295,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 161
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 141.6144169634208,
"grade": "fast",
"device": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 131.90466701053083,
"inferenceMs": 131.66837499011308,
"audioSeconds": 11,
"audioSecondsPerSecond": 83.54321985690174,
"realTimeFactor": 0.011969852271828462,
"firstChunkMs": 50.408792041707784,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 161
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 131.90466701053083,
"grade": "fast",
"device": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 136.18862500879914,
"inferenceMs": 135.93720801873133,
"audioSeconds": 11,
"audioSecondsPerSecond": 80.91971403800103,
"realTimeFactor": 0.012357928001702849,
"firstChunkMs": 51.31491698557511,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 161
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 136.18862500879914,
"grade": "fast",
"device": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 143.24191596824676,
"inferenceMs": 142.95908296480775,
"audioSeconds": 11,
"audioSecondsPerSecond": 76.94509346221723,
"realTimeFactor": 0.012996280269527977,
"firstChunkMs": 55.10308296652511,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 161
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 143.24191596824676,
"grade": "fast",
"device": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 138.3458340424113,
"inferenceMs": 138.1036250386387,
"audioSeconds": 11,
"audioSecondsPerSecond": 79.6503350069371,
"realTimeFactor": 0.01255487500351261,
"firstChunkMs": 52.71691700909287,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 161
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 138.3458340424113,
"grade": "fast",
"device": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 654.2743329773657,
"inferenceMs": 652.3391249938868,
"audioSeconds": 11,
"audioSecondsPerSecond": 16.862395000611198,
"realTimeFactor": 0.05930355681762607,
"firstChunkMs": 394.47016699705273,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1213251584,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 249.88187500275671,
"totalMs": 904.1562079801224,
"grade": "fast",
"device": "mps",
"precision": "fp32",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 209.4613749650307,
"inferenceMs": 207.5675000087358,
"audioSeconds": 11,
"audioSecondsPerSecond": 52.99480891535066,
"realTimeFactor": 0.01886977272806689,
"firstChunkMs": 61.079083010554314,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1213251584,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 209.4613749650307,
"grade": "fast",
"device": "mps",
"precision": "fp32",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 241.8176659848541,
"inferenceMs": 238.42058301670477,
"audioSeconds": 11,
"audioSecondsPerSecond": 46.13695621753132,
"realTimeFactor": 0.021674598456064068,
"firstChunkMs": 53.68583300150931,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1213251584,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 241.8176659848541,
"grade": "fast",
"device": "mps",
"precision": "fp32",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 236.42158397706226,
"inferenceMs": 234.562375000678,
"audioSeconds": 11,
"audioSecondsPerSecond": 46.89584167097645,
"realTimeFactor": 0.02132385227278891,
"firstChunkMs": 58.4229999803938,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1213251584,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 236.42158397706226,
"grade": "fast",
"device": "mps",
"precision": "fp32",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 177.9002919793129,
"inferenceMs": 175.73866702150553,
"audioSeconds": 11,
"audioSecondsPerSecond": 62.592940907272876,
"realTimeFactor": 0.015976242456500502,
"firstChunkMs": 49.31212496012449,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1213251584,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 177.9002919793129,
"grade": "fast",
"device": "mps",
"precision": "fp32",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 184.4135409919545,
"inferenceMs": 182.86070897011086,
"audioSeconds": 11,
"audioSecondsPerSecond": 60.15507684484579,
"realTimeFactor": 0.016623700815464625,
"firstChunkMs": 58.29779099440202,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1213251584,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 184.4135409919545,
"grade": "fast",
"device": "mps",
"precision": "fp32",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 220.4576670192182,
"inferenceMs": 219.01574998628348,
"audioSeconds": 3.4,
"audioSecondsPerSecond": 15.523997704333754,
"realTimeFactor": 0.06441639705478926,
"firstChunkMs": 160.13891698094085,
"chunkCount": 9,
"placement": {
"mps:0/torch.float32": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1223933952,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 220.4576670192182,
"grade": "fast",
"device": "mps",
"precision": "fp32",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 114.02320797787979,
"inferenceMs": 112.34574997797608,
"audioSeconds": 2,
"audioSecondsPerSecond": 17.80218655705333,
"realTimeFactor": 0.05617287498898804,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"mps:0/torch.float32": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1224916992,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 114.02320797787979,
"grade": "fast",
"device": "mps",
"precision": "fp32",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0.13636363636363635,
"maximumWordErrorRate": 0.3,
"passed": true
},
"runtime": {
"durationMs": 198.82333400892094,
"inferenceMs": 196.9027500017546,
"audioSeconds": 11,
"audioSecondsPerSecond": 55.86514154780458,
"realTimeFactor": 0.01790025000015951,
"firstChunkMs": 49.065541999880224,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1224916992,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 198.82333400892094,
"grade": "fast",
"device": "mps",
"precision": "fp32",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 663.582542038057,
"inferenceMs": 661.5712500060908,
"audioSeconds": 22.5,
"audioSecondsPerSecond": 34.00994223946831,
"realTimeFactor": 0.02940316666693737,
"firstChunkMs": 278.1408340088092,
"chunkCount": 44,
"placement": {
"mps:0/torch.float32": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1351532544,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 663.582542038057,
"grade": "fast",
"device": "mps",
"precision": "fp32",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 543.1396249914542,
"inferenceMs": 540.8079590415582,
"audioSeconds": 11,
"audioSecondsPerSecond": 20.339937340224516,
"realTimeFactor": 0.04916435991286893,
"firstChunkMs": 267.64754101168364,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1213251584,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 235.01945898169652,
"totalMs": 778.1590839731507,
"grade": "fast",
"device": "mps",
"precision": "fp32",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 202.56666600471362,
"inferenceMs": 200.97537501715124,
"audioSeconds": 11,
"audioSecondsPerSecond": 54.733073636813764,
"realTimeFactor": 0.01827048863792284,
"firstChunkMs": 66.2877910071984,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1213251584,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 202.56666600471362,
"grade": "fast",
"device": "mps",
"precision": "fp32",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 185.15899998601526,
"inferenceMs": 183.23174997931346,
"audioSeconds": 11,
"audioSecondsPerSecond": 60.03326389253981,
"realTimeFactor": 0.016657431816301225,
"firstChunkMs": 48.228499945253134,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1213251584,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 185.15899998601526,
"grade": "fast",
"device": "mps",
"precision": "fp32",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 199.1607090458274,
"inferenceMs": 196.11079199239612,
"audioSeconds": 11,
"audioSecondsPerSecond": 56.09074283085098,
"realTimeFactor": 0.017828253817490557,
"firstChunkMs": 56.44562502857298,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1213251584,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 199.1607090458274,
"grade": "fast",
"device": "mps",
"precision": "fp32",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 177.76483303168789,
"inferenceMs": 175.91416602954268,
"audioSeconds": 11,
"audioSecondsPerSecond": 62.5304956859056,
"realTimeFactor": 0.01599219691177661,
"firstChunkMs": 51.365000021178275,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1213251584,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 177.76483303168789,
"grade": "fast",
"device": "mps",
"precision": "fp32",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 198.39299999875948,
"inferenceMs": 196.89500000094995,
"audioSeconds": 11,
"audioSecondsPerSecond": 55.867340460382074,
"realTimeFactor": 0.017899545454631814,
"firstChunkMs": 51.924334024079144,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1213251584,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 198.39299999875948,
"grade": "fast",
"device": "mps",
"precision": "fp32",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 508.4877079934813,
"inferenceMs": 506.4527499489486,
"audioSeconds": 11,
"audioSecondsPerSecond": 21.719696459558804,
"realTimeFactor": 0.04604115908626805,
"firstChunkMs": 220.72670800844207,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1213251584,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 244.69837499782443,
"totalMs": 753.1860829913057,
"grade": "fast",
"device": "mps",
"precision": "fp32",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 207.7221249928698,
"inferenceMs": 205.68479201756418,
"audioSeconds": 11,
"audioSecondsPerSecond": 53.479889748293445,
"realTimeFactor": 0.018698617456142198,
"firstChunkMs": 60.721083951648325,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1213251584,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 207.7221249928698,
"grade": "fast",
"device": "mps",
"precision": "fp32",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 187.68379202811047,
"inferenceMs": 186.1541669932194,
"audioSeconds": 11,
"audioSecondsPerSecond": 59.090807246880864,
"realTimeFactor": 0.016923106090292673,
"firstChunkMs": 55.5160419899039,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1213251584,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 187.68379202811047,
"grade": "fast",
"device": "mps",
"precision": "fp32",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 190.30612497590482,
"inferenceMs": 188.8273749500513,
"audioSeconds": 11,
"audioSecondsPerSecond": 58.25426531989721,
"realTimeFactor": 0.01716612499545921,
"firstChunkMs": 54.91308297496289,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1213251584,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 190.30612497590482,
"grade": "fast",
"device": "mps",
"precision": "fp32",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 241.32049997569993,
"inferenceMs": 239.06741599785164,
"audioSeconds": 11,
"audioSecondsPerSecond": 46.01212571812317,
"realTimeFactor": 0.02173340145435015,
"firstChunkMs": 57.95208300696686,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1213251584,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 241.32049997569993,
"grade": "fast",
"device": "mps",
"precision": "fp32",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 179.7998330439441,
"inferenceMs": 178.36737498873845,
"audioSeconds": 11,
"audioSecondsPerSecond": 61.670470850930585,
"realTimeFactor": 0.01621521590806713,
"firstChunkMs": 47.77208302402869,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1213251584,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 179.7998330439441,
"grade": "fast",
"device": "mps",
"precision": "fp32",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 613.8405409874395,
"inferenceMs": 611.377207969781,
"audioSeconds": 11,
"audioSecondsPerSecond": 17.992165649301903,
"realTimeFactor": 0.055579746179071,
"firstChunkMs": 312.19166598748416,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 190.79141702968627,
"totalMs": 804.6319580171257,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 215.95529199112207,
"inferenceMs": 214.3496249918826,
"audioSeconds": 11,
"audioSecondsPerSecond": 51.31802773350581,
"realTimeFactor": 0.0194863295447166,
"firstChunkMs": 56.93254200741649,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 215.95529199112207,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 231.90225003054366,
"inferenceMs": 229.58858299534768,
"audioSeconds": 11,
"audioSecondsPerSecond": 47.91179010945375,
"realTimeFactor": 0.020871689363213427,
"firstChunkMs": 51.952167006675154,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 231.90225003054366,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 173.35262498818338,
"inferenceMs": 171.48575000464916,
"audioSeconds": 11,
"audioSecondsPerSecond": 64.14527154414742,
"realTimeFactor": 0.015589613636786287,
"firstChunkMs": 48.594666994176805,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 173.35262498818338,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 215.1338750263676,
"inferenceMs": 212.48554199701175,
"audioSeconds": 11,
"audioSecondsPerSecond": 51.76822807151132,
"realTimeFactor": 0.019316867454273797,
"firstChunkMs": 55.997459043283015,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 215.1338750263676,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 209.4480840023607,
"inferenceMs": 207.94554200256243,
"audioSeconds": 11,
"audioSecondsPerSecond": 52.89846511768187,
"realTimeFactor": 0.01890414018205113,
"firstChunkMs": 51.8030000384897,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 209.4480840023607,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 239.31504099164158,
"inferenceMs": 238.21575002511963,
"audioSeconds": 3.4,
"audioSecondsPerSecond": 14.27277583300631,
"realTimeFactor": 0.07006345588974107,
"firstChunkMs": 166.90870799357072,
"chunkCount": 9,
"placement": {
"mps:0/torch.float16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 196329472,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 239.31504099164158,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 136.13629102474079,
"inferenceMs": 134.59295802749693,
"audioSeconds": 2,
"audioSecondsPerSecond": 14.859618432573612,
"realTimeFactor": 0.06729647901374847,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"mps:0/torch.float16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 198361088,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 136.13629102474079,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0.13636363636363635,
"maximumWordErrorRate": 0.3,
"passed": true
},
"runtime": {
"durationMs": 213.39654200710356,
"inferenceMs": 212.23387500504032,
"audioSeconds": 11,
"audioSecondsPerSecond": 51.829614851723186,
"realTimeFactor": 0.019293988636821847,
"firstChunkMs": 47.05408401787281,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 198361088,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 213.39654200710356,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 767.5023340270855,
"inferenceMs": 766.0397909930907,
"audioSeconds": 22.5,
"audioSecondsPerSecond": 29.371842382797237,
"realTimeFactor": 0.03404621293302625,
"firstChunkMs": 366.4952500257641,
"chunkCount": 44,
"placement": {
"mps:0/torch.float16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 374259712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 767.5023340270855,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 514.67391703045,
"inferenceMs": 512.4183330335654,
"audioSeconds": 11,
"audioSecondsPerSecond": 21.466835378193732,
"realTimeFactor": 0.04658348482123322,
"firstChunkMs": 243.43958403915167,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 197.84316699951887,
"totalMs": 712.5170840299688,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 205.55054099531844,
"inferenceMs": 203.45641701715067,
"audioSeconds": 11,
"audioSecondsPerSecond": 54.06563312806564,
"realTimeFactor": 0.018496037910650062,
"firstChunkMs": 58.0066250404343,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 205.55054099531844,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 209.64783302042633,
"inferenceMs": 208.33387499442324,
"audioSeconds": 11,
"audioSecondsPerSecond": 52.799862721770296,
"realTimeFactor": 0.018939443181311202,
"firstChunkMs": 52.41816700436175,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 209.64783302042633,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 196.09879102790728,
"inferenceMs": 194.42687497939914,
"audioSeconds": 11,
"audioSecondsPerSecond": 56.576540671990564,
"realTimeFactor": 0.01767517045267265,
"firstChunkMs": 51.0694159893319,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 196.09879102790728,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 180.05879200063646,
"inferenceMs": 178.19612502353266,
"audioSeconds": 11,
"audioSecondsPerSecond": 61.72973738091855,
"realTimeFactor": 0.01619964772941206,
"firstChunkMs": 48.80750004667789,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 180.05879200063646,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 200.16408304218203,
"inferenceMs": 198.4048750018701,
"audioSeconds": 11,
"audioSecondsPerSecond": 55.44218608487477,
"realTimeFactor": 0.018036806818351826,
"firstChunkMs": 49.675040994770825,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 200.16408304218203,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 510.6736670131795,
"inferenceMs": 508.86458304012194,
"audioSeconds": 11,
"audioSecondsPerSecond": 21.616752996017986,
"realTimeFactor": 0.046260416640011084,
"firstChunkMs": 250.80845900811255,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 265.6908339704387,
"totalMs": 776.3645009836182,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 234.06566597986966,
"inferenceMs": 231.99766699690372,
"audioSeconds": 11,
"audioSecondsPerSecond": 47.4142699036142,
"realTimeFactor": 0.02109069699971852,
"firstChunkMs": 58.785665954928845,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 234.06566597986966,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 205.37874998990446,
"inferenceMs": 203.41233402723446,
"audioSeconds": 11,
"audioSecondsPerSecond": 54.07735009091058,
"realTimeFactor": 0.018492030366112223,
"firstChunkMs": 52.83370800316334,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 205.37874998990446,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 206.9477919721976,
"inferenceMs": 205.26266697561368,
"audioSeconds": 11,
"audioSecondsPerSecond": 53.5898717583498,
"realTimeFactor": 0.018660242452328515,
"firstChunkMs": 51.44287500297651,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 206.9477919721976,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 211.6809169529006,
"inferenceMs": 209.50954098952934,
"audioSeconds": 11,
"audioSecondsPerSecond": 52.50357548418163,
"realTimeFactor": 0.01904632190813903,
"firstChunkMs": 49.01600000448525,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 211.6809169529006,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 208.5020830272697,
"inferenceMs": 206.53095899615437,
"audioSeconds": 11,
"audioSecondsPerSecond": 53.260780143885455,
"realTimeFactor": 0.018775541726923126,
"firstChunkMs": 53.92475001281127,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 208.5020830272697,
"grade": "fast",
"device": "mps",
"precision": "fp16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 526.5434170141816,
"inferenceMs": 524.0580419776961,
"audioSeconds": 11,
"audioSecondsPerSecond": 20.990041405505536,
"realTimeFactor": 0.047641640179790556,
"firstChunkMs": 273.519792011939,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 185.81945804180577,
"totalMs": 712.3628750559874,
"grade": "fast",
"device": "mps",
"precision": "bf16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 210.2653339970857,
"inferenceMs": 208.21975002763793,
"audioSeconds": 11,
"audioSecondsPerSecond": 52.828802255981586,
"realTimeFactor": 0.01892906818433072,
"firstChunkMs": 58.23387502459809,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 210.2653339970857,
"grade": "fast",
"device": "mps",
"precision": "bf16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 200.73704200331122,
"inferenceMs": 198.64229200175032,
"audioSeconds": 11,
"audioSecondsPerSecond": 55.375921658732544,
"realTimeFactor": 0.018058390181977302,
"firstChunkMs": 50.74295902159065,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 200.73704200331122,
"grade": "fast",
"device": "mps",
"precision": "bf16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 186.77916703745723,
"inferenceMs": 185.14049996156245,
"audioSeconds": 11,
"audioSecondsPerSecond": 59.41433669177593,
"realTimeFactor": 0.016830954541960222,
"firstChunkMs": 51.16700002690777,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 186.77916703745723,
"grade": "fast",
"device": "mps",
"precision": "bf16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 221.2382089928724,
"inferenceMs": 219.55570799764246,
"audioSeconds": 11,
"audioSecondsPerSecond": 50.101179788585206,
"realTimeFactor": 0.019959609817967496,
"firstChunkMs": 54.91241696290672,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 221.2382089928724,
"grade": "fast",
"device": "mps",
"precision": "bf16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 230.99491704488173,
"inferenceMs": 228.85745903477073,
"audioSeconds": 11,
"audioSecondsPerSecond": 48.064852447429956,
"realTimeFactor": 0.020805223548615522,
"firstChunkMs": 55.501584021840245,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 230.99491704488173,
"grade": "fast",
"device": "mps",
"precision": "bf16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 251.8711659940891,
"inferenceMs": 250.26379199698567,
"audioSeconds": 3.4,
"audioSecondsPerSecond": 13.585664841364473,
"realTimeFactor": 0.07360699764617226,
"firstChunkMs": 176.40283302171156,
"chunkCount": 9,
"placement": {
"mps:0/torch.bfloat16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 196329472,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 251.8711659940891,
"grade": "fast",
"device": "mps",
"precision": "bf16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 129.18966601137072,
"inferenceMs": 127.27066699881107,
"audioSeconds": 2,
"audioSecondsPerSecond": 15.714540099162704,
"realTimeFactor": 0.06363533349940553,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"mps:0/torch.bfloat16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 198361088,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 129.18966601137072,
"grade": "fast",
"device": "mps",
"precision": "bf16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0.13636363636363635,
"maximumWordErrorRate": 0.3,
"passed": true
},
"runtime": {
"durationMs": 170.06429197499529,
"inferenceMs": 168.19104203023016,
"audioSeconds": 11,
"audioSecondsPerSecond": 65.40181847510578,
"realTimeFactor": 0.015290094730020925,
"firstChunkMs": 44.18091697152704,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 198361088,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 170.06429197499529,
"grade": "fast",
"device": "mps",
"precision": "bf16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 732.6652079937048,
"inferenceMs": 730.3064580191858,
"audioSeconds": 22.5,
"audioSecondsPerSecond": 30.808984027098532,
"realTimeFactor": 0.032458064800852705,
"firstChunkMs": 327.8231670265086,
"chunkCount": 44,
"placement": {
"mps:0/torch.bfloat16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 374259712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 732.6652079937048,
"grade": "fast",
"device": "mps",
"precision": "bf16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 511.71020802576095,
"inferenceMs": 509.66095901094377,
"audioSeconds": 11,
"audioSecondsPerSecond": 21.582975516403643,
"realTimeFactor": 0.04633281445554034,
"firstChunkMs": 245.32504100352526,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 207.45629200246185,
"totalMs": 719.1665000282228,
"grade": "fast",
"device": "mps",
"precision": "bf16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 201.49012503679842,
"inferenceMs": 199.3599160341546,
"audioSeconds": 11,
"audioSecondsPerSecond": 55.17658824713523,
"realTimeFactor": 0.01812362873037769,
"firstChunkMs": 49.51716703362763,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 201.49012503679842,
"grade": "fast",
"device": "mps",
"precision": "bf16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 183.73691698070616,
"inferenceMs": 181.79941695416346,
"audioSeconds": 11,
"audioSecondsPerSecond": 60.506244652992464,
"realTimeFactor": 0.01652721972310577,
"firstChunkMs": 52.9124999884516,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 183.73691698070616,
"grade": "fast",
"device": "mps",
"precision": "bf16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 205.97116701537743,
"inferenceMs": 204.11345799220726,
"audioSeconds": 11,
"audioSecondsPerSecond": 53.891595920245315,
"realTimeFactor": 0.018555768908382477,
"firstChunkMs": 56.40237499028444,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 205.97116701537743,
"grade": "fast",
"device": "mps",
"precision": "bf16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 182.24049999844283,
"inferenceMs": 180.52412499673665,
"audioSeconds": 11,
"audioSecondsPerSecond": 60.9336840724133,
"realTimeFactor": 0.016411284090612422,
"firstChunkMs": 52.541333017870784,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 182.24049999844283,
"grade": "fast",
"device": "mps",
"precision": "bf16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 204.3810419854708,
"inferenceMs": 202.64545897953212,
"audioSeconds": 11,
"audioSecondsPerSecond": 54.28199603086609,
"realTimeFactor": 0.01842231445268474,
"firstChunkMs": 52.65199998393655,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 204.3810419854708,
"grade": "fast",
"device": "mps",
"precision": "bf16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 504.9162089708261,
"inferenceMs": 502.69587500952184,
"audioSeconds": 11,
"audioSecondsPerSecond": 21.882017631021228,
"realTimeFactor": 0.04569962500086562,
"firstChunkMs": 247.5633340072818,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 181.78208300378174,
"totalMs": 686.6982919746079,
"grade": "fast",
"device": "mps",
"precision": "bf16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 193.45141696976498,
"inferenceMs": 191.432417021133,
"audioSeconds": 11,
"audioSecondsPerSecond": 57.46153222724898,
"realTimeFactor": 0.017402947001921184,
"firstChunkMs": 57.36749997595325,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 193.45141696976498,
"grade": "fast",
"device": "mps",
"precision": "bf16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 192.3852920299396,
"inferenceMs": 190.76862500514835,
"audioSeconds": 11,
"audioSecondsPerSecond": 57.661473419453216,
"realTimeFactor": 0.017342602273195305,
"firstChunkMs": 49.170207988936454,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 192.3852920299396,
"grade": "fast",
"device": "mps",
"precision": "bf16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 182.71733302390203,
"inferenceMs": 180.77879102202132,
"audioSeconds": 11,
"audioSecondsPerSecond": 60.84784579989834,
"realTimeFactor": 0.016434435547456484,
"firstChunkMs": 48.03416703362018,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 182.71733302390203,
"grade": "fast",
"device": "mps",
"precision": "bf16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 178.23370802216232,
"inferenceMs": 176.542499975767,
"audioSeconds": 11,
"audioSecondsPerSecond": 62.307942855176,
"realTimeFactor": 0.01604931817961518,
"firstChunkMs": 48.26583300018683,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 178.23370802216232,
"grade": "fast",
"device": "mps",
"precision": "bf16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2,
"passed": true
},
"runtime": {
"durationMs": 188.48591594723985,
"inferenceMs": 186.68095802422613,
"audioSeconds": 11,
"audioSecondsPerSecond": 58.92406015279018,
"realTimeFactor": 0.016970996184020558,
"firstChunkMs": 49.216374987736344,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 161
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 194035712,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 0,
"totalMs": 188.48591594723985,
"grade": "fast",
"device": "mps",
"precision": "bf16",
"provider": "Metal/MPS",
"acceleration": "partial",
"cpuThreads": 4,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "f8e9dfd8c562c257c151a907b7b7f2fe8ff8511a",
"fallback": false
}
}
]Moonshine Streaming Small · German
56 configurations testedQuality criteria
No explicit quality gate recorded. Review per-case evidence; full certification is pending.
| Precision | Device | Result | Platform | Inference / load | Task metric | |
|---|---|---|---|---|---|---|
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 266 ms / 0 ms | 0.021 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 278 ms / 0 ms | 0.021 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 279 ms / 0 ms | 0.022 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 281 ms / 0 ms | 0.022 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 281 ms / 0 ms | 0.022 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 283 ms / 0 ms | 0.022 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 285 ms / 0 ms | 0.022 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 290 ms / 0 ms | 0.022 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 293 ms / 0 ms | 0.023 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 295 ms / 0 ms | 0.023 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 296 ms / 0 ms | 0.023 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 297 ms / 0 ms | 0.023 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 298 ms / 0 ms | 0.023 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 304 ms / 0 ms | 0.023 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 306 ms / 0 ms | 0.024 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 307 ms / 0 ms | 0.024 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 314 ms / 0 ms | 0.024 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 326 ms / 0 ms | 0.025 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 461 ms / 227 ms | 0.036 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 462 ms / 220 ms | 0.036 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 464 ms / 223 ms | 0.036 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 472 ms / 222 ms | 0.036 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 492 ms / 286 ms | 0.038 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 498 ms / 312 ms | 0.038 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 403 ms / 0 ms | 0.045 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 426 ms / 0 ms | 0.047 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 548 ms / 0 ms | 0.048 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 559 ms / 0 ms | 0.049 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 461 ms / 0 ms | 0.051 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 605 ms / 0 ms | 0.053 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 116 ms / 0 ms | 0.058 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 117 ms / 0 ms | 0.058 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 119 ms / 0 ms | 0.059 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 119 ms / 0 ms | 0.059 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 124 ms / 0 ms | 0.062 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 126 ms / 0 ms | 0.063 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 127 ms / 0 ms | 0.063 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 134 ms / 0 ms | 0.067 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 139 ms / 0 ms | 0.069 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 1073 ms / 228 ms | 0.083 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 1099 ms / 218 ms | 0.085 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 1196 ms / 306 ms | 0.092 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 38 ms / 0 ms | 0.019 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 38 ms / 0 ms | 0.019 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 39 ms / 0 ms | 0.019 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 250 ms / 0 ms | 0.022 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 200 ms / 0 ms | 0.022 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 343 ms / 0 ms | 0.026 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 344 ms / 0 ms | 0.027 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 346 ms / 0 ms | 0.027 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 346 ms / 0 ms | 0.027 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 348 ms / 0 ms | 0.027 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 387 ms / 148 ms | 0.030 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 389 ms / 115 ms | 0.030 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 407 ms / 0 ms | 0.031 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 959 ms / 163 ms | 0.074 RTF |
Test setup & sample details
- Quality gate
- No explicit quality gate recorded. Review the per-case quality evidence; full certification is pending.
- Tested
- 2026-11-07T16:26:22.729540+00:00
- Environment
- { "os": "macos", "arch": "aarch64", "hardware": "Apple M3 Max", "osVersion": "27.2", "runtime": "Transformers5.22.1/Torch2.10.0", "interpreter": "Existing app-owned pinned development probe; normal managed/public/package acceptance recorded separately.", "concurrentActivity": "Tracked B2 mirror service and ordinary desktop applications enabled; not a clean-room hardware maximum." }
- Runtime
- transformers 5.22.1
- Artifact revision
- 56473ba32b22b484fdfc7eb03d34c393ff494197
- Fixture
{ "file": "model-samples/desktop/moonshine-streaming-family/de_de-clean-0.wav", "size": 414764, "sha1": "f0244c5c61f727d2545992ffdd10670785dfc8d2", "sha256": "55c0173541f40d6b340585ab78190859df1c1f8ce481895ad8da0a31b531bf86", "url": "https://assets.localai.tools/samples/v1/files/55c0173541f40d6b340585ab78190859df1c1f8ce481895ad8da0a31b531bf86/de_de-clean-0.wav" }- Rerun when
- Artifact/runtime/tokenizer revision; Audio decode/resampling, generation/stream decoding or input bounds; Fixture/reference/quality thresholds; Relevant OS/backend behavior
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 162.7653749892488,
"provider": "PyTorch CPU",
"placement": {
"cpu/torch.float32": 261
},
"parameterDtype": "torch.float32",
"acceleration": "cpu",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 961.875124994549,
"inferenceMs": 958.5616249969462,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 13.520257500441131,
"realTimeFactor": 0.0739630883485298,
"firstChunkMs": 715.4208330030087,
"chunkCount": 27,
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"fallback": false,
"totalMs": 1124.6404999837978,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "PyTorch CPU",
"placement": {
"cpu/torch.float32": 261
},
"parameterDtype": "torch.float32",
"acceleration": "cpu",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 250.45170799421612,
"inferenceMs": 250.20087500161026,
"audioSeconds": 11.34,
"audioSecondsPerSecond": 45.32358250116838,
"realTimeFactor": 0.022063569224127888,
"firstChunkMs": 102.14870799973141,
"chunkCount": 16,
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"fallback": false,
"totalMs": 250.45170799421612,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "PyTorch CPU",
"placement": {
"cpu/torch.float32": 261
},
"parameterDtype": "torch.float32",
"acceleration": "cpu",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 200.45495800150093,
"inferenceMs": 200.238541001454,
"audioSeconds": 9,
"audioSecondsPerSecond": 44.94639221294889,
"realTimeFactor": 0.022248726777939334,
"firstChunkMs": 84.4667500059586,
"chunkCount": 15,
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"fallback": false,
"totalMs": 200.45495800150093,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.17857142857142858,
"maximumErrorRate": 0.3,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.17857142857142858,
"maximumWordErrorRate": 0.3
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "PyTorch CPU",
"placement": {
"cpu/torch.float32": 261
},
"parameterDtype": "torch.float32",
"acceleration": "cpu",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 343.1445000023814,
"inferenceMs": 342.8914999967674,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 37.79621250489493,
"realTimeFactor": 0.026457677468886373,
"firstChunkMs": 109.05420900962781,
"chunkCount": 26,
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"fallback": false,
"totalMs": 343.1445000023814,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0,
"maximumErrorRate": 0,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0,
"maximumWordErrorRate": 0
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "PyTorch CPU",
"placement": {
"cpu/torch.float32": 261
},
"parameterDtype": "torch.float32",
"acceleration": "cpu",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 38.831874990137294,
"inferenceMs": 38.64770900690928,
"audioSeconds": 2,
"audioSecondsPerSecond": 51.74950990348349,
"realTimeFactor": 0.01932385450345464,
"firstChunkMs": null,
"chunkCount": 0,
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"fallback": false,
"totalMs": 38.831874990137294,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "PyTorch CPU",
"placement": {
"cpu/torch.float32": 261
},
"parameterDtype": "torch.float32",
"acceleration": "cpu",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 406.76754199375864,
"inferenceMs": 406.508500003838,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 31.881252175237766,
"realTimeFactor": 0.03136639660523441,
"firstChunkMs": 165.53387499880046,
"chunkCount": 27,
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"fallback": false,
"totalMs": 406.76754199375864,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "PyTorch CPU",
"placement": {
"cpu/torch.float32": 261
},
"parameterDtype": "torch.float32",
"acceleration": "cpu",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 346.16950000054203,
"inferenceMs": 345.88016699126456,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 37.46962456025215,
"realTimeFactor": 0.02668828449006671,
"firstChunkMs": 108.93458299688064,
"chunkCount": 27,
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"fallback": false,
"totalMs": 346.16950000054203,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "PyTorch CPU",
"placement": {
"cpu/torch.float32": 261
},
"parameterDtype": "torch.float32",
"acceleration": "cpu",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 344.52958300244063,
"inferenceMs": 344.2210829962278,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 37.65022144254315,
"realTimeFactor": 0.026560268749708932,
"firstChunkMs": 109.156582999276,
"chunkCount": 27,
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"fallback": false,
"totalMs": 344.52958300244063,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "PyTorch CPU",
"placement": {
"cpu/torch.float32": 261
},
"parameterDtype": "torch.float32",
"acceleration": "cpu",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 348.0763750121696,
"inferenceMs": 347.77445800136775,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 37.26553144379864,
"realTimeFactor": 0.026834448919858624,
"firstChunkMs": 111.57579100108705,
"chunkCount": 27,
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"fallback": false,
"totalMs": 348.0763750121696,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "PyTorch CPU",
"placement": {
"cpu/torch.float32": 261
},
"parameterDtype": "torch.float32",
"acceleration": "cpu",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 345.83012500661425,
"inferenceMs": 345.5494579975493,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 37.50548496039578,
"realTimeFactor": 0.02666276682079856,
"firstChunkMs": 110.51283300912473,
"chunkCount": 27,
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"fallback": false,
"totalMs": 345.83012500661425,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 147.81299998867325,
"provider": "PyTorch CPU",
"placement": {
"cpu/torch.float32": 261
},
"parameterDtype": "torch.float32",
"acceleration": "cpu",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 387.14358300785534,
"inferenceMs": 386.6477920091711,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 33.51887756206971,
"realTimeFactor": 0.02983393456860888,
"firstChunkMs": 143.4081660117954,
"chunkCount": 27,
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"fallback": false,
"totalMs": 534.9565829965286,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0,
"maximumErrorRate": 0,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0,
"maximumWordErrorRate": 0
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "PyTorch CPU",
"placement": {
"cpu/torch.float32": 261
},
"parameterDtype": "torch.float32",
"acceleration": "cpu",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 38.02779199031647,
"inferenceMs": 37.819707999005914,
"audioSeconds": 2,
"audioSecondsPerSecond": 52.882481272794855,
"realTimeFactor": 0.018909853999502957,
"firstChunkMs": null,
"chunkCount": 0,
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"fallback": false,
"totalMs": 38.02779199031647,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 115.28020800324157,
"provider": "PyTorch CPU",
"placement": {
"cpu/torch.float32": 261
},
"parameterDtype": "torch.float32",
"acceleration": "cpu",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 389.93737498822156,
"inferenceMs": 389.3695000006119,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 33.284579300586294,
"realTimeFactor": 0.030043942901281782,
"firstChunkMs": 149.60599999176338,
"chunkCount": 27,
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"fallback": false,
"totalMs": 505.21758299146313,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0,
"maximumErrorRate": 0,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0,
"maximumWordErrorRate": 0
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "PyTorch CPU",
"placement": {
"cpu/torch.float32": 261
},
"parameterDtype": "torch.float32",
"acceleration": "cpu",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 38.178957998752594,
"inferenceMs": 37.97358300653286,
"audioSeconds": 2,
"audioSecondsPerSecond": 52.668193034508384,
"realTimeFactor": 0.01898679150326643,
"firstChunkMs": null,
"chunkCount": 0,
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"fallback": false,
"totalMs": 38.178957998752594,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 306.0667500103591,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.float32": 261
},
"parameterDtype": "torch.float32",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 1198.2972500118194,
"inferenceMs": 1196.4378339907853,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 10.832154945126732,
"realTimeFactor": 0.09231773410422726,
"firstChunkMs": 930.7112080132356,
"chunkCount": 27,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1238794240,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"fallback": false,
"totalMs": 1504.3640000221785,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.float32": 261
},
"parameterDtype": "torch.float32",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 549.2182500020135,
"inferenceMs": 548.0192079994595,
"audioSeconds": 11.34,
"audioSecondsPerSecond": 20.69270535497578,
"realTimeFactor": 0.04832620881829448,
"firstChunkMs": 402.401083993027,
"chunkCount": 16,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1260290048,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"fallback": false,
"totalMs": 549.2182500020135,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.float32": 261
},
"parameterDtype": "torch.float32",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 463.0477909959154,
"inferenceMs": 461.45187500223983,
"audioSeconds": 9,
"audioSecondsPerSecond": 19.503658967592916,
"realTimeFactor": 0.051272430555804424,
"firstChunkMs": 342.67704100057017,
"chunkCount": 15,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1300234240,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"fallback": false,
"totalMs": 463.0477909959154,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.17857142857142858,
"maximumErrorRate": 0.3,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.17857142857142858,
"maximumWordErrorRate": 0.3
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.float32": 261
},
"parameterDtype": "torch.float32",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 328.7051669904031,
"inferenceMs": 326.40416600042954,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 39.70537557410633,
"realTimeFactor": 0.025185506635835613,
"firstChunkMs": 66.75729199196212,
"chunkCount": 26,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1300234240,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"fallback": false,
"totalMs": 328.7051669904031,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0,
"maximumErrorRate": 0,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0,
"maximumWordErrorRate": 0
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.float32": 261
},
"parameterDtype": "torch.float32",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 135.56470900948625,
"inferenceMs": 133.60900001134723,
"audioSeconds": 2,
"audioSecondsPerSecond": 14.969051484781284,
"realTimeFactor": 0.06680450000567362,
"firstChunkMs": null,
"chunkCount": 0,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1309573120,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"fallback": false,
"totalMs": 135.56470900948625,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.float32": 261
},
"parameterDtype": "torch.float32",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 315.8697079925332,
"inferenceMs": 314.32487499841955,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 41.23122613208759,
"realTimeFactor": 0.024253462577038545,
"firstChunkMs": 82.70541600359138,
"chunkCount": 27,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1309573120,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"fallback": false,
"totalMs": 315.8697079925332,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.float32": 261
},
"parameterDtype": "torch.float32",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 300.3247500018915,
"inferenceMs": 298.3849580050446,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 43.43382483704455,
"realTimeFactor": 0.023023530710265788,
"firstChunkMs": 63.92991601023823,
"chunkCount": 27,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1309573120,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"fallback": false,
"totalMs": 300.3247500018915,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.float32": 261
},
"parameterDtype": "torch.float32",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 306.3925410096999,
"inferenceMs": 304.308916995069,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 42.5883018084876,
"realTimeFactor": 0.023480626311347917,
"firstChunkMs": 66.31004100199789,
"chunkCount": 27,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1309573120,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"fallback": false,
"totalMs": 306.3925410096999,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.float32": 261
},
"parameterDtype": "torch.float32",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 306.9413750054082,
"inferenceMs": 305.8556670002872,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 42.37292748931747,
"realTimeFactor": 0.02359997430557772,
"firstChunkMs": 68.94029199611396,
"chunkCount": 27,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1309573120,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"fallback": false,
"totalMs": 306.9413750054082,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.float32": 261
},
"parameterDtype": "torch.float32",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 308.9602499967441,
"inferenceMs": 307.3536250012694,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 42.166413361633445,
"realTimeFactor": 0.023715557484665847,
"firstChunkMs": 66.42099999589846,
"chunkCount": 27,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1309573120,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"fallback": false,
"totalMs": 308.9602499967441,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 312.22591700498015,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.float32": 261
},
"parameterDtype": "torch.float32",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 500.0015830009943,
"inferenceMs": 497.8218749893131,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 26.033408034305882,
"realTimeFactor": 0.03841218171213835,
"firstChunkMs": 255.9675829979824,
"chunkCount": 27,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1238810624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"fallback": false,
"totalMs": 812.2275000059744,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0,
"maximumErrorRate": 0,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0,
"maximumWordErrorRate": 0
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.float32": 261
},
"parameterDtype": "torch.float32",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 120.65929200616665,
"inferenceMs": 118.91470800037496,
"audioSeconds": 2,
"audioSecondsPerSecond": 16.818777371035495,
"realTimeFactor": 0.05945735400018748,
"firstChunkMs": null,
"chunkCount": 0,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1248149504,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"fallback": false,
"totalMs": 120.65929200616665,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 286.4770000014687,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.float32": 261
},
"parameterDtype": "torch.float32",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 493.8418749952689,
"inferenceMs": 491.75304200616665,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 26.354692076998845,
"realTimeFactor": 0.03794390756220422,
"firstChunkMs": 251.73737500153948,
"chunkCount": 27,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1238810624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"fallback": false,
"totalMs": 780.3188749967376,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0,
"maximumErrorRate": 0,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0,
"maximumWordErrorRate": 0
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.float32": 261
},
"parameterDtype": "torch.float32",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 128.7605830002576,
"inferenceMs": 126.32175000908319,
"audioSeconds": 2,
"audioSecondsPerSecond": 15.83258623203201,
"realTimeFactor": 0.0631608750045416,
"firstChunkMs": null,
"chunkCount": 0,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1248149504,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"fallback": false,
"totalMs": 128.7605830002576,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 228.10049999679904,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.float16": 261
},
"parameterDtype": "torch.float16",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 1074.6936250070576,
"inferenceMs": 1072.8086669987533,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 12.08043931659909,
"realTimeFactor": 0.08277844652768158,
"firstChunkMs": 856.9542089971947,
"chunkCount": 27,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 372670464,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"fallback": false,
"totalMs": 1302.7941250038566,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.float16": 261
},
"parameterDtype": "torch.float16",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 560.7364999887068,
"inferenceMs": 559.217041998636,
"audioSeconds": 11.34,
"audioSecondsPerSecond": 20.278351960575016,
"realTimeFactor": 0.04931367213391852,
"firstChunkMs": 422.56433398870286,
"chunkCount": 16,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 394166272,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"fallback": false,
"totalMs": 560.7364999887068,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.float16": 261
},
"parameterDtype": "torch.float16",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 405.09162499802187,
"inferenceMs": 403.4506669995608,
"audioSeconds": 9,
"audioSecondsPerSecond": 22.307560096337127,
"realTimeFactor": 0.04482785188884009,
"firstChunkMs": 293.7242499901913,
"chunkCount": 15,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 408944640,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"fallback": false,
"totalMs": 405.09162499802187,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.21428571428571427,
"maximumErrorRate": 0.3,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.21428571428571427,
"maximumWordErrorRate": 0.3
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.float16": 261
},
"parameterDtype": "torch.float16",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 267.9976670042379,
"inferenceMs": 266.0690420016181,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 48.70916173675398,
"realTimeFactor": 0.02053001867296436,
"firstChunkMs": 61.27245900279377,
"chunkCount": 26,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 408944640,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"fallback": false,
"totalMs": 267.9976670042379,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0,
"maximumErrorRate": 0,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0,
"maximumWordErrorRate": 0
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.float16": 261
},
"parameterDtype": "torch.float16",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 140.0419999990845,
"inferenceMs": 138.6000419879565,
"audioSeconds": 2,
"audioSecondsPerSecond": 14.43001005853799,
"realTimeFactor": 0.06930002099397825,
"firstChunkMs": null,
"chunkCount": 0,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 409894912,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"fallback": false,
"totalMs": 140.0419999990845,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.float16": 261
},
"parameterDtype": "torch.float16",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 296.7077089997474,
"inferenceMs": 295.0569579988951,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 43.92372268695502,
"realTimeFactor": 0.0227667405863345,
"firstChunkMs": 71.99599999876227,
"chunkCount": 27,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 409894912,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"fallback": false,
"totalMs": 296.7077089997474,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.float16": 261
},
"parameterDtype": "torch.float16",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 283.5415410081623,
"inferenceMs": 281.2182500056224,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 46.085202506383894,
"realTimeFactor": 0.021698939043643704,
"firstChunkMs": 66.09962500806432,
"chunkCount": 27,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 409894912,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"fallback": false,
"totalMs": 283.5415410081623,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.float16": 261
},
"parameterDtype": "torch.float16",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 282.4107080086833,
"inferenceMs": 280.83466600219253,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 46.148148960708504,
"realTimeFactor": 0.021669341512514855,
"firstChunkMs": 63.87095800891984,
"chunkCount": 27,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 409894912,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"fallback": false,
"totalMs": 282.4107080086833,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.float16": 261
},
"parameterDtype": "torch.float16",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 298.0485830048565,
"inferenceMs": 296.5131249948172,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 43.708014612258836,
"realTimeFactor": 0.02287909915083466,
"firstChunkMs": 64.41512500168756,
"chunkCount": 27,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 409894912,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"fallback": false,
"totalMs": 298.0485830048565,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.float16": 261
},
"parameterDtype": "torch.float16",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 294.6734589932021,
"inferenceMs": 292.9218749923166,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 44.243879021803835,
"realTimeFactor": 0.022601996527184923,
"firstChunkMs": 64.95520900352858,
"chunkCount": 27,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 409894912,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"fallback": false,
"totalMs": 294.6734589932021,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 223.17179098899942,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.float16": 261
},
"parameterDtype": "torch.float16",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 466.0192500014091,
"inferenceMs": 464.26758299639914,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 27.914936288154582,
"realTimeFactor": 0.035823115971944375,
"firstChunkMs": 242.0892090012785,
"chunkCount": 27,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 372686848,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"fallback": false,
"totalMs": 689.1910409904085,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0,
"maximumErrorRate": 0,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0,
"maximumWordErrorRate": 0
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.float16": 261
},
"parameterDtype": "torch.float16",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 120.46270900464151,
"inferenceMs": 118.96574999263976,
"audioSeconds": 2,
"audioSecondsPerSecond": 16.811561311753486,
"realTimeFactor": 0.05948287499631988,
"firstChunkMs": null,
"chunkCount": 0,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 373637120,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"fallback": false,
"totalMs": 120.46270900464151,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 222.17112500220537,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.float16": 261
},
"parameterDtype": "torch.float16",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 474.05095800058916,
"inferenceMs": 472.02104100142606,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 27.45640315631787,
"realTimeFactor": 0.03642137662048041,
"firstChunkMs": 256.0914159985259,
"chunkCount": 27,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 372686848,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"fallback": false,
"totalMs": 696.2220830027945,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0,
"maximumErrorRate": 0,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0,
"maximumWordErrorRate": 0
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.float16": 261
},
"parameterDtype": "torch.float16",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 118.5551250091521,
"inferenceMs": 116.74875000608154,
"audioSeconds": 2,
"audioSecondsPerSecond": 17.130804397441672,
"realTimeFactor": 0.05837437500304077,
"firstChunkMs": null,
"chunkCount": 0,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 373637120,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"fallback": false,
"totalMs": 118.5551250091521,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 217.87487500114366,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.bfloat16": 261
},
"parameterDtype": "torch.bfloat16",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 1100.534917000914,
"inferenceMs": 1098.5462079988793,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 11.797409982059873,
"realTimeFactor": 0.0847643679011481,
"firstChunkMs": 881.4064589969348,
"chunkCount": 27,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 372670464,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"fallback": false,
"totalMs": 1318.4097920020577,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.bfloat16": 261
},
"parameterDtype": "torch.bfloat16",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 606.0734589991625,
"inferenceMs": 604.7204170026816,
"audioSeconds": 11.34,
"audioSecondsPerSecond": 18.75246755551452,
"realTimeFactor": 0.05332631543233524,
"firstChunkMs": 464.0454589971341,
"chunkCount": 16,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 394166272,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"fallback": false,
"totalMs": 606.0734589991625,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.bfloat16": 261
},
"parameterDtype": "torch.bfloat16",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 427.01612500241026,
"inferenceMs": 425.8851250051521,
"audioSeconds": 9,
"audioSecondsPerSecond": 21.132459134117738,
"realTimeFactor": 0.0473205694450169,
"firstChunkMs": 307.68204100604635,
"chunkCount": 15,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 408944640,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"fallback": false,
"totalMs": 427.01612500241026,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.14285714285714285,
"maximumErrorRate": 0.3,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.14285714285714285,
"maximumWordErrorRate": 0.3
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.bfloat16": 261
},
"parameterDtype": "torch.bfloat16",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 291.9108329951996,
"inferenceMs": 289.7991249919869,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 44.72063192170905,
"realTimeFactor": 0.022361043595060717,
"firstChunkMs": 62.988957986817695,
"chunkCount": 25,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 408944640,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"fallback": false,
"totalMs": 291.9108329951996,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0,
"maximumErrorRate": 0,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0,
"maximumWordErrorRate": 0
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.bfloat16": 261
},
"parameterDtype": "torch.bfloat16",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 125.16495799354743,
"inferenceMs": 123.90845800109673,
"audioSeconds": 2,
"audioSecondsPerSecond": 16.140948182748733,
"realTimeFactor": 0.061954229000548366,
"firstChunkMs": null,
"chunkCount": 0,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 409894912,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"fallback": false,
"totalMs": 125.16495799354743,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.bfloat16": 261
},
"parameterDtype": "torch.bfloat16",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 298.6608750070445,
"inferenceMs": 296.39354199753143,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 43.725649056509944,
"realTimeFactor": 0.02286987206771076,
"firstChunkMs": 77.90966700122226,
"chunkCount": 27,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 409894912,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"fallback": false,
"totalMs": 298.6608750070445,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.bfloat16": 261
},
"parameterDtype": "torch.bfloat16",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 280.5532090133056,
"inferenceMs": 278.91849998559337,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 46.46518606929769,
"realTimeFactor": 0.021521489196419243,
"firstChunkMs": 60.51862500316929,
"chunkCount": 27,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 409894912,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"fallback": false,
"totalMs": 280.5532090133056,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.bfloat16": 261
},
"parameterDtype": "torch.bfloat16",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 284.3930410017492,
"inferenceMs": 283.0619169981219,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 45.78503578807456,
"realTimeFactor": 0.0218411972992378,
"firstChunkMs": 63.30070798867382,
"chunkCount": 27,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 409894912,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"fallback": false,
"totalMs": 284.3930410017492,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.bfloat16": 261
},
"parameterDtype": "torch.bfloat16",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 286.6324590140721,
"inferenceMs": 285.16745900560636,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 45.44698068002636,
"realTimeFactor": 0.02200366196030913,
"firstChunkMs": 65.90562500059605,
"chunkCount": 27,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 409894912,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"fallback": false,
"totalMs": 286.6324590140721,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.bfloat16": 261
},
"parameterDtype": "torch.bfloat16",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 280.259584003943,
"inferenceMs": 278.073833003873,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 46.606327031927144,
"realTimeFactor": 0.0214563142749902,
"firstChunkMs": 61.606333998497576,
"chunkCount": 27,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 409894912,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"fallback": false,
"totalMs": 280.259584003943,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 219.93724998901598,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.bfloat16": 261
},
"parameterDtype": "torch.bfloat16",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 464.1117079881951,
"inferenceMs": 462.0109999959823,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 28.051280164569032,
"realTimeFactor": 0.03564899691327024,
"firstChunkMs": 238.81962499581277,
"chunkCount": 27,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 372686848,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"fallback": false,
"totalMs": 684.0489579772111,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0,
"maximumErrorRate": 0,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0,
"maximumWordErrorRate": 0
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.bfloat16": 261
},
"parameterDtype": "torch.bfloat16",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 128.46899998839945,
"inferenceMs": 126.74966700433288,
"audioSeconds": 2,
"audioSecondsPerSecond": 15.779134156870258,
"realTimeFactor": 0.06337483350216644,
"firstChunkMs": null,
"chunkCount": 0,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 373637120,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"fallback": false,
"totalMs": 128.46899998839945,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0.07142857142857142,
"maximumErrorRate": 0.2,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0.07142857142857142,
"maximumWordErrorRate": 0.2
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 226.73766598745715,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.bfloat16": 261
},
"parameterDtype": "torch.bfloat16",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 462.6680840010522,
"inferenceMs": 460.6377500022063,
"audioSeconds": 12.96,
"audioSecondsPerSecond": 28.134906442074985,
"realTimeFactor": 0.03554303626560234,
"firstChunkMs": 242.42245899222326,
"chunkCount": 27,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 372686848,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"fallback": false,
"totalMs": 689.4057499885093,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"score": 0,
"maximumErrorRate": 0,
"passed": true,
"loopRejected": false,
"complete": true,
"streamParity": true,
"wordErrorRate": 0,
"maximumWordErrorRate": 0
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"provider": "Metal/MPS",
"placement": {
"mps:0/torch.bfloat16": 261
},
"parameterDtype": "torch.bfloat16",
"acceleration": "partial",
"accelerationDetails": "Encoder/decoder/logits on selected device; WAV decode/resample/token decoding and attention-mask preparation on CPU",
"attentionImplementation": "sdpa",
"durationMs": 117.0564999920316,
"inferenceMs": 115.84825000318233,
"audioSeconds": 2,
"audioSecondsPerSecond": 17.263963848785462,
"realTimeFactor": 0.057924125001591165,
"firstChunkMs": null,
"chunkCount": 0,
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 373637120,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"fallback": false,
"totalMs": 117.0564999920316,
"grade": "fast",
"artifactRevision": "56473ba32b22b484fdfc7eb03d34c393ff494197"
}
}
]