Moonshine Desktop
Transcribe complete English WAV recordings locally with the original offline Moonshine Base checkpoint. Returns complete native text, token IDs, duration and sample rate; supports genuine incremental decoder text from the supplied complete recording.
Desktop app
Run Moonshine Desktop on your computer
Download the desktop app to load this model, provide input and view results locally.
Public desktop downloads are coming soon.Device requirements
If your device falls short
MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.
GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.
PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.
Benchmark evidence
Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.
Moonshine Base — English Speech Recognition Desktop
96 configurations testedQuality criteria
English WER <=0.20 clean/independent/longer, <=0.30 noisy, exact empty silence, EOS/no loops, warm RTF <=1; controlled fixtures only.
| Precision | Device | Result | Platform | Inference / load | Task metric | |
|---|---|---|---|---|---|---|
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 181 ms / 1950 ms | 0.016 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 181 ms / 2009 ms | 0.016 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 182 ms / 2009 ms | 0.017 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 182 ms / 2005 ms | 0.017 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 183 ms / 1950 ms | 0.017 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 183 ms / 1967 ms | 0.017 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 184 ms / 2009 ms | 0.017 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 185 ms / 2009 ms | 0.017 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 185 ms / 1928 ms | 0.017 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 185 ms / 1950 ms | 0.017 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 187 ms / 1967 ms | 0.017 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 187 ms / 1950 ms | 0.017 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 187 ms / 1941 ms | 0.017 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 188 ms / 1928 ms | 0.017 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 188 ms / 1928 ms | 0.017 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 188 ms / 2005 ms | 0.017 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 190 ms / 1941 ms | 0.017 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 190 ms / 1967 ms | 0.017 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 191 ms / 2048 ms | 0.017 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 191 ms / 1967 ms | 0.017 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 191 ms / 2097 ms | 0.017 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 192 ms / 2048 ms | 0.017 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 193 ms / 1950 ms | 0.018 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 196 ms / 1960 ms | 0.018 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 196 ms / 2048 ms | 0.018 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 197 ms / 1960 ms | 0.018 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 201 ms / 1928 ms | 0.018 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 206 ms / 2097 ms | 0.019 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 210 ms / 2009 ms | 0.019 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 212 ms / 2048 ms | 0.019 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 214 ms / 1967 ms | 0.019 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 217 ms / 1950 ms | 0.020 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 224 ms / 1928 ms | 0.020 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 226 ms / 2005 ms | 0.021 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 226 ms / 1928 ms | 0.021 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 226 ms / 1960 ms | 0.021 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 226 ms / 2048 ms | 0.021 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 227 ms / 2005 ms | 0.021 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 227 ms / 1941 ms | 0.021 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 230 ms / 2005 ms | 0.021 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 231 ms / 2097 ms | 0.021 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 235 ms / 1941 ms | 0.021 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 236 ms / 2097 ms | 0.021 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 238 ms / 1941 ms | 0.022 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 246 ms / 1960 ms | 0.022 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 247 ms / 2048 ms | 0.022 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 247 ms / 2097 ms | 0.022 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 261 ms / 1960 ms | 0.024 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 66 ms / 1950 ms | 0.033 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 70 ms / 2005 ms | 0.035 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 70 ms / 2097 ms | 0.035 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 70 ms / 1967 ms | 0.035 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 71 ms / 2009 ms | 0.035 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 71 ms / 1960 ms | 0.035 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 72 ms / 1928 ms | 0.036 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 72 ms / 2048 ms | 0.036 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 73 ms / 1941 ms | 0.037 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 417 ms / 1967 ms | 0.038 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 421 ms / 2009 ms | 0.038 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 436 ms / 2097 ms | 0.040 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 453 ms / 2005 ms | 0.041 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 460 ms / 1941 ms | 0.042 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 1011 ms / 1950 ms | 0.045 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 517 ms / 1960 ms | 0.047 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 1191 ms / 2048 ms | 0.053 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 1239 ms / 1928 ms | 0.055 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 890 ms / 2048 ms | 0.081 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 915 ms / 1950 ms | 0.083 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 921 ms / 1928 ms | 0.084 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 381 ms / 2048 ms | 0.112 RTF |
BF16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 413 ms / 1950 ms | 0.121 RTF |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 422 ms / 1928 ms | 0.124 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 17 ms / 1846 ms | 0.009 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 18 ms / 1828 ms | 0.009 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 19 ms / 1858 ms | 0.009 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 145 ms / 1828 ms | 0.013 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 147 ms / 1846 ms | 0.013 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 150 ms / 1858 ms | 0.014 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 150 ms / 1846 ms | 0.014 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 151 ms / 1846 ms | 0.014 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 151 ms / 1828 ms | 0.014 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 153 ms / 1828 ms | 0.014 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 153 ms / 1846 ms | 0.014 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 156 ms / 1858 ms | 0.014 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 157 ms / 1846 ms | 0.014 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 158 ms / 1858 ms | 0.014 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 324 ms / 1846 ms | 0.014 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 158 ms / 1858 ms | 0.014 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 158 ms / 1828 ms | 0.014 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 169 ms / 1828 ms | 0.015 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 175 ms / 1828 ms | 0.016 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 177 ms / 1858 ms | 0.016 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 180 ms / 1858 ms | 0.016 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 187 ms / 1846 ms | 0.017 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 79 ms / 1846 ms | 0.023 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 451 ms / 1846 ms | 0.041 RTF |
Test setup & sample details
- Quality gate
- English WER <=0.20 clean/independent/longer, <=0.30 noisy, exact empty silence, EOS/no loops, warm RTF <=1; controlled fixtures only.
- Tested
- 2026-11-13T00:50:56.047743+00:00
- Environment
- { "os": "macos", "arch": "aarch64", "hardware": "Apple M3 Max", "osVersion": "27.2", "runtime": "Transformers5.22.1/Torch2.10.0", "interpreter": "App-ownedCPython3.13.18 pinned development venv" }
- Runtime
- transformers 5.22.1
- Artifact revision
- 7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf
- Fixture
{ "file": "model-samples/desktop/granite-speech5/granite-speech5-jfk.wav", "size": 3880888, "sha1": "6fb9dfd0ec18bb61a6af995c0df0cd32ee2afe34", "sha256": "c72e27f68334ae37e037ef819fa5aa1fc1552aa840b93e308df4ffe52317bedb", "url": "https://assets.localai.tools/samples/v1/files/c72e27f68334ae37e037ef819fa5aa1fc1552aa840b93e308df4ffe52317bedb/granite-speech5-jfk.wav" }- Rerun when
- artifact revision change; runtime version change; fixture or frozen quality gate change; relevant backend behavior change
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 451.71866699820384,
"inferenceMs": 451.324666995788,
"audioSeconds": 11,
"audioSecondsPerSecond": 24.372698423998745,
"realTimeFactor": 0.04102951518143527,
"firstChunkMs": 343.7532500247471,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1845.5714579904452,
"totalMs": 2297.290124988649,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 779943936,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 79.66775001841597,
"inferenceMs": 79.46929198806174,
"audioSeconds": 3.4,
"audioSecondsPerSecond": 42.78382146037949,
"realTimeFactor": 0.023373321172959337,
"firstChunkMs": 27.60625001974404,
"chunkCount": 9,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1845.5714579904452,
"totalMs": 1925.2392080088612,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 781205504,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 17.553916986798868,
"inferenceMs": 17.379124998115003,
"audioSeconds": 2,
"audioSecondsPerSecond": 115.08059238983128,
"realTimeFactor": 0.008689562499057502,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1845.5714579904452,
"totalMs": 1863.125374977244,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 781385728,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.3,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 150.72183299344033,
"inferenceMs": 150.50837499438785,
"audioSeconds": 11,
"audioSecondsPerSecond": 73.08563394170037,
"realTimeFactor": 0.01368257954494435,
"firstChunkMs": 46.03724999469705,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1845.5714579904452,
"totalMs": 1996.2932909838855,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 795705344,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 323.7916659854818,
"inferenceMs": 323.5266249976121,
"audioSeconds": 22.5,
"audioSecondsPerSecond": 69.546053590384,
"realTimeFactor": 0.014378961111004982,
"firstChunkMs": 82.49416598118842,
"chunkCount": 44,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1845.5714579904452,
"totalMs": 2169.363123975927,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 871792640,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 150.36812500329688,
"inferenceMs": 150.1362500130199,
"audioSeconds": 11,
"audioSecondsPerSecond": 73.26678266605217,
"realTimeFactor": 0.013648750001183626,
"firstChunkMs": 47.022624989040196,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1845.5714579904452,
"totalMs": 1995.939582993742,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 152.96700000180863,
"inferenceMs": 152.6665419805795,
"audioSeconds": 11,
"audioSecondsPerSecond": 72.0524605934894,
"realTimeFactor": 0.013878776543689046,
"firstChunkMs": 46.23149998951703,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1845.5714579904452,
"totalMs": 1998.5384579922538,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 186.78816698957235,
"inferenceMs": 186.5783749963157,
"audioSeconds": 11,
"audioSecondsPerSecond": 58.95645730764465,
"realTimeFactor": 0.016961670454210518,
"firstChunkMs": 45.072542008711025,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1845.5714579904452,
"totalMs": 2032.3596249800175,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 147.3795420024544,
"inferenceMs": 147.14658298180439,
"audioSeconds": 11,
"audioSecondsPerSecond": 74.75538865459227,
"realTimeFactor": 0.013376962089254945,
"firstChunkMs": 46.26945802010596,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1845.5714579904452,
"totalMs": 1992.9509999928996,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 157.66329198959284,
"inferenceMs": 157.44608402019367,
"audioSeconds": 11,
"audioSecondsPerSecond": 69.86518634905626,
"realTimeFactor": 0.014313280365472152,
"firstChunkMs": 44.81329201371409,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1845.5714579904452,
"totalMs": 2003.234749980038,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 179.93758301599883,
"inferenceMs": 179.5301669917535,
"audioSeconds": 11,
"audioSecondsPerSecond": 61.271039760717606,
"realTimeFactor": 0.01632092427197759,
"firstChunkMs": 61.65008302195929,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1858.0356250167824,
"totalMs": 2037.9732080327813,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 780812288,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 19.166499987477437,
"inferenceMs": 18.951833015307784,
"audioSeconds": 2,
"audioSecondsPerSecond": 105.53068921536818,
"realTimeFactor": 0.009475916507653892,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1858.0356250167824,
"totalMs": 1877.2021250042599,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 784498688,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 156.07100000488572,
"inferenceMs": 155.8352500142064,
"audioSeconds": 11,
"audioSecondsPerSecond": 70.58736710081453,
"realTimeFactor": 0.0141668409103824,
"firstChunkMs": 48.464041989063844,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1858.0356250167824,
"totalMs": 2014.1066250216682,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 158.42270900611766,
"inferenceMs": 158.20420798263513,
"audioSeconds": 11,
"audioSecondsPerSecond": 69.53038822587693,
"realTimeFactor": 0.014382200725694102,
"firstChunkMs": 47.80033399583772,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1858.0356250167824,
"totalMs": 2016.4583340229,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 177.27912499685772,
"inferenceMs": 177.01800001668744,
"audioSeconds": 11,
"audioSecondsPerSecond": 62.1405732691762,
"realTimeFactor": 0.016092545456062493,
"firstChunkMs": 47.23583298618905,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1858.0356250167824,
"totalMs": 2035.3147500136402,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 157.76716597611085,
"inferenceMs": 157.54591699806042,
"audioSeconds": 11,
"audioSecondsPerSecond": 69.82091449653642,
"realTimeFactor": 0.014322356090732765,
"firstChunkMs": 46.572707971790805,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1858.0356250167824,
"totalMs": 2015.8027909928933,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 150.3929590107873,
"inferenceMs": 150.12808400206268,
"audioSeconds": 11,
"audioSecondsPerSecond": 73.27076791207743,
"realTimeFactor": 0.013648007636551152,
"firstChunkMs": 47.13099999935366,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1858.0356250167824,
"totalMs": 2008.4285840275697,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 169.07916602212936,
"inferenceMs": 168.72575000161305,
"audioSeconds": 11,
"audioSecondsPerSecond": 65.19455388341636,
"realTimeFactor": 0.015338704545601186,
"firstChunkMs": 59.81387500651181,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1828.2938749762252,
"totalMs": 1997.3730409983546,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 779845632,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 17.782708018785343,
"inferenceMs": 17.59479200700298,
"audioSeconds": 2,
"audioSecondsPerSecond": 113.66999957737332,
"realTimeFactor": 0.00879739600350149,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1828.2938749762252,
"totalMs": 1846.0765829950105,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 779943936,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 152.8752500016708,
"inferenceMs": 152.64774998649955,
"audioSeconds": 11,
"audioSecondsPerSecond": 72.06133074986602,
"realTimeFactor": 0.013877068180590868,
"firstChunkMs": 46.32862500147894,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1828.2938749762252,
"totalMs": 1981.169124977896,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 158.6986249894835,
"inferenceMs": 158.43254199717194,
"audioSeconds": 11,
"audioSecondsPerSecond": 69.43018057613665,
"realTimeFactor": 0.014402958363379266,
"firstChunkMs": 47.57637498551048,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1828.2938749762252,
"totalMs": 1986.9924999657087,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 175.66387500846758,
"inferenceMs": 175.3907919919584,
"audioSeconds": 11,
"audioSecondsPerSecond": 62.71708950663924,
"realTimeFactor": 0.0159446174538144,
"firstChunkMs": 45.91725001228042,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1828.2938749762252,
"totalMs": 2003.9577499846928,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 151.5978749957867,
"inferenceMs": 151.37820798554458,
"audioSeconds": 11,
"audioSecondsPerSecond": 72.66567722251285,
"realTimeFactor": 0.013761655271413143,
"firstChunkMs": 45.41975000756793,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1828.2938749762252,
"totalMs": 1979.891749972012,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 145.10262498515658,
"inferenceMs": 144.8713330028113,
"audioSeconds": 11,
"audioSecondsPerSecond": 75.92944561217325,
"realTimeFactor": 0.013170121182073754,
"firstChunkMs": 44.36008300399408,
"chunkCount": 22,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1828.2938749762252,
"totalMs": 1973.3964999613818,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 891.5877910039853,
"inferenceMs": 890.3341249970254,
"audioSeconds": 11,
"audioSecondsPerSecond": 12.35491226401858,
"realTimeFactor": 0.0809394659088205,
"firstChunkMs": 624.9610829981975,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1287192576,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2047.769833006896,
"totalMs": 2939.3576240108814,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 649035776,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 381.6677920112852,
"inferenceMs": 380.6656670058146,
"audioSeconds": 3.4,
"audioSecondsPerSecond": 8.931722229491386,
"realTimeFactor": 0.11196049029582783,
"firstChunkMs": 306.10454198904335,
"chunkCount": 9,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1288880128,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2047.769833006896,
"totalMs": 2429.4376250181813,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 665239552,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 72.9295409983024,
"inferenceMs": 72.0365830056835,
"audioSeconds": 2,
"audioSecondsPerSecond": 27.763671131405626,
"realTimeFactor": 0.03601829150284175,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1289650176,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2047.769833006896,
"totalMs": 2120.6993740051985,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 680738816,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.3,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 191.63295900216326,
"inferenceMs": 190.52466700668447,
"audioSeconds": 11,
"audioSecondsPerSecond": 57.735306261493534,
"realTimeFactor": 0.017320424273334953,
"firstChunkMs": 48.369083990110084,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1289650176,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2047.769833006896,
"totalMs": 2239.4027920090593,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 690913280,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 1192.016082990449,
"inferenceMs": 1190.7150410115719,
"audioSeconds": 22.5,
"audioSecondsPerSecond": 18.89620876955172,
"realTimeFactor": 0.052920668489403196,
"firstChunkMs": 737.3255410057027,
"chunkCount": 44,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1387331584,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2047.769833006896,
"totalMs": 3239.785915997345,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 772849664,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 193.39520897483453,
"inferenceMs": 192.0949589984957,
"audioSeconds": 11,
"audioSecondsPerSecond": 57.26334546908199,
"realTimeFactor": 0.017463178090772337,
"firstChunkMs": 48.921374982455745,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1387331584,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2047.769833006896,
"totalMs": 2241.1650419817306,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 213.59625001787208,
"inferenceMs": 212.32166601112112,
"audioSeconds": 11,
"audioSecondsPerSecond": 51.808184283104836,
"realTimeFactor": 0.01930196963737465,
"firstChunkMs": 51.86566701740958,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1387331584,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2047.769833006896,
"totalMs": 2261.366083024768,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 228.3357080013957,
"inferenceMs": 226.20045801158994,
"audioSeconds": 11,
"audioSecondsPerSecond": 48.629432922882884,
"realTimeFactor": 0.02056367800105363,
"firstChunkMs": 81.09029199113138,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1387331584,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2047.769833006896,
"totalMs": 2276.1055410082918,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 248.34604101488367,
"inferenceMs": 247.00529102119617,
"audioSeconds": 11,
"audioSecondsPerSecond": 44.533458998074906,
"realTimeFactor": 0.02245502645647238,
"firstChunkMs": 60.342000011587515,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1387331584,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2047.769833006896,
"totalMs": 2296.1158740217797,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 197.4353750119917,
"inferenceMs": 196.24808299704455,
"audioSeconds": 11,
"audioSecondsPerSecond": 56.0515029345059,
"realTimeFactor": 0.01784073481791314,
"firstChunkMs": 50.854959001298994,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1387331584,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2047.769833006896,
"totalMs": 2245.205208018888,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 518.205999978818,
"inferenceMs": 516.5339579980355,
"audioSeconds": 11,
"audioSecondsPerSecond": 21.295792521818743,
"realTimeFactor": 0.046957632545275955,
"firstChunkMs": 209.410207986366,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1287192576,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1960.441000002902,
"totalMs": 2478.64699998172,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 641368064,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 72.01816601445898,
"inferenceMs": 70.73237499571405,
"audioSeconds": 2,
"audioSecondsPerSecond": 28.275595158810766,
"realTimeFactor": 0.03536618749785703,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1287962624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1960.441000002902,
"totalMs": 2032.459166017361,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 657047552,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 197.3151659767609,
"inferenceMs": 196.0242919740267,
"audioSeconds": 11,
"audioSecondsPerSecond": 56.11549410140201,
"realTimeFactor": 0.017820390179456972,
"firstChunkMs": 51.281958003528416,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1287962624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1960.441000002902,
"totalMs": 2157.756165979663,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 261.70549998641945,
"inferenceMs": 260.58745800401084,
"audioSeconds": 11,
"audioSecondsPerSecond": 42.2123155283655,
"realTimeFactor": 0.02368976890945553,
"firstChunkMs": 44.72337500192225,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1287962624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1960.441000002902,
"totalMs": 2222.1464999893215,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 227.18229200108908,
"inferenceMs": 226.1059159936849,
"audioSeconds": 11,
"audioSecondsPerSecond": 48.649766423215695,
"realTimeFactor": 0.020555083272153173,
"firstChunkMs": 52.35087499022484,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1287962624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1960.441000002902,
"totalMs": 2187.623292003991,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 247.13537498610094,
"inferenceMs": 246.14083301275969,
"audioSeconds": 11,
"audioSecondsPerSecond": 44.68986256916491,
"realTimeFactor": 0.022376439364796333,
"firstChunkMs": 57.06704099429771,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1287962624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1960.441000002902,
"totalMs": 2207.576374989003,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 198.12124999589287,
"inferenceMs": 196.92162499995902,
"audioSeconds": 11,
"audioSecondsPerSecond": 55.85978685683855,
"realTimeFactor": 0.017901965909087183,
"firstChunkMs": 52.99900000682101,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1287962624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1960.441000002902,
"totalMs": 2158.562249998795,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 437.53066600766033,
"inferenceMs": 436.21295801131055,
"audioSeconds": 11,
"audioSecondsPerSecond": 25.217040892477986,
"realTimeFactor": 0.03965572345557369,
"firstChunkMs": 177.54070801311173,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1287192576,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2097.0099580008537,
"totalMs": 2534.540624008514,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 638763008,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 71.40208399505354,
"inferenceMs": 69.92087501566857,
"audioSeconds": 2,
"audioSecondsPerSecond": 28.603761030619538,
"realTimeFactor": 0.034960437507834285,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1287962624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2097.0099580008537,
"totalMs": 2168.412041995907,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 654426112,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 193.05295799858868,
"inferenceMs": 191.28216701210476,
"audioSeconds": 11,
"audioSecondsPerSecond": 57.50666762000817,
"realTimeFactor": 0.017389287910191342,
"firstChunkMs": 47.11949999909848,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1287962624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2097.0099580008537,
"totalMs": 2290.0629159994423,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 237.62962501496077,
"inferenceMs": 236.21054098475724,
"audioSeconds": 11,
"audioSecondsPerSecond": 46.56862455901083,
"realTimeFactor": 0.02147368554406884,
"firstChunkMs": 43.506457994226366,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1287962624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2097.0099580008537,
"totalMs": 2334.6395830158144,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 232.34320798655972,
"inferenceMs": 230.88416701648384,
"audioSeconds": 11,
"audioSecondsPerSecond": 47.64293776460931,
"realTimeFactor": 0.02098946972877126,
"firstChunkMs": 54.68404199928045,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1287962624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2097.0099580008537,
"totalMs": 2329.3531659874134,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 250.2754170272965,
"inferenceMs": 247.28549999417737,
"audioSeconds": 11,
"audioSecondsPerSecond": 44.4829963756832,
"realTimeFactor": 0.02248049999947067,
"firstChunkMs": 54.214000003412366,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1287962624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2097.0099580008537,
"totalMs": 2347.28537502815,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 206.83154099970125,
"inferenceMs": 205.61549998819828,
"audioSeconds": 11,
"audioSecondsPerSecond": 53.49791236862672,
"realTimeFactor": 0.018692318180745297,
"firstChunkMs": 56.84129099245183,
"chunkCount": 22,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1287962624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2097.0099580008537,
"totalMs": 2303.841499000555,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 922.3894169845153,
"inferenceMs": 921.094165998511,
"audioSeconds": 11,
"audioSecondsPerSecond": 11.942318609819294,
"realTimeFactor": 0.08373583327259192,
"firstChunkMs": 660.8417499810457,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1207500800,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1927.5395839940757,
"totalMs": 2849.929000978591,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp16",
"cpuThreads": 4,
"rssBytes": 736100352,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 424.0240420040209,
"inferenceMs": 422.3643750010524,
"audioSeconds": 3.4,
"audioSecondsPerSecond": 8.04992135047263,
"realTimeFactor": 0.12422481617678012,
"firstChunkMs": 350.2127920219209,
"chunkCount": 9,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1209188352,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1927.5395839940757,
"totalMs": 2351.5636259980965,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp16",
"cpuThreads": 4,
"rssBytes": 752762880,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 72.45920901186764,
"inferenceMs": 71.54370899661444,
"audioSeconds": 2,
"audioSecondsPerSecond": 27.954938708791897,
"realTimeFactor": 0.03577185449830722,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1211006976,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1927.5395839940757,
"totalMs": 1999.9987930059433,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp16",
"cpuThreads": 4,
"rssBytes": 768180224,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.3,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 187.30887499987148,
"inferenceMs": 184.66475000604987,
"audioSeconds": 11,
"audioSecondsPerSecond": 59.567405255413526,
"realTimeFactor": 0.016787704546004534,
"firstChunkMs": 45.476874976884574,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1211006976,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1927.5395839940757,
"totalMs": 2114.848458993947,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp16",
"cpuThreads": 4,
"rssBytes": 773931008,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 1240.63237500377,
"inferenceMs": 1239.4249580102041,
"audioSeconds": 22.5,
"audioSecondsPerSecond": 18.153579895729965,
"realTimeFactor": 0.055085553689342405,
"firstChunkMs": 666.9738750206307,
"chunkCount": 44,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1324417024,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1927.5395839940757,
"totalMs": 3168.1719589978456,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp16",
"cpuThreads": 4,
"rssBytes": 853917696,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 189.12075000116602,
"inferenceMs": 187.87483300548047,
"audioSeconds": 11,
"audioSecondsPerSecond": 58.54961957400181,
"realTimeFactor": 0.017079530273225497,
"firstChunkMs": 47.18033300014213,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1324417024,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1927.5395839940757,
"totalMs": 2116.6603339952417,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 202.55449999240227,
"inferenceMs": 201.39149998431094,
"audioSeconds": 11,
"audioSecondsPerSecond": 54.6199814831159,
"realTimeFactor": 0.018308318180391903,
"firstChunkMs": 49.949334003031254,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1324417024,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1927.5395839940757,
"totalMs": 2130.094083986478,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 225.47095801564865,
"inferenceMs": 224.261833995115,
"audioSeconds": 11,
"audioSecondsPerSecond": 49.049808449526935,
"realTimeFactor": 0.020387439454101364,
"firstChunkMs": 81.61583301261999,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1324417024,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1927.5395839940757,
"totalMs": 2153.0105420097243,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 227.19333300483413,
"inferenceMs": 226.1052080139052,
"audioSeconds": 11,
"audioSecondsPerSecond": 48.649918755181936,
"realTimeFactor": 0.02055501891035502,
"firstChunkMs": 60.11291698087007,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1324417024,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1927.5395839940757,
"totalMs": 2154.73291699891,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 188.9327079989016,
"inferenceMs": 187.7489170001354,
"audioSeconds": 11,
"audioSecondsPerSecond": 58.588886560618974,
"realTimeFactor": 0.017068083363648675,
"firstChunkMs": 48.78195800120011,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1324417024,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1927.5395839940757,
"totalMs": 2116.4722919929773,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 454.8513329937123,
"inferenceMs": 453.49641700158827,
"audioSeconds": 11,
"audioSecondsPerSecond": 24.255979953997024,
"realTimeFactor": 0.04122694700014439,
"firstChunkMs": 191.5866250055842,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1207500800,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2004.9734579806682,
"totalMs": 2459.8247909743804,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp16",
"cpuThreads": 4,
"rssBytes": 737214464,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 70.96812501549721,
"inferenceMs": 69.60837499354966,
"audioSeconds": 2,
"audioSecondsPerSecond": 28.732174830763284,
"realTimeFactor": 0.03480418749677483,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1208270848,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2004.9734579806682,
"totalMs": 2075.9415829961654,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp16",
"cpuThreads": 4,
"rssBytes": 753074176,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 183.04974999045953,
"inferenceMs": 181.93004201748408,
"audioSeconds": 11,
"audioSecondsPerSecond": 60.46280140441491,
"realTimeFactor": 0.01653909472886219,
"firstChunkMs": 42.76770900469273,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1208270848,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2004.9734579806682,
"totalMs": 2188.0232079711277,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 231.28508299123496,
"inferenceMs": 229.581124993274,
"audioSeconds": 11,
"audioSecondsPerSecond": 47.913346536315935,
"realTimeFactor": 0.020871011363024907,
"firstChunkMs": 47.811999975237995,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1208270848,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2004.9734579806682,
"totalMs": 2236.258540971903,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 227.43379199528135,
"inferenceMs": 225.85441698902287,
"audioSeconds": 11,
"audioSecondsPerSecond": 48.70394011614406,
"realTimeFactor": 0.020532219726274805,
"firstChunkMs": 51.238957996247336,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1208270848,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2004.9734579806682,
"totalMs": 2232.4072499759495,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 227.6656659960281,
"inferenceMs": 226.59095900598913,
"audioSeconds": 11,
"audioSecondsPerSecond": 48.54562621675145,
"realTimeFactor": 0.02059917809145356,
"firstChunkMs": 54.429749987320974,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1208270848,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2004.9734579806682,
"totalMs": 2232.6391239766963,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 189.8243750038091,
"inferenceMs": 188.45587500254624,
"audioSeconds": 11,
"audioSecondsPerSecond": 58.369100989031935,
"realTimeFactor": 0.01713235227295875,
"firstChunkMs": 47.76279200450517,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1208270848,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2004.9734579806682,
"totalMs": 2194.7978329844773,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 461.5715419931803,
"inferenceMs": 460.31283400952816,
"audioSeconds": 11,
"audioSecondsPerSecond": 23.89679189299403,
"realTimeFactor": 0.04184662127359347,
"firstChunkMs": 193.72966699302197,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1207500800,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1940.6594579922967,
"totalMs": 2402.230999985477,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp16",
"cpuThreads": 4,
"rssBytes": 739098624,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 74.92391698178835,
"inferenceMs": 73.08724999893457,
"audioSeconds": 2,
"audioSecondsPerSecond": 27.3645540094771,
"realTimeFactor": 0.036543624999467283,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1208270848,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1940.6594579922967,
"totalMs": 2015.583374974085,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp16",
"cpuThreads": 4,
"rssBytes": 755400704,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 188.90529198688455,
"inferenceMs": 187.48845800291747,
"audioSeconds": 11,
"audioSecondsPerSecond": 58.670278251628865,
"realTimeFactor": 0.0170444052729925,
"firstChunkMs": 46.44325000117533,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1208270848,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1940.6594579922967,
"totalMs": 2129.564749979181,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 238.1661250256002,
"inferenceMs": 234.51358400052413,
"audioSeconds": 11,
"audioSecondsPerSecond": 46.90559844062344,
"realTimeFactor": 0.021319416727320375,
"firstChunkMs": 62.1513330261223,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1208270848,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1940.6594579922967,
"totalMs": 2178.825583017897,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 228.42912501073442,
"inferenceMs": 227.0145840011537,
"audioSeconds": 11,
"audioSecondsPerSecond": 48.45503670347495,
"realTimeFactor": 0.020637689454650335,
"firstChunkMs": 52.65337499440648,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1208270848,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1940.6594579922967,
"totalMs": 2169.088583003031,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 240.52033401676454,
"inferenceMs": 238.07900000247173,
"audioSeconds": 11,
"audioSecondsPerSecond": 46.203151054422264,
"realTimeFactor": 0.021643545454770156,
"firstChunkMs": 47.10812499979511,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1208270848,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1940.6594579922967,
"totalMs": 2181.179792009061,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 190.95641700550914,
"inferenceMs": 189.6230409911368,
"audioSeconds": 11,
"audioSecondsPerSecond": 58.00982803832448,
"realTimeFactor": 0.01723845827192153,
"firstChunkMs": 49.79045799700543,
"chunkCount": 22,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1208270848,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1940.6594579922967,
"totalMs": 2131.615874997806,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 918.5327920131385,
"inferenceMs": 915.0745420192834,
"audioSeconds": 11,
"audioSecondsPerSecond": 12.020878622332164,
"realTimeFactor": 0.08318859472902576,
"firstChunkMs": 656.6329170018435,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1207500800,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1950.3151249955408,
"totalMs": 2868.8479170086794,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "bf16",
"cpuThreads": 4,
"rssBytes": 733839360,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 414.0096250048373,
"inferenceMs": 412.6669999968726,
"audioSeconds": 3.4,
"audioSecondsPerSecond": 8.239088659926203,
"realTimeFactor": 0.12137264705790371,
"firstChunkMs": 338.4208749921527,
"chunkCount": 9,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1209188352,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1950.3151249955408,
"totalMs": 2364.324750000378,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "bf16",
"cpuThreads": 4,
"rssBytes": 750288896,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 67.1778749965597,
"inferenceMs": 65.83841700921766,
"audioSeconds": 2,
"audioSecondsPerSecond": 30.377401080587816,
"realTimeFactor": 0.03291920850460883,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1211006976,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1950.3151249955408,
"totalMs": 2017.4929999921005,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "bf16",
"cpuThreads": 4,
"rssBytes": 766001152,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.3,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 184.46133300312795,
"inferenceMs": 183.02387499716133,
"audioSeconds": 11,
"audioSecondsPerSecond": 60.10144851413843,
"realTimeFactor": 0.01663853409065103,
"firstChunkMs": 43.56570800882764,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1211006976,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1950.3151249955408,
"totalMs": 2134.776457998669,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "bf16",
"cpuThreads": 4,
"rssBytes": 771735552,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 1012.6601249794476,
"inferenceMs": 1010.9351669962052,
"audioSeconds": 22.5,
"audioSecondsPerSecond": 22.256620141976384,
"realTimeFactor": 0.04493045186649801,
"firstChunkMs": 589.5544159866404,
"chunkCount": 44,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1324417024,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1950.3151249955408,
"totalMs": 2962.9752499749884,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "bf16",
"cpuThreads": 4,
"rssBytes": 851820544,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 191.21408398495987,
"inferenceMs": 187.45816600858234,
"audioSeconds": 11,
"audioSecondsPerSecond": 58.67975897884539,
"realTimeFactor": 0.017041651455325667,
"firstChunkMs": 48.5489169950597,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1324417024,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1950.3151249955408,
"totalMs": 2141.5292089805007,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 182.11200000951067,
"inferenceMs": 180.8744169829879,
"audioSeconds": 11,
"audioSecondsPerSecond": 60.81567633212939,
"realTimeFactor": 0.016443128816635264,
"firstChunkMs": 42.31375001836568,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1324417024,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1950.3151249955408,
"totalMs": 2132.4271250050515,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 218.20729100727476,
"inferenceMs": 216.6311670152936,
"audioSeconds": 11,
"audioSecondsPerSecond": 50.77755039386105,
"realTimeFactor": 0.019693742455935782,
"firstChunkMs": 75.11658300063573,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1324417024,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1950.3151249955408,
"totalMs": 2168.5224160028156,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 186.13054198794998,
"inferenceMs": 184.90187500719912,
"audioSeconds": 11,
"audioSecondsPerSecond": 59.49101381244358,
"realTimeFactor": 0.01680926136429083,
"firstChunkMs": 45.258166996063665,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1324417024,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1950.3151249955408,
"totalMs": 2136.445666983491,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 195.10008301585913,
"inferenceMs": 193.2125419843942,
"audioSeconds": 11,
"audioSecondsPerSecond": 56.93212193693136,
"realTimeFactor": 0.017564776544035834,
"firstChunkMs": 42.9368750192225,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1324417024,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1950.3151249955408,
"totalMs": 2145.4152080114,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 422.9795830033254,
"inferenceMs": 420.9224170190282,
"audioSeconds": 11,
"audioSecondsPerSecond": 26.133081905929316,
"realTimeFactor": 0.03826567427445711,
"firstChunkMs": 172.01999999815598,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1207500800,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2009.3027089897078,
"totalMs": 2432.282291993033,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "bf16",
"cpuThreads": 4,
"rssBytes": 736690176,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 73.18700000178069,
"inferenceMs": 70.62741700792685,
"audioSeconds": 2,
"audioSecondsPerSecond": 28.317614953630976,
"realTimeFactor": 0.035313708503963426,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1208270848,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2009.3027089897078,
"totalMs": 2082.4897089914884,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "bf16",
"cpuThreads": 4,
"rssBytes": 752664576,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 185.46379197505303,
"inferenceMs": 183.88962498283945,
"audioSeconds": 11,
"audioSecondsPerSecond": 59.81849166871985,
"realTimeFactor": 0.016717238634803587,
"firstChunkMs": 42.63095898204483,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1208270848,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2009.3027089897078,
"totalMs": 2194.766500964761,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 182.24883297807537,
"inferenceMs": 180.9931249881629,
"audioSeconds": 11,
"audioSecondsPerSecond": 60.775789139611845,
"realTimeFactor": 0.016453920453469353,
"firstChunkMs": 42.964457999914885,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1208270848,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2009.3027089897078,
"totalMs": 2191.551541967783,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 212.60629099560902,
"inferenceMs": 210.13337501790375,
"audioSeconds": 11,
"audioSecondsPerSecond": 52.3477053517214,
"realTimeFactor": 0.019103034092536705,
"firstChunkMs": 46.16233299020678,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1208270848,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2009.3027089897078,
"totalMs": 2221.9089999853168,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 186.02920800913125,
"inferenceMs": 184.5597499923315,
"audioSeconds": 11,
"audioSecondsPerSecond": 59.601294434225515,
"realTimeFactor": 0.016778159090211953,
"firstChunkMs": 45.07812499650754,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1208270848,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2009.3027089897078,
"totalMs": 2195.331916998839,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 183.19491698639467,
"inferenceMs": 181.86204199446365,
"audioSeconds": 11,
"audioSecondsPerSecond": 60.48540904613217,
"realTimeFactor": 0.016532912908587605,
"firstChunkMs": 43.16145897610113,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1208270848,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 2009.3027089897078,
"totalMs": 2192.4976259761024,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 418.46654200344346,
"inferenceMs": 416.8922500102781,
"audioSeconds": 11,
"audioSecondsPerSecond": 26.38571477337083,
"realTimeFactor": 0.03789929545547983,
"firstChunkMs": 173.85699998703785,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1207500800,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1966.6534999851137,
"totalMs": 2385.120041988557,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "bf16",
"cpuThreads": 4,
"rssBytes": 734330880,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 71.40712498221546,
"inferenceMs": 70.13725000433624,
"audioSeconds": 2,
"audioSecondsPerSecond": 28.51551778657347,
"realTimeFactor": 0.03506862500216812,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1208270848,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1966.6534999851137,
"totalMs": 2038.0606249673292,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "bf16",
"cpuThreads": 4,
"rssBytes": 750223360,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 187.88204100565054,
"inferenceMs": 186.59820800530724,
"audioSeconds": 11,
"audioSecondsPerSecond": 58.95019098836757,
"realTimeFactor": 0.016963473455027932,
"firstChunkMs": 45.76124998857267,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1208270848,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1966.6534999851137,
"totalMs": 2154.5355409907643,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 190.90654197498225,
"inferenceMs": 189.62499999906868,
"audioSeconds": 11,
"audioSecondsPerSecond": 58.009228741220966,
"realTimeFactor": 0.017238636363551697,
"firstChunkMs": 43.36045897798613,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1208270848,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1966.6534999851137,
"totalMs": 2157.560041960096,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 214.85429201857187,
"inferenceMs": 213.61499998602085,
"audioSeconds": 11,
"audioSecondsPerSecond": 51.49451115661283,
"realTimeFactor": 0.019419545453274623,
"firstChunkMs": 46.32258301717229,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1208270848,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1966.6534999851137,
"totalMs": 2181.5077920036856,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 192.6054159994237,
"inferenceMs": 191.1454580258578,
"audioSeconds": 11,
"audioSecondsPerSecond": 57.547796916586634,
"realTimeFactor": 0.01737685982053253,
"firstChunkMs": 44.72033301135525,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1208270848,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1966.6534999851137,
"totalMs": 2159.2589159845375,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 184.90808398928493,
"inferenceMs": 183.30345800495706,
"audioSeconds": 11,
"audioSecondsPerSecond": 60.009778973741604,
"realTimeFactor": 0.016663950727723368,
"firstChunkMs": 43.15554199274629,
"chunkCount": 22,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1208270848,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1966.6534999851137,
"totalMs": 2151.5615839743987,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "7a73d8d55ac0ba2ef3ae761593f6784b51f96dcf"
}
}
]Moonshine Base — Spanish Speech Recognition Desktop
48 configurations testedQuality criteria
WER <=0.20 three frozen Spanish FLEURS clips, <=0.30 deterministic noisy clip, empty real-neural silence, EOS/no loops/gibberish, warmRTF<=1; controlled read-speech only.
| Precision | Device | Result | Platform | Inference / load | Task metric | |
|---|---|---|---|---|---|---|
Q8 | cpu | Passed | Very fast | macos · aarch64 | 15 ms / 609 ms | 0.008 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 15 ms / 623 ms | 0.008 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 16 ms / 633 ms | 0.008 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 18 ms / 1774 ms | 0.009 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 18 ms / 707 ms | 0.009 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 18 ms / 690 ms | 0.009 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 162 ms / 1774 ms | 0.018 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 152 ms / 707 ms | 0.018 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 152 ms / 690 ms | 0.018 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 152 ms / 707 ms | 0.018 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 153 ms / 690 ms | 0.018 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 153 ms / 707 ms | 0.018 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 153 ms / 690 ms | 0.018 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 153 ms / 690 ms | 0.018 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 153 ms / 707 ms | 0.018 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 153 ms / 1774 ms | 0.018 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 153 ms / 690 ms | 0.018 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 154 ms / 707 ms | 0.018 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 154 ms / 690 ms | 0.018 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 155 ms / 707 ms | 0.018 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 155 ms / 1774 ms | 0.018 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 155 ms / 1774 ms | 0.019 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 157 ms / 1774 ms | 0.019 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 158 ms / 1774 ms | 0.019 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 159 ms / 1774 ms | 0.019 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 166 ms / 1774 ms | 0.020 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 244 ms / 1774 ms | 0.020 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 207 ms / 623 ms | 0.023 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 197 ms / 623 ms | 0.023 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 197 ms / 633 ms | 0.023 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 197 ms / 623 ms | 0.023 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 198 ms / 623 ms | 0.024 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 199 ms / 633 ms | 0.024 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 199 ms / 633 ms | 0.024 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 200 ms / 609 ms | 0.024 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 200 ms / 623 ms | 0.024 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 201 ms / 623 ms | 0.024 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 201 ms / 609 ms | 0.024 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 201 ms / 623 ms | 0.024 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 202 ms / 623 ms | 0.024 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 202 ms / 609 ms | 0.024 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 203 ms / 633 ms | 0.024 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 206 ms / 609 ms | 0.024 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 206 ms / 609 ms | 0.025 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 206 ms / 609 ms | 0.025 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 211 ms / 633 ms | 0.025 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 314 ms / 623 ms | 0.026 RTF |
Q8 | cpu | Passed | Very fast | macos · aarch64 | 222 ms / 633 ms | 0.026 RTF |
Test setup & sample details
- Quality gate
- WER <=0.20 three frozen Spanish FLEURS clips, <=0.30 deterministic noisy clip, empty real-neural silence, EOS/no loops/gibberish, warmRTF<=1; controlled read-speech only.
- Tested
- 2026-11-13T01:30:49.985923+00:00
- Environment
- { "os": "macos", "arch": "aarch64", "hardware": "Apple M3 Max", "osVersion": "27.2", "runtime": "ONNX Runtime1.31.1", "interpreter": "App-ownedCPython3.13.18 private locked environment" }
- Runtime
- onnxruntime 1.31.1
- Artifact revision
- 661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c
- Fixture
{ "file": "model-samples/desktop/moonshine-family/es_419-clean-0.wav", "size": 268844, "sha1": "4fcd501f4204aadfdb6bdd8741626548612ecadd", "sha256": "6137763a726844a7dfdd853ee2211bcd97a171c9d5abdab740789b9b3d1d49e5", "url": "https://assets.localai.tools/samples/v1/files/6137763a726844a7dfdd853ee2211bcd97a171c9d5abdab740789b9b3d1d49e5/es_419-clean-0.wav" }- Rerun when
- artifact revision change; runtime version change; fixture or frozen quality gate change; relevant backend behavior change
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 168.26145799132064,
"inferenceMs": 155.44549998594448,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 54.03823205406098,
"realTimeFactor": 0.01850541666499339,
"firstChunkMs": 81.73437498044223,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 1774.2630419961642,
"totalMs": 1942.524499987485,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 750469120,
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0.03333333333333333,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 260.8217500091996,
"inferenceMs": 243.57854199479334,
"audioSeconds": 12.12,
"audioSecondsPerSecond": 49.758077623516904,
"realTimeFactor": 0.0200972394385143,
"firstChunkMs": 113.49212500499561,
"chunkCount": 44,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 1774.2630419961642,
"totalMs": 2035.0847920053639,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 766066688,
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 175.4053749900777,
"inferenceMs": 162.19941701274365,
"audioSeconds": 9.18,
"audioSecondsPerSecond": 56.596997505106614,
"realTimeFactor": 0.017668781809667064,
"firstChunkMs": 87.88916698540561,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 1774.2630419961642,
"totalMs": 1949.668416986242,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 767934464,
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.3,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 165.65137499128468,
"inferenceMs": 153.47774999099784,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 54.73106036863779,
"realTimeFactor": 0.018271160713214028,
"firstChunkMs": 80.16295899869874,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 1774.2630419961642,
"totalMs": 1939.914416987449,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 774307840,
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 23.898917017504573,
"inferenceMs": 18.227749998914078,
"audioSeconds": 2,
"audioSecondsPerSecond": 109.72281275084146,
"realTimeFactor": 0.009113874999457039,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 1774.2630419961642,
"totalMs": 1798.1619590136688,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 774488064,
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 168.84600001503713,
"inferenceMs": 156.8394170026295,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 53.55796495889277,
"realTimeFactor": 0.0186713591669797,
"firstChunkMs": 81.71791600761935,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 1774.2630419961642,
"totalMs": 1943.1090420112014,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 178.14870798611082,
"inferenceMs": 166.19583399733528,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 50.54278316106698,
"realTimeFactor": 0.019785218333016105,
"firstChunkMs": 83.80362499156035,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 1774.2630419961642,
"totalMs": 1952.411749982275,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 171.04766599368304,
"inferenceMs": 158.68837499874644,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 52.93393419692121,
"realTimeFactor": 0.018891473214136482,
"firstChunkMs": 82.98954099882394,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 1774.2630419961642,
"totalMs": 1945.3107079898473,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 169.80183401028626,
"inferenceMs": 157.85491702263243,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 53.213420008929155,
"realTimeFactor": 0.01879225202650386,
"firstChunkMs": 82.5876249873545,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 1774.2630419961642,
"totalMs": 1944.0648760064505,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 167.7440839994233,
"inferenceMs": 155.38312497665174,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 54.0599244690323,
"realTimeFactor": 0.018497991068649015,
"firstChunkMs": 81.90870902035385,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 1774.2630419961642,
"totalMs": 1942.0071259955876,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 167.47358298744075,
"inferenceMs": 154.90783299901523,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 54.22579244300319,
"realTimeFactor": 0.018441408690358957,
"firstChunkMs": 81.52058298583142,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 707.048374984879,
"totalMs": 874.5219579723198,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 749322240,
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 24.126125004841015,
"inferenceMs": 18.30766597413458,
"audioSeconds": 2,
"audioSecondsPerSecond": 109.24385461399821,
"realTimeFactor": 0.00915383298706729,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 707.048374984879,
"totalMs": 731.1744999897201,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 749355008,
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 165.8224999846425,
"inferenceMs": 153.76329098944552,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 54.629423875797414,
"realTimeFactor": 0.018305153689219707,
"firstChunkMs": 80.7481249794364,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 707.048374984879,
"totalMs": 872.8708749695215,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 165.3967919992283,
"inferenceMs": 153.36520798155107,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 54.77122295566848,
"realTimeFactor": 0.018257762854946555,
"firstChunkMs": 80.2894170046784,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 707.048374984879,
"totalMs": 872.4451669841073,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 164.52320900862105,
"inferenceMs": 152.4867090047337,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 55.086768249023166,
"realTimeFactor": 0.01815317964342068,
"firstChunkMs": 79.73566700820811,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 707.048374984879,
"totalMs": 871.5715839935001,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 164.03795898077078,
"inferenceMs": 152.12066698586568,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 55.21932138767501,
"realTimeFactor": 0.01810960321260306,
"firstChunkMs": 79.584666993469,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 707.048374984879,
"totalMs": 871.0863339656498,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 164.8820000118576,
"inferenceMs": 152.9333330108784,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 54.92589375138051,
"realTimeFactor": 0.018206349167961718,
"firstChunkMs": 79.61629101191647,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 707.048374984879,
"totalMs": 871.9303749967366,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 165.3670840023551,
"inferenceMs": 153.2138749898877,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 54.8253217964392,
"realTimeFactor": 0.01823974702260568,
"firstChunkMs": 80.44983400031924,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 690.1585830200929,
"totalMs": 855.525667022448,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 793952256,
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 24.13487498415634,
"inferenceMs": 18.46337501774542,
"audioSeconds": 2,
"audioSecondsPerSecond": 108.32255739147207,
"realTimeFactor": 0.00923168750887271,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 690.1585830200929,
"totalMs": 714.2934580042493,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 794771456,
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 165.13158299494535,
"inferenceMs": 153.01366697531193,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 54.897057014882876,
"realTimeFactor": 0.018215912735156183,
"firstChunkMs": 80.61216599890031,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 690.1585830200929,
"totalMs": 855.2901660150383,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 165.47287499997765,
"inferenceMs": 153.48800001083873,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 54.72740539590603,
"realTimeFactor": 0.01827238095367128,
"firstChunkMs": 80.14449998154305,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 690.1585830200929,
"totalMs": 855.6314580200706,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 164.56266600289382,
"inferenceMs": 152.89516700431705,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 54.93960446612955,
"realTimeFactor": 0.01820180559575203,
"firstChunkMs": 80.64929099055007,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 690.1585830200929,
"totalMs": 854.7212490229867,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 164.03787498711608,
"inferenceMs": 152.28608399047516,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 55.15934076107298,
"realTimeFactor": 0.018129295713151805,
"firstChunkMs": 80.58208398870192,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 690.1585830200929,
"totalMs": 854.196458007209,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 166.80295899277553,
"inferenceMs": 154.1861669975333,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 54.47959543695243,
"realTimeFactor": 0.018355496071134916,
"firstChunkMs": 81.67895898805,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 690.1585830200929,
"totalMs": 856.9615420128684,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 212.41149998968467,
"inferenceMs": 200.24491698131897,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 41.94863034043278,
"realTimeFactor": 0.023838680593014163,
"firstChunkMs": 65.70208398625255,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 622.5357079820242,
"totalMs": 834.9472079717088,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "q8",
"cpuThreads": 4,
"rssBytes": 373374976,
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0.03333333333333333,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 331.0624579899013,
"inferenceMs": 313.9106250018813,
"audioSeconds": 12.12,
"audioSecondsPerSecond": 38.60971574290409,
"realTimeFactor": 0.025900216584313636,
"firstChunkMs": 84.0985830000136,
"chunkCount": 44,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 622.5357079820242,
"totalMs": 953.5981659719255,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "q8",
"cpuThreads": 4,
"rssBytes": 437878784,
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 219.82570897671394,
"inferenceMs": 206.73433298361488,
"audioSeconds": 9.18,
"audioSecondsPerSecond": 44.40481591767139,
"realTimeFactor": 0.02252007984570968,
"firstChunkMs": 69.25449997652322,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 622.5357079820242,
"totalMs": 842.3614169587381,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "q8",
"cpuThreads": 4,
"rssBytes": 441778176,
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.3,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 212.77612500125542,
"inferenceMs": 200.7085420191288,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 41.8517314484773,
"realTimeFactor": 0.023893874049896284,
"firstChunkMs": 63.9805420069024,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 622.5357079820242,
"totalMs": 835.3118329832796,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "q8",
"cpuThreads": 4,
"rssBytes": 447758336,
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 20.97654200042598,
"inferenceMs": 15.38199998321943,
"audioSeconds": 2,
"audioSecondsPerSecond": 130.02210389948283,
"realTimeFactor": 0.007690999991609715,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 622.5357079820242,
"totalMs": 643.5122499824502,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "q8",
"cpuThreads": 4,
"rssBytes": 447791104,
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 213.0418749875389,
"inferenceMs": 201.061750005465,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 41.778209926908936,
"realTimeFactor": 0.023935922619698215,
"firstChunkMs": 62.30220798170194,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 622.5357079820242,
"totalMs": 835.5775829695631,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 214.1593330015894,
"inferenceMs": 202.2890000080224,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 41.52474924324542,
"realTimeFactor": 0.02408202381047886,
"firstChunkMs": 61.888958007330075,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 622.5357079820242,
"totalMs": 836.6950409836136,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 208.93104202696122,
"inferenceMs": 196.94591700681485,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 42.65130309713066,
"realTimeFactor": 0.023445942500811293,
"firstChunkMs": 62.21241701859981,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 622.5357079820242,
"totalMs": 831.4667500089854,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 208.59716698760167,
"inferenceMs": 196.68987501063384,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 42.70682463724105,
"realTimeFactor": 0.023415461310789743,
"firstChunkMs": 61.833082989323884,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 622.5357079820242,
"totalMs": 831.1328749696258,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 209.66624998254701,
"inferenceMs": 197.66333300503902,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 42.49650085474305,
"realTimeFactor": 0.02353134916726655,
"firstChunkMs": 62.85599997499958,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 622.5357079820242,
"totalMs": 832.2019579645712,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 223.13474997645244,
"inferenceMs": 210.5831670050975,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 39.889228182215845,
"realTimeFactor": 0.025069424643463987,
"firstChunkMs": 68.26662499224767,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 633.0684589920565,
"totalMs": 856.203208968509,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "q8",
"cpuThreads": 4,
"rssBytes": 374030336,
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 21.26337500521913,
"inferenceMs": 15.579458995489404,
"audioSeconds": 2,
"audioSecondsPerSecond": 128.37416245192108,
"realTimeFactor": 0.007789729497744702,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 633.0684589920565,
"totalMs": 654.3318339972757,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "q8",
"cpuThreads": 4,
"rssBytes": 375947264,
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 234.22983300406486,
"inferenceMs": 222.10425001685508,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 37.82007773089682,
"realTimeFactor": 0.0264409821448637,
"firstChunkMs": 65.08812500396743,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 633.0684589920565,
"totalMs": 867.2982919961214,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 208.49375001853332,
"inferenceMs": 196.75316600478254,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 42.693086828375705,
"realTimeFactor": 0.023422995952950304,
"firstChunkMs": 62.93733301572502,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 633.0684589920565,
"totalMs": 841.5622090105899,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 210.57829199708067,
"inferenceMs": 198.6737079860177,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 42.28038065606133,
"realTimeFactor": 0.023651631903097343,
"firstChunkMs": 62.73308300296776,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 633.0684589920565,
"totalMs": 843.6467509891372,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 210.2537500031758,
"inferenceMs": 198.66170900058933,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 42.2829343523622,
"realTimeFactor": 0.02365020345245111,
"firstChunkMs": 61.67666698456742,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 633.0684589920565,
"totalMs": 843.3222089952324,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 214.61870800703764,
"inferenceMs": 202.88720799726434,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 41.40231453189135,
"realTimeFactor": 0.024153239047293374,
"firstChunkMs": 62.48629098990932,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 633.0684589920565,
"totalMs": 847.6871669990942,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 218.07691699359566,
"inferenceMs": 205.81566699547693,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 40.81321953097284,
"realTimeFactor": 0.02450186511850916,
"firstChunkMs": 66.04149998747744,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 609.3802499817684,
"totalMs": 827.4571669753641,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "q8",
"cpuThreads": 4,
"rssBytes": 373293056,
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "WER",
"errorRate": 0,
"maximumErrorRate": 0,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 21.076542005175725,
"inferenceMs": 15.12220801669173,
"audioSeconds": 2,
"audioSecondsPerSecond": 132.25581858101816,
"realTimeFactor": 0.007561104008345865,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 609.3802499817684,
"totalMs": 630.4567919869442,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "q8",
"cpuThreads": 4,
"rssBytes": 373440512,
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 219.02304200921208,
"inferenceMs": 205.9895839774981,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 40.77876093442472,
"realTimeFactor": 0.024522569521130726,
"firstChunkMs": 65.22441701963544,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 609.3802499817684,
"totalMs": 828.4032919909805,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 217.75520898518153,
"inferenceMs": 205.55762498406693,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 40.86445346238602,
"realTimeFactor": 0.02447114583143654,
"firstChunkMs": 64.72500000381842,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 609.3802499817684,
"totalMs": 827.13545896695,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 214.55624999362044,
"inferenceMs": 202.43412497802638,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 41.49498016162935,
"realTimeFactor": 0.024099300592622188,
"firstChunkMs": 63.2570419984404,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 609.3802499817684,
"totalMs": 823.9364999753889,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 212.93716700165533,
"inferenceMs": 201.0554579901509,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 41.77951737282104,
"realTimeFactor": 0.023935173570256058,
"firstChunkMs": 63.24950000271201,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 609.3802499817684,
"totalMs": 822.3174169834238,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
},
{
"precision": "q8",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 212.37945900065824,
"inferenceMs": 200.08795900503173,
"audioSeconds": 8.4,
"audioSecondsPerSecond": 41.98153672899807,
"realTimeFactor": 0.023819995119646636,
"firstChunkMs": 63.54195898165926,
"chunkCount": 28,
"placement": {
"encoder": "CPUExecutionProvider",
"decoder": "CPUExecutionProvider"
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitCpuFallback": false,
"streaming": "Incremental UTF-8-safe decoder text from the complete supplied WAV; not live audio ingestion",
"loadMs": 609.3802499817684,
"totalMs": 821.7597089824267,
"grade": "fast",
"engine": "onnxruntime",
"version": "1.31.1",
"artifactRevision": "661e0b04de2fd5a1ac000e5c9e2ce429b1aece2c"
}
}
]Moonshine Base — Mandarin Speech Recognition Desktop
96 configurations testedQuality criteria
Mandarin CER <=0.20 on three independent Google FLEURS read clips, <=0.30 controlled noise, exact empty silence, EOS/no loops, warm RTF <=1; not broad Mandarin quality.
| Precision | Device | Result | Platform | Inference / load | Task metric | |
|---|---|---|---|---|---|---|
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 59 ms / 1922 ms | 0.030 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 63 ms / 1963 ms | 0.031 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 63 ms / 1857 ms | 0.032 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 65 ms / 1959 ms | 0.032 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 65 ms / 1919 ms | 0.033 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 65 ms / 1859 ms | 0.033 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 68 ms / 1994 ms | 0.034 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 69 ms / 1899 ms | 0.034 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 71 ms / 1867 ms | 0.035 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 354 ms / 1919 ms | 0.037 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 384 ms / 1963 ms | 0.040 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 504 ms / 1857 ms | 0.052 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 461 ms / 1919 ms | 0.061 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 468 ms / 1963 ms | 0.062 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 606 ms / 1857 ms | 0.080 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 608 ms / 1959 ms | 0.082 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 615 ms / 1963 ms | 0.083 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 616 ms / 1994 ms | 0.083 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 616 ms / 1919 ms | 0.083 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 616 ms / 1899 ms | 0.083 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 617 ms / 1899 ms | 0.083 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 618 ms / 1994 ms | 0.083 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 618 ms / 1919 ms | 0.083 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 618 ms / 1994 ms | 0.083 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 619 ms / 1994 ms | 0.083 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 619 ms / 1963 ms | 0.083 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 621 ms / 1959 ms | 0.083 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 623 ms / 1959 ms | 0.084 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 623 ms / 1919 ms | 0.084 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 623 ms / 1919 ms | 0.084 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 624 ms / 1899 ms | 0.084 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 627 ms / 1963 ms | 0.084 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 629 ms / 1919 ms | 0.085 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 630 ms / 1919 ms | 0.085 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 630 ms / 1959 ms | 0.085 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 633 ms / 1867 ms | 0.085 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 634 ms / 1857 ms | 0.085 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 635 ms / 1859 ms | 0.085 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 637 ms / 1994 ms | 0.086 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 638 ms / 1867 ms | 0.086 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 638 ms / 1857 ms | 0.086 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 639 ms / 1963 ms | 0.086 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 640 ms / 1857 ms | 0.086 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 640 ms / 1922 ms | 0.086 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 647 ms / 1899 ms | 0.087 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 647 ms / 1922 ms | 0.087 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 650 ms / 1963 ms | 0.087 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 650 ms / 1859 ms | 0.087 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 652 ms / 1857 ms | 0.088 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 653 ms / 1857 ms | 0.088 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 653 ms / 1859 ms | 0.088 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 655 ms / 1922 ms | 0.088 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 659 ms / 1959 ms | 0.089 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 665 ms / 1859 ms | 0.089 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 667 ms / 1867 ms | 0.090 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 676 ms / 1867 ms | 0.091 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 676 ms / 1859 ms | 0.091 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 677 ms / 1867 ms | 0.091 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 680 ms / 1857 ms | 0.091 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 688 ms / 1922 ms | 0.092 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 690 ms / 1963 ms | 0.093 RTF |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 693 ms / 1899 ms | 0.093 RTF |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 698 ms / 1922 ms | 0.094 RTF |
BF16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1262 ms / 1922 ms | 0.170 RTF |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1273 ms / 1899 ms | 0.171 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1286 ms / 1859 ms | 0.173 RTF |
BF16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1299 ms / 1994 ms | 0.175 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1315 ms / 1867 ms | 0.177 RTF |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1362 ms / 1959 ms | 0.183 RTF |
BF16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1532 ms / 1919 ms | 0.206 RTF |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1593 ms / 1963 ms | 0.214 RTF |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1634 ms / 1857 ms | 0.220 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 18 ms / 1802 ms | 0.009 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 18 ms / 1807 ms | 0.009 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 18 ms / 1868 ms | 0.009 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 165 ms / 1802 ms | 0.017 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 325 ms / 1802 ms | 0.043 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 478 ms / 1807 ms | 0.064 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 482 ms / 1807 ms | 0.065 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 482 ms / 1802 ms | 0.065 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 485 ms / 1868 ms | 0.065 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 485 ms / 1868 ms | 0.065 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 488 ms / 1807 ms | 0.066 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 488 ms / 1802 ms | 0.066 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 489 ms / 1807 ms | 0.066 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 496 ms / 1802 ms | 0.067 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 496 ms / 1807 ms | 0.067 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 497 ms / 1868 ms | 0.067 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 500 ms / 1868 ms | 0.067 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 500 ms / 1807 ms | 0.067 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 500 ms / 1802 ms | 0.067 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 500 ms / 1868 ms | 0.067 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 501 ms / 1802 ms | 0.067 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 505 ms / 1802 ms | 0.068 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 532 ms / 1868 ms | 0.072 RTF |
FP32 | cpu | Passed | Fast | macos · aarch64 | 792 ms / 1802 ms | 0.106 RTF |
Test setup & sample details
- Quality gate
- Mandarin CER <=0.20 on three independent Google FLEURS read clips, <=0.30 controlled noise, exact empty silence, EOS/no loops, warm RTF <=1; not broad Mandarin quality.
- Tested
- 2026-11-13T00:52:18.125959+00:00
- Environment
- { "os": "macos", "arch": "aarch64", "hardware": "Apple M3 Max", "osVersion": "27.2", "runtime": "Transformers5.22.1/Torch2.10.0", "interpreter": "App-ownedCPython3.13.18 pinned development venv" }
- Runtime
- transformers 5.22.1
- Artifact revision
- 438855be0ca8ccc32da89997f85f9cad4ed1b40b
- Fixture
{ "file": "model-samples/desktop/moonshine-streaming-family/cmn_hans_cn-clean-0.wav", "size": 238124, "sha1": "4128ee721c81ed07ea55512c7d8eedead80886f7", "sha256": "89bbbd987fc42bf2d3f6ead3a38cdc5f5132a2a528702c444f9639dd45ca97c4", "url": "https://assets.localai.tools/samples/v1/files/89bbbd987fc42bf2d3f6ead3a38cdc5f5132a2a528702c444f9639dd45ca97c4/cmn_hans_cn-clean-0.wav" }- Rerun when
- artifact revision change; runtime version change; fixture or frozen quality gate change; relevant backend behavior change
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0.08571428571428572,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 792.4022920196876,
"inferenceMs": 791.9555830012541,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 9.39446625504529,
"realTimeFactor": 0.10644564287651265,
"firstChunkMs": 334.65054200496525,
"chunkCount": 69,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1802.4603330122773,
"totalMs": 2594.862625031965,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 668549120,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 325.2719170122873,
"inferenceMs": 325.0333329779096,
"audioSeconds": 7.56,
"audioSecondsPerSecond": 23.25915293282798,
"realTimeFactor": 0.042993827113480106,
"firstChunkMs": 45.77395800151862,
"chunkCount": 50,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1802.4603330122773,
"totalMs": 2127.7322500245646,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 672497664,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0.06666666666666667,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 165.2684590080753,
"inferenceMs": 165.0502079864964,
"audioSeconds": 9.66,
"audioSecondsPerSecond": 58.527645119903966,
"realTimeFactor": 0.017085942855744968,
"firstChunkMs": 51.30137500236742,
"chunkCount": 16,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1802.4603330122773,
"totalMs": 1967.7287920203526,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 692551680,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0.08571428571428572,
"maximumErrorRate": 0.3,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 496.1740830040071,
"inferenceMs": 495.941250002943,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 15.001776924093026,
"realTimeFactor": 0.06665877016168588,
"firstChunkMs": 36.329208000097424,
"chunkCount": 69,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1802.4603330122773,
"totalMs": 2298.6344160162844,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 695074816,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0,
"maximumErrorRate": 0,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 17.758041998604313,
"inferenceMs": 17.54349999828264,
"audioSeconds": 2,
"audioSecondsPerSecond": 114.00233705906933,
"realTimeFactor": 0.00877174999914132,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1802.4603330122773,
"totalMs": 1820.2183750108816,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 695107584,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 500.55416600662284,
"inferenceMs": 500.3281249955762,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 14.870241404210054,
"realTimeFactor": 0.06724840389725487,
"firstChunkMs": 36.76333301700652,
"chunkCount": 69,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1802.4603330122773,
"totalMs": 2303.0144990189,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 488.4615000046324,
"inferenceMs": 488.2290839741472,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 15.23874804720557,
"realTimeFactor": 0.06562218870620258,
"firstChunkMs": 36.07787500368431,
"chunkCount": 69,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1802.4603330122773,
"totalMs": 2290.9218330169097,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 500.90570902102627,
"inferenceMs": 500.69645800977014,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 14.859302239870894,
"realTimeFactor": 0.06729791102281857,
"firstChunkMs": 34.89245902164839,
"chunkCount": 69,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1802.4603330122773,
"totalMs": 2303.3660420333035,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 482.25066700251773,
"inferenceMs": 482.03566699521616,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 15.434542523331238,
"realTimeFactor": 0.06478974018752906,
"firstChunkMs": 36.13300001597963,
"chunkCount": 69,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1802.4603330122773,
"totalMs": 2284.711000014795,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 505.150709010195,
"inferenceMs": 504.9496659776196,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 14.734141838861532,
"realTimeFactor": 0.06786957876043274,
"firstChunkMs": 37.1455000131391,
"chunkCount": 69,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1802.4603330122773,
"totalMs": 2307.6110420224722,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0.08571428571428572,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 532.7741669898387,
"inferenceMs": 532.2790000063833,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 13.977632031154295,
"realTimeFactor": 0.071542876344944,
"firstChunkMs": 51.93208300624974,
"chunkCount": 69,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1868.3132500154898,
"totalMs": 2401.0874170053285,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 668663808,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0,
"maximumErrorRate": 0,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 18.5442499932833,
"inferenceMs": 18.330958992009982,
"audioSeconds": 2,
"audioSecondsPerSecond": 109.1050392329038,
"realTimeFactor": 0.009165479496004991,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1868.3132500154898,
"totalMs": 1886.857500008773,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 669237248,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 500.7474579906557,
"inferenceMs": 500.48987500485964,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 14.865435589336867,
"realTimeFactor": 0.06727014448990049,
"firstChunkMs": 36.380917008500546,
"chunkCount": 69,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1868.3132500154898,
"totalMs": 2369.0607080061454,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 485.31474999617785,
"inferenceMs": 485.1087910064962,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 15.336765974831344,
"realTimeFactor": 0.06520279449012045,
"firstChunkMs": 36.865125002805144,
"chunkCount": 69,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1868.3132500154898,
"totalMs": 2353.6280000116676,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 497.30166600784287,
"inferenceMs": 497.0900419866666,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 14.967107307692883,
"realTimeFactor": 0.06681317768637993,
"firstChunkMs": 37.20583298127167,
"chunkCount": 69,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1868.3132500154898,
"totalMs": 2365.6149160233326,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 485.2708750113379,
"inferenceMs": 485.06158401141874,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 15.33825857424499,
"realTimeFactor": 0.06519644946390037,
"firstChunkMs": 37.568416009889916,
"chunkCount": 69,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1868.3132500154898,
"totalMs": 2353.5841250268277,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 499.9074999941513,
"inferenceMs": 499.68258300214075,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 14.889452330517043,
"realTimeFactor": 0.06716163750028774,
"firstChunkMs": 36.00066699436866,
"chunkCount": 69,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1868.3132500154898,
"totalMs": 2368.220750009641,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0.08571428571428572,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 500.3781659761444,
"inferenceMs": 499.9287080136128,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 14.882121952071241,
"realTimeFactor": 0.06719471881903398,
"firstChunkMs": 48.72174997581169,
"chunkCount": 69,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1806.9622500042897,
"totalMs": 2307.340415980434,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 668008448,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0,
"maximumErrorRate": 0,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 17.84670798224397,
"inferenceMs": 17.64295800239779,
"audioSeconds": 2,
"audioSecondsPerSecond": 113.35967583940217,
"realTimeFactor": 0.008821479001198895,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1806.9622500042897,
"totalMs": 1824.8089579865336,
"grade": "fast",
"actualDevice": "cpu",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 668123136,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 482.1556670067366,
"inferenceMs": 481.9297919748351,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 15.437933333634819,
"realTimeFactor": 0.06477550967403697,
"firstChunkMs": 35.97754199290648,
"chunkCount": 69,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1806.9622500042897,
"totalMs": 2289.1179170110263,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 489.3932919949293,
"inferenceMs": 489.17516600340605,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 15.209275770855868,
"realTimeFactor": 0.065749350269275,
"firstChunkMs": 35.8150829852093,
"chunkCount": 69,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1806.9622500042897,
"totalMs": 2296.355541999219,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 496.47800001548603,
"inferenceMs": 496.2295409932267,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 14.993061447144989,
"realTimeFactor": 0.06669751895070251,
"firstChunkMs": 36.45433302153833,
"chunkCount": 69,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1806.9622500042897,
"totalMs": 2303.4402500197757,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 478.0478329921607,
"inferenceMs": 477.8297909942921,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 15.570397953879093,
"realTimeFactor": 0.06422443427342636,
"firstChunkMs": 36.1024999874644,
"chunkCount": 69,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1806.9622500042897,
"totalMs": 2285.0100829964504,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 488.4470420074649,
"inferenceMs": 488.21674997452646,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 15.239133029311663,
"realTimeFactor": 0.06562053091055463,
"firstChunkMs": 35.69504202459939,
"chunkCount": 69,
"placement": {
"cpu/torch.float32": 210
},
"activationPlacement": {
"encoder": "cpu",
"logits": "cpu"
},
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": null,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1806.9622500042897,
"totalMs": 2295.4092920117546,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0.08571428571428572,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 1635.9869579900987,
"inferenceMs": 1634.309083019616,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 4.552382457701057,
"realTimeFactor": 0.21966519933059356,
"firstChunkMs": 463.93462500418536,
"chunkCount": 69,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1274642432,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1857.3121250083204,
"totalMs": 3493.299082998419,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 675086336,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 607.6802500174381,
"inferenceMs": 606.0242080129683,
"audioSeconds": 7.56,
"audioSecondsPerSecond": 12.474749193250418,
"realTimeFactor": 0.08016193227684766,
"firstChunkMs": 219.8224160238169,
"chunkCount": 50,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1281769472,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1857.3121250083204,
"totalMs": 2464.9923750257585,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 690356224,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0.06666666666666667,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 505.4510830086656,
"inferenceMs": 504.3968340032734,
"audioSeconds": 9.66,
"audioSecondsPerSecond": 19.151587299489886,
"realTimeFactor": 0.05221499316804072,
"firstChunkMs": 346.65437499643303,
"chunkCount": 16,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1309687808,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1857.3121250083204,
"totalMs": 2362.763208016986,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 705740800,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0.08571428571428572,
"maximumErrorRate": 0.3,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 641.7787919926923,
"inferenceMs": 640.1542919920757,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.622198106096738,
"realTimeFactor": 0.08604224354732201,
"firstChunkMs": 34.69604201382026,
"chunkCount": 69,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1309687808,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1857.3121250083204,
"totalMs": 2499.0909170010127,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 706543616,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0,
"maximumErrorRate": 0,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 64.2633750103414,
"inferenceMs": 63.2681249990128,
"audioSeconds": 2,
"audioSecondsPerSecond": 31.61149473026436,
"realTimeFactor": 0.0316340624995064,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1311457280,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1857.3121250083204,
"totalMs": 1921.5755000186618,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 720404480,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 682.1881669748109,
"inferenceMs": 680.2302919968497,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 10.93747233478755,
"realTimeFactor": 0.09142880268774861,
"firstChunkMs": 39.87629199400544,
"chunkCount": 69,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1311457280,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1857.3121250083204,
"totalMs": 2539.5002919831313,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 640.0353330245707,
"inferenceMs": 638.4824590058997,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.652630225086972,
"realTimeFactor": 0.08581753481262093,
"firstChunkMs": 41.147375013679266,
"chunkCount": 69,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1311457280,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1857.3121250083204,
"totalMs": 2497.347458032891,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 653.2571669958998,
"inferenceMs": 651.880749996053,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.413130392399296,
"realTimeFactor": 0.08761838037581358,
"firstChunkMs": 34.98287498950958,
"chunkCount": 69,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1311457280,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1857.3121250083204,
"totalMs": 2510.56929200422,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 635.5329170182813,
"inferenceMs": 633.9898750011344,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.735203184414717,
"realTimeFactor": 0.08521369287649655,
"firstChunkMs": 36.533125006826594,
"chunkCount": 69,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1311457280,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1857.3121250083204,
"totalMs": 2492.8450420266017,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 654.2144999839365,
"inferenceMs": 652.7482920209877,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.397961650676802,
"realTimeFactor": 0.0877349854866919,
"firstChunkMs": 34.13108398672193,
"chunkCount": 69,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1311457280,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1857.3121250083204,
"totalMs": 2511.526624992257,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0.08571428571428572,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 1316.1509159835987,
"inferenceMs": 1314.7572499874514,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 5.658839302898699,
"realTimeFactor": 0.1767146841380983,
"firstChunkMs": 170.7142079831101,
"chunkCount": 69,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1274642432,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1867.0895420073066,
"totalMs": 3183.2404579909053,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 672481280,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0,
"maximumErrorRate": 0,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 72.37562499358319,
"inferenceMs": 70.93970800633542,
"audioSeconds": 2,
"audioSecondsPerSecond": 28.19295506293014,
"realTimeFactor": 0.03546985400316771,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1275494400,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1867.0895420073066,
"totalMs": 1939.4651670008898,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 686866432,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 678.5197909921408,
"inferenceMs": 677.3631670221221,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 10.98376817964331,
"realTimeFactor": 0.09104343642770459,
"firstChunkMs": 46.32291599409655,
"chunkCount": 69,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1275494400,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1867.0895420073066,
"totalMs": 2545.6093329994474,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 676.8669169978239,
"inferenceMs": 675.7897499774117,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.009341293277506,
"realTimeFactor": 0.09083195564212523,
"firstChunkMs": 38.85650000302121,
"chunkCount": 69,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1275494400,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1867.0895420073066,
"totalMs": 2543.9564590051305,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 634.7340420179535,
"inferenceMs": 633.2601670001168,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.748725701862483,
"realTimeFactor": 0.08511561384410171,
"firstChunkMs": 36.24983300687745,
"chunkCount": 69,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1275494400,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1867.0895420073066,
"totalMs": 2501.82358402526,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 668.3532500173897,
"inferenceMs": 667.0127919933293,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.154208868717479,
"realTimeFactor": 0.0896522569883507,
"firstChunkMs": 35.577167000155896,
"chunkCount": 69,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1275494400,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1867.0895420073066,
"totalMs": 2535.4427920246962,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 638.9905829855707,
"inferenceMs": 637.9504590004217,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.662347593036346,
"realTimeFactor": 0.08574602943554055,
"firstChunkMs": 36.951791000319645,
"chunkCount": 69,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1275494400,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1867.0895420073066,
"totalMs": 2506.0801249928772,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0.08571428571428572,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 1287.4344580050092,
"inferenceMs": 1286.2701250123791,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 5.784166059153708,
"realTimeFactor": 0.17288576949091117,
"firstChunkMs": 157.33295801328495,
"chunkCount": 69,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1274642432,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1859.1165420075413,
"totalMs": 3146.5510000125505,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 670547968,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0,
"maximumErrorRate": 0,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 66.7213749838993,
"inferenceMs": 65.40495800436474,
"audioSeconds": 2,
"audioSecondsPerSecond": 30.578721568272112,
"realTimeFactor": 0.03270247900218237,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1275494400,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1859.1165420075413,
"totalMs": 1925.8379169914406,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp32",
"cpuThreads": 4,
"rssBytes": 685129728,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 651.4430410170462,
"inferenceMs": 650.0531669880729,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.445217680381685,
"realTimeFactor": 0.0873727374983969,
"firstChunkMs": 41.652957996120676,
"chunkCount": 69,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1275494400,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1859.1165420075413,
"totalMs": 2510.5595830245875,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 677.7122909843456,
"inferenceMs": 675.821792014176,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.008819318812288,
"realTimeFactor": 0.09083626236749678,
"firstChunkMs": 38.76216599019244,
"chunkCount": 69,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1275494400,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1859.1165420075413,
"totalMs": 2536.828832991887,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 636.2853329919744,
"inferenceMs": 635.1216670009308,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.714290956458736,
"realTimeFactor": 0.08536581545711434,
"firstChunkMs": 37.48108298168518,
"chunkCount": 69,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1275494400,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1859.1165420075413,
"totalMs": 2495.4018749995157,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 654.8187920125201,
"inferenceMs": 653.3792499976698,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.38695481992508,
"realTimeFactor": 0.08781979166635347,
"firstChunkMs": 36.38645799946971,
"chunkCount": 69,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1275494400,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1859.1165420075413,
"totalMs": 2513.9353340200614,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 667.6545419904869,
"inferenceMs": 665.2057080063969,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.18451016046972,
"realTimeFactor": 0.0894093693556985,
"firstChunkMs": 39.493958989623934,
"chunkCount": 69,
"placement": {
"mps:0/torch.float32": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1275494400,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1859.1165420075413,
"totalMs": 2526.771083998028,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0.08571428571428572,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 1594.4152499723714,
"inferenceMs": 1592.7153750089929,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 4.67126777121618,
"realTimeFactor": 0.21407464717862806,
"firstChunkMs": 426.2779999990016,
"chunkCount": 69,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1194950656,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1963.2111669925507,
"totalMs": 3557.626416964922,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp16",
"cpuThreads": 4,
"rssBytes": 762626048,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 469.1172919992823,
"inferenceMs": 467.66858402406797,
"audioSeconds": 7.56,
"audioSecondsPerSecond": 16.165293667899945,
"realTimeFactor": 0.06186092381270741,
"firstChunkMs": 91.1362079787068,
"chunkCount": 50,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1202077696,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1963.2111669925507,
"totalMs": 2432.328458991833,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp16",
"cpuThreads": 4,
"rssBytes": 779878400,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0.06666666666666667,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 385.37929102312773,
"inferenceMs": 383.7704580218997,
"audioSeconds": 9.66,
"audioSecondsPerSecond": 25.171296534369397,
"realTimeFactor": 0.03972779068549686,
"firstChunkMs": 203.52387501043268,
"chunkCount": 16,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1221607424,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1963.2111669925507,
"totalMs": 2348.5904580156785,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp16",
"cpuThreads": 4,
"rssBytes": 796065792,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0.08571428571428572,
"maximumErrorRate": 0.3,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 620.6530409981497,
"inferenceMs": 619.3394589936361,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 12.012798299803547,
"realTimeFactor": 0.08324455094000485,
"firstChunkMs": 32.34049997990951,
"chunkCount": 69,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1221607424,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1963.2111669925507,
"totalMs": 2583.8642079907004,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp16",
"cpuThreads": 4,
"rssBytes": 796950528,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0,
"maximumErrorRate": 0,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 64.26920901867561,
"inferenceMs": 62.91562499245629,
"audioSeconds": 2,
"audioSecondsPerSecond": 31.788605775430256,
"realTimeFactor": 0.031457812496228144,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1223376896,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1963.2111669925507,
"totalMs": 2027.4803760112263,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp16",
"cpuThreads": 4,
"rssBytes": 811024384,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 651.0692499869037,
"inferenceMs": 649.9482920044102,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.44706446886011,
"realTimeFactor": 0.08735864139844222,
"firstChunkMs": 35.27854199637659,
"chunkCount": 69,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1223376896,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1963.2111669925507,
"totalMs": 2614.2804169794545,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 616.8102090014145,
"inferenceMs": 615.1399590016808,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 12.094808492159215,
"realTimeFactor": 0.08268010201635495,
"firstChunkMs": 38.78820899990387,
"chunkCount": 69,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1223376896,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1963.2111669925507,
"totalMs": 2580.021375993965,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 628.6654580035247,
"inferenceMs": 627.2297499817796,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.861682262705372,
"realTimeFactor": 0.0843050739222822,
"firstChunkMs": 34.320542006753385,
"chunkCount": 69,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1223376896,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1963.2111669925507,
"totalMs": 2591.8766249960754,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 691.9874580053147,
"inferenceMs": 690.2382919797674,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 10.77888619980835,
"realTimeFactor": 0.09277396397577518,
"firstChunkMs": 39.35820801416412,
"chunkCount": 69,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1223376896,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1963.2111669925507,
"totalMs": 2655.1986249978654,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 640.8292499836534,
"inferenceMs": 638.9600410184357,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.643920624741128,
"realTimeFactor": 0.08588172594333814,
"firstChunkMs": 36.812499980442226,
"chunkCount": 69,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1223376896,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1963.2111669925507,
"totalMs": 2604.040416976204,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0.08571428571428572,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 1364.658500009682,
"inferenceMs": 1362.4806669831742,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 5.460627941586697,
"realTimeFactor": 0.18312912190634062,
"firstChunkMs": 197.15333302156068,
"chunkCount": 69,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1194950656,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1959.1342500061728,
"totalMs": 3323.792750015855,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp16",
"cpuThreads": 4,
"rssBytes": 784154624,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0,
"maximumErrorRate": 0,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 66.60904199816287,
"inferenceMs": 64.5622499869205,
"audioSeconds": 2,
"audioSecondsPerSecond": 30.977854712392684,
"realTimeFactor": 0.03228112499346025,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1195802624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1959.1342500061728,
"totalMs": 2025.7432920043357,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp16",
"cpuThreads": 4,
"rssBytes": 799080448,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 622.7425840042997,
"inferenceMs": 621.1962910019793,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.976890570288829,
"realTimeFactor": 0.08349412513467463,
"firstChunkMs": 36.17995901731774,
"chunkCount": 69,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1195802624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1959.1342500061728,
"totalMs": 2581.8768340104725,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 660.923332994571,
"inferenceMs": 659.3525000207592,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.28379736145045,
"realTimeFactor": 0.08862264785225257,
"firstChunkMs": 34.1675829840824,
"chunkCount": 69,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1195802624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1959.1342500061728,
"totalMs": 2620.0575830007438,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 609.1323329892475,
"inferenceMs": 608.1653330184054,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 12.233515453888652,
"realTimeFactor": 0.08174265228742007,
"firstChunkMs": 30.94358299858868,
"chunkCount": 69,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1195802624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1959.1342500061728,
"totalMs": 2568.2665829954203,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 624.0923750156071,
"inferenceMs": 622.6542909862474,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.948845623813952,
"realTimeFactor": 0.08369009287449561,
"firstChunkMs": 29.835708992322907,
"chunkCount": 69,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1195802624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1959.1342500061728,
"totalMs": 2583.22662502178,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 631.3593329978175,
"inferenceMs": 630.35600000876,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.802854259968347,
"realTimeFactor": 0.08472526881838173,
"firstChunkMs": 42.955415992764756,
"chunkCount": 69,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1195802624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1959.1342500061728,
"totalMs": 2590.4935830039904,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0.08571428571428572,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 1274.7179589932784,
"inferenceMs": 1273.089541005902,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 5.844050838813316,
"realTimeFactor": 0.17111418561907285,
"firstChunkMs": 171.57566698733717,
"chunkCount": 69,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1194950656,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1899.092165986076,
"totalMs": 3173.8101249793544,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp16",
"cpuThreads": 4,
"rssBytes": 760020992,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0,
"maximumErrorRate": 0,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 69.57058300031349,
"inferenceMs": 68.53320798836648,
"audioSeconds": 2,
"audioSecondsPerSecond": 29.182932751951434,
"realTimeFactor": 0.03426660399418324,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1195802624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1899.092165986076,
"totalMs": 1968.6627489863895,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "fp16",
"cpuThreads": 4,
"rssBytes": 774619136,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 618.2227919925936,
"inferenceMs": 616.7397920216899,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 12.06343436283149,
"realTimeFactor": 0.08289513333624865,
"firstChunkMs": 36.53650000342168,
"chunkCount": 69,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1195802624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1899.092165986076,
"totalMs": 2517.3149579786696,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 625.6796660018153,
"inferenceMs": 623.9317919826135,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.92438034990742,
"realTimeFactor": 0.0838617999976631,
"firstChunkMs": 30.994458007626235,
"chunkCount": 69,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1195802624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1899.092165986076,
"totalMs": 2524.7718319878913,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 647.6394579804037,
"inferenceMs": 646.610875002807,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.506147340883654,
"realTimeFactor": 0.0869100638444633,
"firstChunkMs": 33.297707996098325,
"chunkCount": 69,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1195802624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1899.092165986076,
"totalMs": 2546.7316239664797,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 693.9269579888787,
"inferenceMs": 692.808083986165,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 10.738904715419823,
"realTimeFactor": 0.09311936612717271,
"firstChunkMs": 33.41000000364147,
"chunkCount": 69,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1195802624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1899.092165986076,
"totalMs": 2593.0191239749547,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 617.9765419801697,
"inferenceMs": 616.4422080037184,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 12.06925791810012,
"realTimeFactor": 0.08285513548437075,
"firstChunkMs": 35.63420899445191,
"chunkCount": 69,
"placement": {
"mps:0/torch.float16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1195802624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1899.092165986076,
"totalMs": 2517.0687079662457,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0.08571428571428572,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 1533.907208009623,
"inferenceMs": 1532.1605000062846,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 4.85588813963647,
"realTimeFactor": 0.20593555107611353,
"firstChunkMs": 433.8444159948267,
"chunkCount": 69,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1194950656,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1918.6880000052042,
"totalMs": 3452.595208014827,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "bf16",
"cpuThreads": 4,
"rssBytes": 784793600,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 462.2084579896182,
"inferenceMs": 461.1729999887757,
"audioSeconds": 7.56,
"audioSecondsPerSecond": 16.392980508798214,
"realTimeFactor": 0.06100171957523488,
"firstChunkMs": 88.42025001649745,
"chunkCount": 50,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1202077696,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1918.6880000052042,
"totalMs": 2380.8964579948224,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "bf16",
"cpuThreads": 4,
"rssBytes": 801734656,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0.06666666666666667,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 355.1482080074493,
"inferenceMs": 353.62583299865946,
"audioSeconds": 9.66,
"audioSecondsPerSecond": 27.317008822815893,
"realTimeFactor": 0.036607229088888145,
"firstChunkMs": 204.72716700169258,
"chunkCount": 16,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1221607424,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1918.6880000052042,
"totalMs": 2273.8362080126535,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "bf16",
"cpuThreads": 4,
"rssBytes": 818216960,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0.08571428571428572,
"maximumErrorRate": 0.3,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 631.1552080151159,
"inferenceMs": 630.133124999702,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.807028871880872,
"realTimeFactor": 0.08469531249995994,
"firstChunkMs": 34.849166026106104,
"chunkCount": 69,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1221607424,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1918.6880000052042,
"totalMs": 2549.84320802032,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "bf16",
"cpuThreads": 4,
"rssBytes": 819036160,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0,
"maximumErrorRate": 0,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 67.09908400080167,
"inferenceMs": 65.16858300892636,
"audioSeconds": 2,
"audioSecondsPerSecond": 30.689634600863627,
"realTimeFactor": 0.03258429150446318,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1223376896,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1918.6880000052042,
"totalMs": 1985.787084006006,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "bf16",
"cpuThreads": 4,
"rssBytes": 833110016,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 617.4187079886906,
"inferenceMs": 616.3689579989295,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 12.070692242766906,
"realTimeFactor": 0.08284529005361957,
"firstChunkMs": 38.533874991117045,
"chunkCount": 69,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1223376896,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1918.6880000052042,
"totalMs": 2536.106707993895,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 630.1444999990053,
"inferenceMs": 628.7825409963261,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.832389601993532,
"realTimeFactor": 0.08451378239197932,
"firstChunkMs": 33.044417010387406,
"chunkCount": 69,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1223376896,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1918.6880000052042,
"totalMs": 2548.8325000042096,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 624.7813750233036,
"inferenceMs": 622.9403750039637,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.943358142346545,
"realTimeFactor": 0.08372854502741447,
"firstChunkMs": 39.35450001154095,
"chunkCount": 69,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1223376896,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1918.6880000052042,
"totalMs": 2543.469375028508,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 624.7998749895487,
"inferenceMs": 622.7682090247981,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.946659916456566,
"realTimeFactor": 0.08370540443881695,
"firstChunkMs": 36.102458980167285,
"chunkCount": 69,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1223376896,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1918.6880000052042,
"totalMs": 2543.487874994753,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 619.499916996574,
"inferenceMs": 617.8061249956954,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 12.042612882887553,
"realTimeFactor": 0.08303845766071175,
"firstChunkMs": 38.03287498885766,
"chunkCount": 69,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1223376896,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1918.6880000052042,
"totalMs": 2538.1879170017783,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0.08571428571428572,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 1301.104749989463,
"inferenceMs": 1299.3823339929804,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 5.725797408016933,
"realTimeFactor": 0.17464816317109952,
"firstChunkMs": 164.44179098471068,
"chunkCount": 69,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1194950656,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1994.029291003244,
"totalMs": 3295.134040992707,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "bf16",
"cpuThreads": 4,
"rssBytes": 787480576,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0,
"maximumErrorRate": 0,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 69.5074170071166,
"inferenceMs": 68.14654200570658,
"audioSeconds": 2,
"audioSecondsPerSecond": 29.34851778440233,
"realTimeFactor": 0.03407327100285329,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1195802624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1994.029291003244,
"totalMs": 2063.5367080103606,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "bf16",
"cpuThreads": 4,
"rssBytes": 802095104,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 620.2170000178739,
"inferenceMs": 618.7578329991084,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 12.024090206565065,
"realTimeFactor": 0.08316637540310597,
"firstChunkMs": 38.77725001075305,
"chunkCount": 69,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1195802624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1994.029291003244,
"totalMs": 2614.246291021118,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 638.6054579925258,
"inferenceMs": 637.2613749990705,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.674958332459505,
"realTimeFactor": 0.08565341061815464,
"firstChunkMs": 35.95799999311566,
"chunkCount": 69,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1195802624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1994.029291003244,
"totalMs": 2632.6347489957698,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 618.6861660098657,
"inferenceMs": 617.6562500186265,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 12.04553503631775,
"realTimeFactor": 0.08301831317454657,
"firstChunkMs": 34.09445800934918,
"chunkCount": 69,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1195802624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1994.029291003244,
"totalMs": 2612.7154570131097,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 617.6672499859706,
"inferenceMs": 615.9791250247508,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 12.07833138777398,
"realTimeFactor": 0.08279289314848802,
"firstChunkMs": 30.250207986682653,
"chunkCount": 69,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1195802624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1994.029291003244,
"totalMs": 2611.6965409892146,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 619.104540994158,
"inferenceMs": 617.9929170175456,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 12.038972931770301,
"realTimeFactor": 0.0830635641152615,
"firstChunkMs": 35.988040996016935,
"chunkCount": 69,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1195802624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1994.029291003244,
"totalMs": 2613.133831997402,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0.08571428571428572,
"maximumErrorRate": 0.2,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 1263.995666988194,
"inferenceMs": 1262.1014160104096,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 5.8949303959410475,
"realTimeFactor": 0.16963728709817333,
"firstChunkMs": 169.99308299273252,
"chunkCount": 69,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1194950656,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1921.7479170183651,
"totalMs": 3185.743584006559,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "bf16",
"cpuThreads": 4,
"rssBytes": 784891904,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"metric": "CER",
"errorRate": 0,
"maximumErrorRate": 0,
"loop": false,
"eos": true,
"passed": true
},
"runtime": {
"durationMs": 60.821082995971665,
"inferenceMs": 59.45262499153614,
"audioSeconds": 2,
"audioSecondsPerSecond": 33.64023035626646,
"realTimeFactor": 0.02972631249576807,
"firstChunkMs": null,
"chunkCount": 0,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1195802624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1921.7479170183651,
"totalMs": 1982.5690000143368,
"grade": "fast",
"actualDevice": "mps",
"actualPrecision": "bf16",
"cpuThreads": 4,
"rssBytes": 799866880,
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 689.3855000089388,
"inferenceMs": 687.6803750055842,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 10.81897967488106,
"realTimeFactor": 0.0924301579308581,
"firstChunkMs": 56.09337502392009,
"chunkCount": 69,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1195802624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1921.7479170183651,
"totalMs": 2611.133417027304,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 699.4820000254549,
"inferenceMs": 697.9427079786547,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 10.659900755389137,
"realTimeFactor": 0.09380950376057186,
"firstChunkMs": 31.372625002404675,
"chunkCount": 69,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1195802624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1921.7479170183651,
"totalMs": 2621.22991704382,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 641.2821249978151,
"inferenceMs": 640.1919999916572,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.621513546087668,
"realTimeFactor": 0.08604731182683564,
"firstChunkMs": 30.909124994650483,
"chunkCount": 69,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1195802624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1921.7479170183651,
"totalMs": 2563.0300420161802,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 656.4791669952683,
"inferenceMs": 655.020083009731,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.358430364171706,
"realTimeFactor": 0.08804033373786707,
"firstChunkMs": 30.96999999252148,
"chunkCount": 69,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1195802624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1921.7479170183651,
"totalMs": 2578.2270840136334,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"generateStreamParity": true
},
"runtime": {
"durationMs": 647.7862499887124,
"inferenceMs": 646.8434999987949,
"audioSeconds": 7.44,
"audioSecondsPerSecond": 11.502009373231488,
"realTimeFactor": 0.08694133064499932,
"firstChunkMs": 30.969707993790507,
"chunkCount": 69,
"placement": {
"mps:0/torch.bfloat16": 210
},
"activationPlacement": {
"encoder": "mps:0",
"logits": "mps:0"
},
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"streaming": "Incremental decoder text from complete WAV input, not live audio ingestion",
"driverAllocatedMemoryBytes": 1195802624,
"memoryMeasurementScope": "Post-generation Metal driver allocation, not peak VRAM",
"loadMs": 1921.7479170183651,
"totalMs": 2569.5341670070775,
"grade": "fast",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"artifactRevision": "438855be0ca8ccc32da89997f85f9cad4ed1b40b"
}
}
]Release validation still required
- Sample publication, full dependency backup and both model/runtime-source outage gates pending under upload exclusion.