Canary 2
Transcribe WAV audio in 25 selectable languages locally using NVIDIA Canary 1B v2.
Desktop app
Run Canary 2 on your computer
Download the desktop app to load this model, provide input and view results locally.
Public desktop downloads are coming soon.Device requirements
If your device falls short
MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.
GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.
PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.
Benchmark evidence
Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.
NVIDIA Canary Desktop
21 configurations testedQuality criteria
WER at most 0.2 and ordered streamed transcript equals final text; digital silence must return empty.
| Precision | Device | Result | Platform | Inference / load | Task metric | |
|---|---|---|---|---|---|---|
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 357 ms / 3409 ms | 0.031 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 380 ms / 3516 ms | 0.033 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 405 ms / 3894 ms | 0.035 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 501 ms / 3894 ms | 0.046 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 502 ms / 3516 ms | 0.046 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 503 ms / 3409 ms | 0.046 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 230 ms / 3409 ms | 0.068 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 239 ms / 3516 ms | 0.070 RTF |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 269 ms / 3894 ms | 0.079 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 685 ms / 2441 ms | 0.060 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 927 ms / 2441 ms | 0.084 RTF |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 1059 ms / 2580 ms | 0.092 RTF |
FP32 | cpu | Passed | Fast | macos · aarch64 | 383 ms / 2441 ms | 0.113 RTF |
FP32 | cpu | Passed | Fast | macos · aarch64 | 1509 ms / 2516 ms | 0.131 RTF |
FP32 | cpu | Passed | Fast | macos · aarch64 | 1564 ms / 2584 ms | 0.136 RTF |
FP32 | cpu | Passed | Fast | macos · aarch64 | 1704 ms / 2580 ms | 0.155 RTF |
FP32 | cpu | Passed | Fast | macos · aarch64 | 1826 ms / 2516 ms | 0.166 RTF |
FP32 | cpu | Passed | Fast | macos · aarch64 | 1915 ms / 2584 ms | 0.174 RTF |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 922 ms / 2580 ms | 0.271 RTF |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 1103 ms / 2516 ms | 0.324 RTF |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 1145 ms / 2584 ms | 0.337 RTF |
Test setup & sample details
- Quality gate
- WER at most 0.2 and ordered streamed transcript equals final text; digital silence must return empty.
- Tested
- 2026-11-03T15:24:34.355379+00:00
- Environment
- { "platform": "macOS-27.2-arm64-arm-64bit-Mach-O" }
- Runtime
- transformers 5.22.1
- Artifact revision
- d455706339a6b32e1aa40f82c713a482a0c938e2
- Fixture
{ "file": "model-samples/desktop/granite-speech5/granite-speech5-jfk.wav", "size": 3880888, "sha1": "6fb9dfd0ec18bb61a6af995c0df0cd32ee2afe34", "sha256": "c72e27f68334ae37e037ef819fa5aa1fc1552aa840b93e308df4ffe52317bedb", "url": "https://assets.localai.tools/samples/v1/files/c72e27f68334ae37e037ef819fa5aa1fc1552aa840b93e308df4ffe52317bedb/granite-speech5-jfk.wav" }- Rerun when
- Runtime or checkpoint revision; Fixture or quality gate change
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"wordErrorRate": 0,
"streamParity": true
},
"runtime": {
"placement": {
"mps:0": 1410
},
"version": "5.22.1",
"torchVersion": "2.12.0",
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Audio preprocessing and text decoding on CPU",
"loadMs": 3516.2616659945343,
"inferenceMs": 501.5735409979243,
"realTimeFactor": 0.04559759463617494,
"predictionPlacement": "mps:0",
"engine": "transformers",
"artifactRevision": "d455706339a6b32e1aa40f82c713a482a0c938e2",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 4282.5092489947565,
"grade": "fast",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"wordErrorRate": 0,
"streamParity": true
},
"runtime": {
"placement": {
"mps:0": 1410
},
"version": "5.22.1",
"torchVersion": "2.12.0",
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Audio preprocessing and text decoding on CPU",
"loadMs": 3516.2616659945343,
"inferenceMs": 238.63020798307844,
"realTimeFactor": 0.07018535528914072,
"predictionPlacement": "mps:0",
"engine": "transformers",
"artifactRevision": "d455706339a6b32e1aa40f82c713a482a0c938e2",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 3781.300790986279,
"grade": "fast",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"wordErrorRate": 0,
"streamParity": true
},
"runtime": {
"placement": {
"mps:0": 1410
},
"version": "5.22.1",
"torchVersion": "2.12.0",
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Audio preprocessing and text decoding on CPU",
"loadMs": 3516.2616659945343,
"inferenceMs": 380.2755420038011,
"realTimeFactor": 0.03306743843511314,
"predictionPlacement": "mps:0",
"engine": "transformers",
"artifactRevision": "d455706339a6b32e1aa40f82c713a482a0c938e2",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 3948.935832013376,
"grade": "fast",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"wordErrorRate": 0,
"streamParity": true
},
"runtime": {
"placement": {
"mps:0": 1410
},
"version": "5.22.1",
"torchVersion": "2.12.0",
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Audio preprocessing and text decoding on CPU",
"loadMs": 3408.9508750184905,
"inferenceMs": 502.70704200374894,
"realTimeFactor": 0.045700640182159,
"predictionPlacement": "mps:0",
"engine": "transformers",
"artifactRevision": "d455706339a6b32e1aa40f82c713a482a0c938e2",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 4165.0859160290565,
"grade": "fast",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"wordErrorRate": 0,
"streamParity": true
},
"runtime": {
"placement": {
"mps:0": 1410
},
"version": "5.22.1",
"torchVersion": "2.12.0",
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Audio preprocessing and text decoding on CPU",
"loadMs": 3408.9508750184905,
"inferenceMs": 229.68325001420453,
"realTimeFactor": 0.06755389706300133,
"predictionPlacement": "mps:0",
"engine": "transformers",
"artifactRevision": "d455706339a6b32e1aa40f82c713a482a0c938e2",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 3665.106000000378,
"grade": "fast",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"wordErrorRate": 0,
"streamParity": true
},
"runtime": {
"placement": {
"mps:0": 1410
},
"version": "5.22.1",
"torchVersion": "2.12.0",
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Audio preprocessing and text decoding on CPU",
"loadMs": 3408.9508750184905,
"inferenceMs": 356.9698750216048,
"realTimeFactor": 0.031040858697530854,
"predictionPlacement": "mps:0",
"engine": "transformers",
"artifactRevision": "d455706339a6b32e1aa40f82c713a482a0c938e2",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 3813.3681250037625,
"grade": "fast",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"wordErrorRate": 0,
"streamParity": true
},
"runtime": {
"placement": {
"mps:0": 1410
},
"version": "5.22.1",
"torchVersion": "2.12.0",
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Audio preprocessing and text decoding on CPU",
"loadMs": 3893.5816249868367,
"inferenceMs": 501.2175829906482,
"realTimeFactor": 0.04556523481733166,
"predictionPlacement": "mps:0",
"engine": "transformers",
"artifactRevision": "d455706339a6b32e1aa40f82c713a482a0c938e2",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 4670.492791978177,
"grade": "fast",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"wordErrorRate": 0,
"streamParity": true
},
"runtime": {
"placement": {
"mps:0": 1410
},
"version": "5.22.1",
"torchVersion": "2.12.0",
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Audio preprocessing and text decoding on CPU",
"loadMs": 3893.5816249868367,
"inferenceMs": 268.727625021711,
"realTimeFactor": 0.07903753677109147,
"predictionPlacement": "mps:0",
"engine": "transformers",
"artifactRevision": "d455706339a6b32e1aa40f82c713a482a0c938e2",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 4193.418584007304,
"grade": "fast",
"fallback": false
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"wordErrorRate": 0,
"streamParity": true
},
"runtime": {
"placement": {
"mps:0": 1410
},
"version": "5.22.1",
"torchVersion": "2.12.0",
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Audio preprocessing and text decoding on CPU",
"loadMs": 3893.5816249868367,
"inferenceMs": 405.1327909983229,
"realTimeFactor": 0.035228938347680254,
"predictionPlacement": "mps:0",
"engine": "transformers",
"artifactRevision": "d455706339a6b32e1aa40f82c713a482a0c938e2",
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 4352.785416995175,
"grade": "fast",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"wordErrorRate": 0,
"streamParity": true
},
"runtime": {
"placement": {
"cpu": 1410
},
"version": "5.22.1",
"torchVersion": "2.12.0",
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Audio preprocessing and text decoding on CPU",
"loadMs": 2515.6835000088904,
"inferenceMs": 1826.3042090111412,
"realTimeFactor": 0.1660276553646492,
"predictionPlacement": "cpu",
"engine": "transformers",
"artifactRevision": "d455706339a6b32e1aa40f82c713a482a0c938e2",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 4610.657124983845,
"grade": "fast",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"wordErrorRate": 0,
"streamParity": true
},
"runtime": {
"placement": {
"cpu": 1410
},
"version": "5.22.1",
"torchVersion": "2.12.0",
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Audio preprocessing and text decoding on CPU",
"loadMs": 2515.6835000088904,
"inferenceMs": 1103.180666017579,
"realTimeFactor": 0.32446490176987614,
"predictionPlacement": "cpu",
"engine": "transformers",
"artifactRevision": "d455706339a6b32e1aa40f82c713a482a0c938e2",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 3644.858417013893,
"grade": "moderate",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"wordErrorRate": 0,
"streamParity": true
},
"runtime": {
"placement": {
"cpu": 1410
},
"version": "5.22.1",
"torchVersion": "2.12.0",
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Audio preprocessing and text decoding on CPU",
"loadMs": 2515.6835000088904,
"inferenceMs": 1508.9905000058934,
"realTimeFactor": 0.13121656521790379,
"predictionPlacement": "cpu",
"engine": "transformers",
"artifactRevision": "d455706339a6b32e1aa40f82c713a482a0c938e2",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 4077.946666016942,
"grade": "fast",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"wordErrorRate": 0,
"streamParity": true
},
"runtime": {
"placement": {
"cpu": 1410
},
"version": "5.22.1",
"torchVersion": "2.12.0",
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Audio preprocessing and text decoding on CPU",
"loadMs": 2583.750666992273,
"inferenceMs": 1914.647416997468,
"realTimeFactor": 0.17405885609067892,
"predictionPlacement": "cpu",
"engine": "transformers",
"artifactRevision": "d455706339a6b32e1aa40f82c713a482a0c938e2",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 4758.671707997564,
"grade": "fast",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"wordErrorRate": 0,
"streamParity": true
},
"runtime": {
"placement": {
"cpu": 1410
},
"version": "5.22.1",
"torchVersion": "2.12.0",
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Audio preprocessing and text decoding on CPU",
"loadMs": 2583.750666992273,
"inferenceMs": 1145.3869169927202,
"realTimeFactor": 0.3368785049978589,
"predictionPlacement": "cpu",
"engine": "transformers",
"artifactRevision": "d455706339a6b32e1aa40f82c713a482a0c938e2",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 3753.3482079743408,
"grade": "moderate",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"wordErrorRate": 0,
"streamParity": true
},
"runtime": {
"placement": {
"cpu": 1410
},
"version": "5.22.1",
"torchVersion": "2.12.0",
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Audio preprocessing and text decoding on CPU",
"loadMs": 2583.750666992273,
"inferenceMs": 1564.0137080044951,
"realTimeFactor": 0.13600119200039087,
"predictionPlacement": "cpu",
"engine": "transformers",
"artifactRevision": "d455706339a6b32e1aa40f82c713a482a0c938e2",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 4199.025459005497,
"grade": "fast",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"wordErrorRate": 0,
"streamParity": true
},
"runtime": {
"placement": {
"cpu": 1410
},
"version": "5.22.1",
"torchVersion": "2.12.0",
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Audio preprocessing and text decoding on CPU",
"loadMs": 2579.911583015928,
"inferenceMs": 1704.3164999922737,
"realTimeFactor": 0.15493786363566125,
"predictionPlacement": "cpu",
"engine": "transformers",
"artifactRevision": "d455706339a6b32e1aa40f82c713a482a0c938e2",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 4533.538125018822,
"grade": "fast",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"wordErrorRate": 0,
"streamParity": true
},
"runtime": {
"placement": {
"cpu": 1410
},
"version": "5.22.1",
"torchVersion": "2.12.0",
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Audio preprocessing and text decoding on CPU",
"loadMs": 2579.911583015928,
"inferenceMs": 922.2272920014802,
"realTimeFactor": 0.27124332117690597,
"predictionPlacement": "cpu",
"engine": "transformers",
"artifactRevision": "d455706339a6b32e1aa40f82c713a482a0c938e2",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 3526.650707994122,
"grade": "moderate",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"wordErrorRate": 0,
"streamParity": true
},
"runtime": {
"placement": {
"cpu": 1410
},
"version": "5.22.1",
"torchVersion": "2.12.0",
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Audio preprocessing and text decoding on CPU",
"loadMs": 2579.911583015928,
"inferenceMs": 1059.326249989681,
"realTimeFactor": 0.09211532608605921,
"predictionPlacement": "cpu",
"engine": "transformers",
"artifactRevision": "d455706339a6b32e1aa40f82c713a482a0c938e2",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 3683.511500013992,
"grade": "fast",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"wordErrorRate": 0,
"streamParity": true
},
"runtime": {
"placement": {
"cpu": 1410
},
"version": "5.22.1",
"torchVersion": "2.12.0",
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Audio preprocessing and text decoding on CPU",
"loadMs": 2440.6920000037644,
"inferenceMs": 927.0337920170277,
"realTimeFactor": 0.08427579927427525,
"predictionPlacement": "cpu",
"engine": "transformers",
"artifactRevision": "d455706339a6b32e1aa40f82c713a482a0c938e2",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 3611.9192500191275,
"grade": "fast",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"wordErrorRate": 0,
"streamParity": true
},
"runtime": {
"placement": {
"cpu": 1410
},
"version": "5.22.1",
"torchVersion": "2.12.0",
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Audio preprocessing and text decoding on CPU",
"loadMs": 2440.6920000037644,
"inferenceMs": 383.26004199916497,
"realTimeFactor": 0.11272354176446028,
"predictionPlacement": "cpu",
"engine": "transformers",
"artifactRevision": "d455706339a6b32e1aa40f82c713a482a0c938e2",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 2849.1257919813506,
"grade": "fast",
"fallback": false
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"wordErrorRate": 0,
"streamParity": true
},
"runtime": {
"placement": {
"cpu": 1410
},
"version": "5.22.1",
"torchVersion": "2.12.0",
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Audio preprocessing and text decoding on CPU",
"loadMs": 2440.6920000037644,
"inferenceMs": 684.9679159931839,
"realTimeFactor": 0.05956242747766816,
"predictionPlacement": "cpu",
"engine": "transformers",
"artifactRevision": "d455706339a6b32e1aa40f82c713a482a0c938e2",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 3169.302833994152,
"grade": "fast",
"fallback": false
}
}
]