Cohere Transcribe 03-2026 — Multilingual ASR
10 configurations testedQuality criteria
Non-empty, non-repetitive English transcript with word error rate at most 0.35 against the checked-in reference.
| Precision | Device | Result | |
|---|---|---|---|
Q4 | GPU · WebGPUAccelerated | Passed | Very fast |
FP32 | CPU · WASM | Failed | — |
FP32 | GPU · WebGPU | Failed | — |
FP16 | CPU · WASM | Failed | — |
FP16 | GPU · WebGPU | Failed | — |
Q8 | CPU · WASM | Failed | — |
Q8 | GPU · WebGPU | Failed | — |
Q4 | CPU · WASM | Failed | — |
Q4F16 | CPU · WASM | Failed | — |
Q4F16 | GPU · WebGPU | Failed | — |
Test setup & sample details
- Quality gate
- Non-empty, non-repetitive English transcript with word error rate at most 0.35 against the checked-in reference.
- Tested
- 2026-09-12T13:46:52.787Z
- Environment
- Not recorded
- Runtime
- Transformers.js 4.2.0
- Artifact revision
- 31b1c6211c9000d76b077ddd23b74c9090badeba
- Fixture
{ "file": "whisper-standard.mp3", "url": "https://f005.backblazeb2.com/file/hubters-webai-public/assets/benchmarks/whisper-standard.mp3", "size": 471925, "sha1": "5faad1507b5d6bc61a39ca3184db5a7b554a7479", "durationSeconds": 29.49225 }- Rerun when
- artifact revision change; runtime version change; fixture or quality gate change; browser/backend change
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "wasm",
"status": "fail",
"quality": "Not embedded",
"runtime": "Not embedded",
"failure": "Cold initialization exceeded the bounded 20-minute benchmark timeout."
},
{
"precision": "fp32",
"device": "webgpu",
"status": "fail",
"quality": "Not embedded",
"runtime": "Not embedded",
"failure": "Runtime module fetch failed in the isolated browser; support was not established."
},
{
"precision": "fp16",
"device": "wasm",
"status": "fail",
"quality": "Not embedded",
"runtime": "Not embedded",
"failure": "Runtime module fetch failed in the isolated browser; support was not established."
},
{
"precision": "fp16",
"device": "webgpu",
"status": "fail",
"quality": "Not embedded",
"runtime": "Not embedded",
"failure": "Runtime module fetch failed in the isolated browser; support was not established."
},
{
"precision": "q8",
"device": "wasm",
"status": "fail",
"quality": "Not embedded",
"runtime": "Not embedded",
"failure": "Runtime module fetch failed in the isolated browser; support was not established."
},
{
"precision": "q8",
"device": "webgpu",
"status": "fail",
"quality": "Not embedded",
"runtime": "Not embedded",
"failure": "Runtime module fetch failed in the isolated browser; support was not established."
},
{
"precision": "q4",
"device": "wasm",
"status": "fail",
"quality": "Not embedded",
"runtime": "Not embedded",
"failure": "ONNX Runtime Web has no WASM implementation for the decoder GatherBlockQuantized node."
},
{
"precision": "q4",
"device": "webgpu",
"status": "pass",
"quality": {
"wordErrorRate": 0.1667,
"grade": "acceptable",
"gibberish": false
},
"runtime": {
"totalMs": 217601,
"loadMs": 215768.8,
"inferenceMs": 1832.1,
"realTimeFactor": 0.0621,
"grade": "excellent"
}
},
{
"precision": "q4f16",
"device": "wasm",
"status": "fail",
"quality": "Not embedded",
"runtime": "Not embedded",
"failure": "Runtime module fetch failed in the isolated browser; support was not established."
},
{
"precision": "q4f16",
"device": "webgpu",
"status": "fail",
"quality": "Not embedded",
"runtime": "Not embedded",
"failure": "Runtime module fetch failed in the isolated browser; support was not established."
}
]