Qwen3 Embedding 0.6B
10 configurations testedQuality criteria
Finite normalized 1024d vectors, distinct rows, and positive cosine exceeds negative by at least 0.1.
| Precision | Device | Result | |
|---|---|---|---|
FP16 | GPU · WebGPUAccelerated | Passed | Fast |
FP32 | GPU · WebGPUAccelerated | Passed | Fast |
Q4F16 | GPU · WebGPUAccelerated | Passed | Moderate |
Q4 | GPU · WebGPUAccelerated | Passed | Moderate |
Q8 | GPU · WebGPUAccelerated | Passed | Moderate |
FP32 | CPU · WASM | Passed | Moderate |
Q8 | CPU · WASM | Passed | Moderate |
FP16 | CPU · WASM | Passed | Moderate |
Q4F16 | CPU · WASM | Passed | Slow |
Q4 | CPU · WASM | Passed | Slow |
Test setup & sample details
- Quality gate
- Finite normalized 1024d vectors, distinct rows, and positive cosine exceeds negative by at least 0.1.
- Tested
- 2026-09-10T10:07:48.000Z
- Environment
- Not recorded
- Runtime
- Transformers.js 4.2.0
- Artifact revision
- c25a394dd583836952667c12f008335071b3f43d
- Fixture
{ "file": "qwen3-embedding-0.6b.json", "url": "https://f005.backblazeb2.com/file/hubters-webai-public/assets/benchmarks/qwen3-embedding-0.6b.json", "size": 649, "sha1": "1de6f9cb512dd37a77b155454b595322c5eeff9f" }- Rerun when
- artifact revision change; runtime version change; fixture or quality gate change; browser/backend change
Per-case quality & failure details
[
{
"precision": "q8",
"device": "wasm",
"status": "pass",
"quality": "Not embedded",
"runtime": {
"loadMs": 66670.5,
"inferenceMs": 1592.1999999284744,
"totalMs": 69483.70000004768,
"embeddingsPerSecond": 1.884,
"grade": "very-slow"
}
},
{
"precision": "q8",
"device": "webgpu",
"status": "pass",
"quality": "Not embedded",
"runtime": {
"loadMs": 65435.89999997616,
"inferenceMs": 1977,
"totalMs": 68633.5,
"embeddingsPerSecond": 1.517,
"grade": "very-slow"
}
},
{
"precision": "q4",
"device": "wasm",
"status": "pass",
"quality": "Not embedded",
"runtime": {
"loadMs": 99191.29999995232,
"inferenceMs": 2046.9000000953674,
"totalMs": 102534.90000009537,
"embeddingsPerSecond": 1.466,
"grade": "very-slow"
}
},
{
"precision": "q4",
"device": "webgpu",
"status": "pass",
"quality": "Not embedded",
"runtime": {
"loadMs": 99817.80000007153,
"inferenceMs": 700.6000000238419,
"totalMs": 101760,
"embeddingsPerSecond": 4.282,
"grade": "slow"
}
},
{
"precision": "q4f16",
"device": "wasm",
"status": "pass",
"quality": "Not embedded",
"runtime": {
"loadMs": 63508.90000009537,
"inferenceMs": 2042.7999999523163,
"totalMs": 66920.60000002384,
"embeddingsPerSecond": 1.469,
"grade": "very-slow"
}
},
{
"precision": "q4f16",
"device": "webgpu",
"status": "pass",
"quality": "Not embedded",
"runtime": {
"loadMs": 67355.19999992847,
"inferenceMs": 583,
"totalMs": 69141.40000009537,
"embeddingsPerSecond": 5.146,
"grade": "slow"
}
},
{
"precision": "fp16",
"device": "wasm",
"status": "pass",
"quality": "Not embedded",
"runtime": {
"loadMs": 130781.79999995232,
"inferenceMs": 1616.7999999523163,
"totalMs": 133604.90000009537,
"embeddingsPerSecond": 1.856,
"grade": "very-slow"
}
},
{
"precision": "fp16",
"device": "webgpu",
"status": "pass",
"quality": "Not embedded",
"runtime": {
"loadMs": 134953.19999992847,
"inferenceMs": 295.3000000715256,
"totalMs": 136436.19999992847,
"embeddingsPerSecond": 10.159,
"grade": "good"
}
},
{
"precision": "fp32",
"device": "wasm",
"status": "pass",
"quality": "Not embedded",
"runtime": {
"loadMs": 245924.30000007153,
"inferenceMs": 1547.6999999284744,
"totalMs": 248731.89999997616,
"embeddingsPerSecond": 1.938,
"grade": "very-slow"
}
},
{
"precision": "fp32",
"device": "webgpu",
"status": "pass",
"quality": "Not embedded",
"runtime": {
"loadMs": 247768.39999997616,
"inferenceMs": 377.2000000476837,
"totalMs": 249519.10000002384,
"embeddingsPerSecond": 7.953,
"grade": "slow"
}
}
]