BERT Base NER — English Named Entities
46 configurations testedQuality criteria
Frozen six short English fixtures, valid complete UTF-16 entity spans/scores, exact selected-entity recall for partially annotated NASA text, full exact-span recall/F1 for five complete references including negative/repeated/Unicode cases. <=1000ms per text. Browser uses simple BIO aggregation; native first differs and evidence is not interchangeable.
| Precision | Device | Result | |
|---|---|---|---|
Q4 | GPU · WebGPUAccelerated | Passed | Very fast |
Q4 | GPU · WebGPUAccelerated | Passed | Very fast |
Q4 | GPU · WebGPUAccelerated | Passed | Very fast |
Q4 | GPU · WebGPUAccelerated | Passed | Very fast |
Q4 | GPU · WebGPUAccelerated | Passed | Very fast |
Q8 | GPU · WebGPUAccelerated | Passed | Very fast |
Q8 | GPU · WebGPUAccelerated | Passed | Very fast |
Q4 | GPU · WebGPUAccelerated | Passed | Very fast |
Q8 | GPU · WebGPUAccelerated | Passed | Very fast |
Q8 | GPU · WebGPUAccelerated | Passed | Fast |
Q4 | GPU · WebGPUAccelerated | Passed | Fast |
Q8 | GPU · WebGPUAccelerated | Passed | Fast |
Q8 | GPU · WebGPUAccelerated | Passed | Fast |
Q8 | GPU · WebGPUAccelerated | Passed | Fast |
Q8 | CPU · WASM | Passed | Very fast |
Q8 | CPU · WASM | Passed | Very fast |
Q8 | CPU · WASM | Passed | Very fast |
Q8 | CPU · WASM | Passed | Very fast |
Q8 | CPU · WASM | Passed | Very fast |
Q8 | CPU · WASM | Passed | Very fast |
Q8 | CPU · WASM | Passed | Very fast |
Q8 | CPU · WASM | Passed | Very fast |
Q8 | CPU · WASM | Passed | Very fast |
Q8 | CPU · WASM | Passed | Very fast |
Q4 | CPU · WASM | Passed | Fast |
Q4 | CPU · WASM | Passed | Fast |
Q4 | CPU · WASM | Passed | Fast |
Q4 | CPU · WASM | Passed | Fast |
Q4 | CPU · WASM | Passed | Fast |
Q8 | CPU · WASM | Passed | Fast |
Q8 | CPU · WASM | Passed | Fast |
Q8 | CPU · WASM | Passed | Fast |
Q4 | CPU · WASM | Passed | Fast |
Q4 | CPU · WASM | Passed | Fast |
FP32 | CPU · WASM | Failed | — |
FP32 | GPU · WebGPU | Failed | — |
FP16 | CPU · WASM | Failed | — |
FP16 | GPU · WebGPU | Failed | — |
INT8 | CPU · WASM | Failed | — |
INT8 | GPU · WebGPU | Failed | — |
UINT8 | CPU · WASM | Failed | — |
UINT8 | GPU · WebGPU | Failed | — |
Q4F16 | CPU · WASM | Failed | — |
Q4F16 | GPU · WebGPU | Failed | — |
BNB4 | CPU · WASM | Failed | — |
BNB4 | GPU · WebGPU | Failed | — |
Test setup & sample details
- Quality gate
- Frozen six short English fixtures, valid complete UTF-16 entity spans/scores, exact selected-entity recall for partially annotated NASA text, full exact-span recall/F1 for five complete references including negative/repeated/Unicode cases. <=1000ms per text. Browser uses simple BIO aggregation; native first differs and evidence is not interchangeable.
- Tested
- 2026-10-23T10:53:16.920Z
- Environment
- Isolated headless Google Chrome on macOS; Transformers.js 4.2.0
- Runtime
- Transformers.js 4.2.0
- Artifact revision
- 8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa
- Fixture
{ "file": "model-samples/browser/bert-ner/quality-gates.json", "url": "https://assets.localai.tools/samples/v1/files/858aff66b2fad14ec9b6414c2a86d4f45f383998f09b3d705143d6801b68ad0f/bert-ner-quality-gates.json", "size": 4228, "sha1": "2e5621be8c41bf169ec2cb42ed93ccd0d7d4c92f", "sha256": "858aff66b2fad14ec9b6414c2a86d4f45f383998f09b3d705143d6801b68ad0f" }- Rerun when
- artifact revision change; runtime version change; fixture or quality-gate change; browser/backend behavior change
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "wasm",
"status": "fail",
"quality": {
"finite": true,
"validOffsets": true,
"nondegenerate": true,
"expected": [
{
"text": "Cape Kennedy",
"label": "LOC",
"found": true,
"score": 0.9919501543045044,
"pass": true
},
{
"text": "Neil Armstrong",
"label": "PER",
"found": true,
"score": 0.9995951950550079,
"pass": true
},
{
"text": "Michael Collins",
"label": "PER",
"found": true,
"score": 0.9996791481971741,
"pass": true
},
{
"text": "Edwin Buzz Aldrin",
"label": "PER",
"found": false,
"score": null,
"pass": false
}
],
"recall": 0.75,
"grade": "failed"
},
"runtime": {
"loadMs": 51071.199999928474,
"inferenceMs": 184.89999997615814,
"totalMs": 52634.700000047684,
"grade": "slow",
"textsPerSecond": 5.40832882709002
}
},
{
"precision": "fp32",
"device": "webgpu",
"status": "fail",
"quality": {
"finite": true,
"validOffsets": true,
"nondegenerate": true,
"expected": [
{
"text": "Cape Kennedy",
"label": "LOC",
"found": true,
"score": 0.9919500946998596,
"pass": true
},
{
"text": "Neil Armstrong",
"label": "PER",
"found": true,
"score": 0.9995951950550079,
"pass": true
},
{
"text": "Michael Collins",
"label": "PER",
"found": true,
"score": 0.9996791481971741,
"pass": true
},
{
"text": "Edwin Buzz Aldrin",
"label": "PER",
"found": false,
"score": null,
"pass": false
}
],
"recall": 0.75,
"grade": "failed"
},
"runtime": {
"loadMs": 56146.5,
"inferenceMs": 79.39999997615814,
"totalMs": 57656.60000002384,
"grade": "good",
"textsPerSecond": 12.594458442068959
}
},
{
"precision": "fp16",
"device": "wasm",
"status": "fail",
"quality": "Not embedded",
"runtime": {
"loadMs": null,
"inferenceMs": null,
"totalMs": 29800.399999976158,
"grade": "failed"
},
"failure": "Error: Can't create a session. ERROR_CODE: 1, ERROR_MESSAGE: /mnt/vss/_work/1/s/onnxruntime/core/graph/graph_utils.cc:30 int onnxruntime::graph_utils::GetIndexFromName(const Node &, const std::string &, bool) itr != node_args.end() was false. Attempting to get index by a name which does not exist:InsertedPrecisionFreeCast_/bert/encoder/layer.11/output/LayerNorm/Constant_output_0for node: /bert/embeddings/LayerNorm/Mul/SimplifiedLayerNormFusion/\n"
},
{
"precision": "fp16",
"device": "webgpu",
"status": "fail",
"quality": {
"finite": true,
"validOffsets": true,
"nondegenerate": true,
"expected": [
{
"text": "Cape Kennedy",
"label": "LOC",
"found": true,
"score": 0.9120904207229614,
"pass": true
},
{
"text": "Neil Armstrong",
"label": "PER",
"found": true,
"score": 0.9852735102176666,
"pass": true
},
{
"text": "Michael Collins",
"label": "PER",
"found": true,
"score": 0.9911523163318634,
"pass": true
},
{
"text": "Edwin Buzz Aldrin",
"label": "PER",
"found": false,
"score": null,
"pass": false
}
],
"recall": 0.75,
"grade": "failed"
},
"runtime": {
"loadMs": 27688,
"inferenceMs": 68.30000007152557,
"totalMs": 29063.399999976158,
"grade": "good",
"textsPerSecond": 14.641288418049392
}
},
{
"precision": "int8",
"device": "wasm",
"status": "fail",
"quality": {
"finite": true,
"validOffsets": true,
"nondegenerate": true,
"expected": [
{
"text": "Cape Kennedy",
"label": "LOC",
"found": true,
"score": 0.9895126521587372,
"pass": true
},
{
"text": "Neil Armstrong",
"label": "PER",
"found": true,
"score": 0.9993838667869568,
"pass": true
},
{
"text": "Michael Collins",
"label": "PER",
"found": true,
"score": 0.9995821416378021,
"pass": true
},
{
"text": "Edwin Buzz Aldrin",
"label": "PER",
"found": false,
"score": null,
"pass": false
}
],
"recall": 0.75,
"grade": "failed"
},
"runtime": {
"loadMs": 19456.799999952316,
"inferenceMs": 194.29999995231628,
"totalMs": 21021.399999976158,
"grade": "slow",
"textsPerSecond": 5.146680392410771
}
},
{
"precision": "int8",
"device": "webgpu",
"status": "fail",
"quality": {
"finite": true,
"validOffsets": true,
"nondegenerate": true,
"expected": [
{
"text": "Cape Kennedy",
"label": "LOC",
"found": true,
"score": 0.9833778142929077,
"pass": true
},
{
"text": "Neil Armstrong",
"label": "PER",
"found": true,
"score": 0.9993617832660675,
"pass": true
},
{
"text": "Michael Collins",
"label": "PER",
"found": true,
"score": 0.9995712041854858,
"pass": true
},
{
"text": "Edwin Buzz Aldrin",
"label": "PER",
"found": false,
"score": null,
"pass": false
}
],
"recall": 0.75,
"grade": "failed"
},
"runtime": {
"loadMs": 18314.100000023842,
"inferenceMs": 362.09999990463257,
"totalMs": 19945.100000023842,
"grade": "slow",
"textsPerSecond": 2.7616680482280396
}
},
{
"precision": "uint8",
"device": "wasm",
"status": "fail",
"quality": {
"finite": true,
"validOffsets": true,
"nondegenerate": true,
"expected": [
{
"text": "Cape Kennedy",
"label": "LOC",
"found": true,
"score": 0.979133665561676,
"pass": true
},
{
"text": "Neil Armstrong",
"label": "PER",
"found": true,
"score": 0.9994161427021027,
"pass": true
},
{
"text": "Michael Collins",
"label": "PER",
"found": true,
"score": 0.9995928108692169,
"pass": true
},
{
"text": "Edwin Buzz Aldrin",
"label": "PER",
"found": false,
"score": null,
"pass": false
}
],
"recall": 0.75,
"grade": "failed"
},
"runtime": {
"loadMs": 20562.299999952316,
"inferenceMs": 197.29999995231628,
"totalMs": 22139.100000023842,
"grade": "slow",
"textsPerSecond": 5.068423721447954
}
},
{
"precision": "uint8",
"device": "webgpu",
"status": "fail",
"quality": {
"finite": true,
"validOffsets": true,
"nondegenerate": true,
"expected": [
{
"text": "Cape Kennedy",
"label": "LOC",
"found": true,
"score": 0.9817031025886536,
"pass": true
},
{
"text": "Neil Armstrong",
"label": "PER",
"found": true,
"score": 0.9994866847991943,
"pass": true
},
{
"text": "Michael Collins",
"label": "PER",
"found": true,
"score": 0.9995744526386261,
"pass": true
},
{
"text": "Edwin Buzz Aldrin",
"label": "PER",
"found": false,
"score": null,
"pass": false
}
],
"recall": 0.75,
"grade": "failed"
},
"runtime": {
"loadMs": 18230.300000071526,
"inferenceMs": 285.7999999523163,
"totalMs": 19954.700000047684,
"grade": "slow",
"textsPerSecond": 3.4989503154893034
}
},
{
"precision": "q8",
"device": "wasm",
"status": "pass",
"quality": {
"finite": true,
"validOffsets": true,
"nondegenerate": true,
"expected": [
{
"text": "Cape Kennedy",
"label": "LOC",
"found": true,
"score": 0.9723472595214844,
"pass": true
},
{
"text": "Neil Armstrong",
"label": "PER",
"found": true,
"score": 0.999410480260849,
"pass": true
},
{
"text": "Michael Collins",
"label": "PER",
"found": true,
"score": 0.9996160864830017,
"pass": true
},
{
"text": "Edwin Buzz Aldrin",
"label": "PER",
"found": true,
"score": 0.9106517434120178,
"pass": true
}
],
"recall": 1,
"grade": "ner-span-pass"
},
"runtime": {
"loadMs": 19248.100000023842,
"inferenceMs": 198.39999997615814,
"totalMs": 20881.299999952316,
"grade": "slow",
"textsPerSecond": 5.0403225812508605
}
},
{
"precision": "q8",
"device": "webgpu",
"status": "pass",
"quality": {
"finite": true,
"validOffsets": true,
"nondegenerate": true,
"expected": [
{
"text": "Cape Kennedy",
"label": "LOC",
"found": true,
"score": 0.9673751592636108,
"pass": true
},
{
"text": "Neil Armstrong",
"label": "PER",
"found": true,
"score": 0.9993798434734344,
"pass": true
},
{
"text": "Michael Collins",
"label": "PER",
"found": true,
"score": 0.999609112739563,
"pass": true
},
{
"text": "Edwin Buzz Aldrin",
"label": "PER",
"found": true,
"score": 0.9028891444206237,
"pass": true
}
],
"recall": 1,
"grade": "ner-span-pass"
},
"runtime": {
"loadMs": 16627.100000023842,
"inferenceMs": 363,
"totalMs": 18244.899999976158,
"grade": "slow",
"textsPerSecond": 2.7548209366391183
}
},
{
"precision": "q4",
"device": "wasm",
"status": "pass",
"quality": {
"finite": true,
"validOffsets": true,
"nondegenerate": true,
"expected": [
{
"text": "Cape Kennedy",
"label": "LOC",
"found": true,
"score": 0.9928421080112457,
"pass": true
},
{
"text": "Neil Armstrong",
"label": "PER",
"found": true,
"score": 0.9995550215244293,
"pass": true
},
{
"text": "Michael Collins",
"label": "PER",
"found": true,
"score": 0.9995963275432587,
"pass": true
},
{
"text": "Edwin Buzz Aldrin",
"label": "PER",
"found": true,
"score": 0.9127414464950562,
"pass": true
}
],
"recall": 1,
"grade": "ner-span-pass"
},
"runtime": {
"loadMs": 20310.100000023842,
"inferenceMs": 302.10000002384186,
"totalMs": 21789.799999952316,
"grade": "slow",
"textsPerSecond": 3.31016219768646
}
},
{
"precision": "q4",
"device": "webgpu",
"status": "pass",
"quality": {
"finite": true,
"validOffsets": true,
"nondegenerate": true,
"expected": [
{
"text": "Cape Kennedy",
"label": "LOC",
"found": true,
"score": 0.9928420782089233,
"pass": true
},
{
"text": "Neil Armstrong",
"label": "PER",
"found": true,
"score": 0.9995550215244293,
"pass": true
},
{
"text": "Michael Collins",
"label": "PER",
"found": true,
"score": 0.9995963275432587,
"pass": true
},
{
"text": "Edwin Buzz Aldrin",
"label": "PER",
"found": true,
"score": 0.9127416491508484,
"pass": true
}
],
"recall": 1,
"grade": "ner-span-pass"
},
"runtime": {
"loadMs": 20363,
"inferenceMs": 91.39999997615814,
"totalMs": 21691.099999904633,
"grade": "good",
"textsPerSecond": 10.940919040053084
}
},
{
"precision": "q4f16",
"device": "wasm",
"status": "fail",
"quality": "Not embedded",
"runtime": {
"loadMs": null,
"inferenceMs": null,
"totalMs": 17129.299999952316,
"grade": "failed"
},
"failure": "Error: Can't create a session. ERROR_CODE: 1, ERROR_MESSAGE: /mnt/vss/_work/1/s/onnxruntime/core/graph/graph_utils.cc:30 int onnxruntime::graph_utils::GetIndexFromName(const Node &, const std::string &, bool) itr != node_args.end() was false. Attempting to get index by a name which does not exist:InsertedPrecisionFreeCast_/bert/embeddings/LayerNorm/Constant_output_0for node: /bert/embeddings/LayerNorm/Mul/SimplifiedLayerNormFusion/\n"
},
{
"precision": "q4f16",
"device": "webgpu",
"status": "fail",
"quality": {
"finite": true,
"validOffsets": true,
"nondegenerate": true,
"expected": [
{
"text": "Cape Kennedy",
"label": "LOC",
"found": true,
"score": 0.9028969407081604,
"pass": true
},
{
"text": "Neil Armstrong",
"label": "PER",
"found": true,
"score": 0.98146653175354,
"pass": true
},
{
"text": "Michael Collins",
"label": "PER",
"found": true,
"score": 0.9889111220836639,
"pass": true
},
{
"text": "Edwin Buzz Aldrin",
"label": "PER",
"found": false,
"score": null,
"pass": false
}
],
"recall": 0.75,
"grade": "failed"
},
"runtime": {
"loadMs": 15915.899999976158,
"inferenceMs": 68.89999997615814,
"totalMs": 17249.600000023842,
"grade": "good",
"textsPerSecond": 14.513788103716047
}
},
{
"precision": "bnb4",
"device": "wasm",
"status": "fail",
"quality": {
"finite": true,
"validOffsets": true,
"nondegenerate": true,
"expected": [
{
"text": "Cape Kennedy",
"label": "LOC",
"found": true,
"score": 0.9878316521644592,
"pass": true
},
{
"text": "Neil Armstrong",
"label": "PER",
"found": true,
"score": 0.9994357824325562,
"pass": true
},
{
"text": "Michael Collins",
"label": "PER",
"found": true,
"score": 0.9995394051074982,
"pass": true
},
{
"text": "Edwin Buzz Aldrin",
"label": "PER",
"found": false,
"score": null,
"pass": false
}
],
"recall": 0.75,
"grade": "failed"
},
"runtime": {
"loadMs": 21031.100000023842,
"inferenceMs": 234.29999995231628,
"totalMs": 22572.199999928474,
"grade": "slow",
"textsPerSecond": 4.268032437915133
}
},
{
"precision": "bnb4",
"device": "webgpu",
"status": "fail",
"quality": {
"finite": true,
"validOffsets": true,
"nondegenerate": true,
"expected": [
{
"text": "Cape Kennedy",
"label": "LOC",
"found": true,
"score": 0.9878315925598145,
"pass": true
},
{
"text": "Neil Armstrong",
"label": "PER",
"found": true,
"score": 0.9994357824325562,
"pass": true
},
{
"text": "Michael Collins",
"label": "PER",
"found": true,
"score": 0.9995394051074982,
"pass": true
},
{
"text": "Edwin Buzz Aldrin",
"label": "PER",
"found": false,
"score": null,
"pass": false
}
],
"recall": 0.75,
"grade": "failed"
},
"runtime": {
"loadMs": 20800.199999928474,
"inferenceMs": 417.3000000715256,
"totalMs": 22650.799999952316,
"grade": "slow",
"textsPerSecond": 2.396357536133715
}
},
{
"precision": "q8",
"device": "wasm",
"status": "pass",
"quality": {
"passed": true,
"validOffsetsAndScores": true,
"precision": 0.5,
"recall": 1,
"f1": 0.6666666666666666,
"referenceCoverage": "selected-entities"
},
"runtime": {
"loadMs": 2134.5999999940395,
"inferenceMs": 194.2999999821186,
"totalMs": 2328.899999976158,
"charactersPerSecond": 1008.7493567577861,
"grade": "good",
"actualDevice": "wasm",
"actualPrecision": "q8",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
"gpuForwardQueueObserved": false,
"acceleration": "cpu"
}
},
{
"precision": "q8",
"device": "wasm",
"status": "pass",
"quality": {
"passed": true,
"validOffsetsAndScores": true,
"precision": 1,
"recall": 1,
"f1": 1,
"referenceCoverage": "complete"
},
"runtime": {
"loadMs": 2134.5999999940395,
"inferenceMs": 53.79999998211861,
"totalMs": 2188.399999976158,
"charactersPerSecond": 762.0817846399086,
"grade": "excellent",
"actualDevice": "wasm",
"actualPrecision": "q8",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
"gpuForwardQueueObserved": false,
"acceleration": "cpu"
}
},
{
"precision": "q8",
"device": "wasm",
"status": "pass",
"quality": {
"passed": true,
"validOffsetsAndScores": true,
"precision": 1,
"recall": 1,
"f1": 1,
"referenceCoverage": "complete"
},
"runtime": {
"loadMs": 2134.5999999940395,
"inferenceMs": 39.5,
"totalMs": 2174.0999999940395,
"charactersPerSecond": 759.493670886076,
"grade": "excellent",
"actualDevice": "wasm",
"actualPrecision": "q8",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
"gpuForwardQueueObserved": false,
"acceleration": "cpu"
}
},
{
"precision": "q8",
"device": "wasm",
"status": "pass",
"quality": {
"passed": true,
"validOffsetsAndScores": true,
"precision": 1,
"recall": 1,
"f1": 1,
"referenceCoverage": "complete"
},
"runtime": {
"loadMs": 2134.5999999940395,
"inferenceMs": 54.19999998807907,
"totalMs": 2188.7999999821186,
"charactersPerSecond": 811.8081182597326,
"grade": "excellent",
"actualDevice": "wasm",
"actualPrecision": "q8",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
"gpuForwardQueueObserved": false,
"acceleration": "cpu"
}
},
{
"precision": "q8",
"device": "wasm",
"status": "pass",
"quality": {
"passed": true,
"validOffsetsAndScores": true,
"precision": 1,
"recall": 1,
"f1": 1,
"referenceCoverage": "complete"
},
"runtime": {
"loadMs": 2134.5999999940395,
"inferenceMs": 41.5,
"totalMs": 2176.0999999940395,
"charactersPerSecond": 674.6987951807229,
"grade": "excellent",
"actualDevice": "wasm",
"actualPrecision": "q8",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
"gpuForwardQueueObserved": false,
"acceleration": "cpu"
}
},
{
"precision": "q8",
"device": "wasm",
"status": "pass",
"quality": {
"passed": true,
"validOffsetsAndScores": true,
"precision": 1,
"recall": 1,
"f1": 1,
"referenceCoverage": "complete"
},
"runtime": {
"loadMs": 2134.5999999940395,
"inferenceMs": 52.5,
"totalMs": 2187.0999999940395,
"charactersPerSecond": 819.047619047619,
"grade": "excellent",
"actualDevice": "wasm",
"actualPrecision": "q8",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
"gpuForwardQueueObserved": false,
"acceleration": "cpu"
}
},
{
"precision": "q8",
"device": "webgpu",
"status": "pass",
"quality": {
"passed": true,
"validOffsetsAndScores": true,
"precision": 0.5,
"recall": 1,
"f1": 0.6666666666666666,
"referenceCoverage": "selected-entities"
},
"runtime": {
"loadMs": 1950.699999988079,
"inferenceMs": 357.7999999821186,
"totalMs": 2308.4999999701977,
"charactersPerSecond": 547.7920626321836,
"grade": "good",
"actualDevice": "webgpu",
"actualPrecision": "q8",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
"gpuForwardQueueObserved": true,
"acceleration": "partial"
}
},
{
"precision": "q8",
"device": "webgpu",
"status": "pass",
"quality": {
"passed": true,
"validOffsetsAndScores": true,
"precision": 1,
"recall": 1,
"f1": 1,
"referenceCoverage": "complete"
},
"runtime": {
"loadMs": 1950.699999988079,
"inferenceMs": 97.90000000596046,
"totalMs": 2048.5999999940395,
"charactersPerSecond": 418.79468843211225,
"grade": "excellent",
"actualDevice": "webgpu",
"actualPrecision": "q8",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
"gpuForwardQueueObserved": true,
"acceleration": "partial"
}
},
{
"precision": "q8",
"device": "webgpu",
"status": "pass",
"quality": {
"passed": true,
"validOffsetsAndScores": true,
"precision": 1,
"recall": 1,
"f1": 1,
"referenceCoverage": "complete"
},
"runtime": {
"loadMs": 1950.699999988079,
"inferenceMs": 81,
"totalMs": 2031.699999988079,
"charactersPerSecond": 370.3703703703704,
"grade": "excellent",
"actualDevice": "webgpu",
"actualPrecision": "q8",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
"gpuForwardQueueObserved": true,
"acceleration": "partial"
}
},
{
"precision": "q8",
"device": "webgpu",
"status": "pass",
"quality": {
"passed": true,
"validOffsetsAndScores": true,
"precision": 1,
"recall": 1,
"f1": 1,
"referenceCoverage": "complete"
},
"runtime": {
"loadMs": 1950.699999988079,
"inferenceMs": 146.2000000178814,
"totalMs": 2096.9000000059605,
"charactersPerSecond": 300.9575923024518,
"grade": "good",
"actualDevice": "webgpu",
"actualPrecision": "q8",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
"gpuForwardQueueObserved": true,
"acceleration": "partial"
}
},
{
"precision": "q8",
"device": "webgpu",
"status": "pass",
"quality": {
"passed": true,
"validOffsetsAndScores": true,
"precision": 1,
"recall": 1,
"f1": 1,
"referenceCoverage": "complete"
},
"runtime": {
"loadMs": 1950.699999988079,
"inferenceMs": 115.19999998807907,
"totalMs": 2065.899999976158,
"charactersPerSecond": 243.05555558070702,
"grade": "good",
"actualDevice": "webgpu",
"actualPrecision": "q8",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
"gpuForwardQueueObserved": true,
"acceleration": "partial"
}
},
{
"precision": "q8",
"device": "webgpu",
"status": "pass",
"quality": {
"passed": true,
"validOffsetsAndScores": true,
"precision": 1,
"recall": 1,
"f1": 1,
"referenceCoverage": "complete"
},
"runtime": {
"loadMs": 1950.699999988079,
"inferenceMs": 85.5,
"totalMs": 2036.199999988079,
"charactersPerSecond": 502.92397660818716,
"grade": "excellent",
"actualDevice": "webgpu",
"actualPrecision": "q8",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
"gpuForwardQueueObserved": true,
"acceleration": "partial"
}
},
{
"precision": "q4",
"device": "wasm",
"status": "pass",
"quality": {
"passed": true,
"validOffsetsAndScores": true,
"precision": 0.5,
"recall": 1,
"f1": 0.6666666666666666,
"referenceCoverage": "selected-entities"
},
"runtime": {
"loadMs": 2381.2999999821186,
"inferenceMs": 301,
"totalMs": 2682.2999999821186,
"charactersPerSecond": 651.1627906976744,
"grade": "good",
"actualDevice": "wasm",
"actualPrecision": "q4",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
"gpuForwardQueueObserved": false,
"acceleration": "cpu"
}
},
{
"precision": "q4",
"device": "wasm",
"status": "pass",
"quality": {
"passed": true,
"validOffsetsAndScores": true,
"precision": 1,
"recall": 1,
"f1": 1,
"referenceCoverage": "complete"
},
"runtime": {
"loadMs": 2381.2999999821186,
"inferenceMs": 152.80000001192093,
"totalMs": 2534.0999999940395,
"charactersPerSecond": 268.32460730890915,
"grade": "good",
"actualDevice": "wasm",
"actualPrecision": "q4",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
"gpuForwardQueueObserved": false,
"acceleration": "cpu"
}
},
{
"precision": "q4",
"device": "wasm",
"status": "pass",
"quality": {
"passed": true,
"validOffsetsAndScores": true,
"precision": 1,
"recall": 1,
"f1": 1,
"referenceCoverage": "complete"
},
"runtime": {
"loadMs": 2381.2999999821186,
"inferenceMs": 132.5,
"totalMs": 2513.7999999821186,
"charactersPerSecond": 226.41509433962264,
"grade": "good",
"actualDevice": "wasm",
"actualPrecision": "q4",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
"gpuForwardQueueObserved": false,
"acceleration": "cpu"
}
},
{
"precision": "q4",
"device": "wasm",
"status": "pass",
"quality": {
"passed": true,
"validOffsetsAndScores": true,
"precision": 1,
"recall": 1,
"f1": 1,
"referenceCoverage": "complete"
},
"runtime": {
"loadMs": 2381.2999999821186,
"inferenceMs": 152.5,
"totalMs": 2533.7999999821186,
"charactersPerSecond": 288.5245901639344,
"grade": "good",
"actualDevice": "wasm",
"actualPrecision": "q4",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
"gpuForwardQueueObserved": false,
"acceleration": "cpu"
}
},
{
"precision": "q4",
"device": "wasm",
"status": "pass",
"quality": {
"passed": true,
"validOffsetsAndScores": true,
"precision": 1,
"recall": 1,
"f1": 1,
"referenceCoverage": "complete"
},
"runtime": {
"loadMs": 2381.2999999821186,
"inferenceMs": 127.5,
"totalMs": 2508.7999999821186,
"charactersPerSecond": 219.6078431372549,
"grade": "good",
"actualDevice": "wasm",
"actualPrecision": "q4",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
"gpuForwardQueueObserved": false,
"acceleration": "cpu"
}
},
{
"precision": "q4",
"device": "wasm",
"status": "pass",
"quality": {
"passed": true,
"validOffsetsAndScores": true,
"precision": 1,
"recall": 1,
"f1": 1,
"referenceCoverage": "complete"
},
"runtime": {
"loadMs": 2381.2999999821186,
"inferenceMs": 132,
"totalMs": 2513.2999999821186,
"charactersPerSecond": 325.75757575757575,
"grade": "good",
"actualDevice": "wasm",
"actualPrecision": "q4",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
"gpuForwardQueueObserved": false,
"acceleration": "cpu"
}
},
{
"precision": "q4",
"device": "webgpu",
"status": "pass",
"quality": {
"passed": true,
"validOffsetsAndScores": true,
"precision": 0.5,
"recall": 1,
"f1": 0.6666666666666666,
"referenceCoverage": "selected-entities"
},
"runtime": {
"loadMs": 1927.5999999940395,
"inferenceMs": 141,
"totalMs": 2068.5999999940395,
"charactersPerSecond": 1390.0709219858156,
"grade": "good",
"actualDevice": "webgpu",
"actualPrecision": "q4",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
"gpuForwardQueueObserved": true,
"acceleration": "partial"
}
},
{
"precision": "q4",
"device": "webgpu",
"status": "pass",
"quality": {
"passed": true,
"validOffsetsAndScores": true,
"precision": 1,
"recall": 1,
"f1": 1,
"referenceCoverage": "complete"
},
"runtime": {
"loadMs": 1927.5999999940395,
"inferenceMs": 64.90000000596046,
"totalMs": 1992.5,
"charactersPerSecond": 631.7411401576969,
"grade": "excellent",
"actualDevice": "webgpu",
"actualPrecision": "q4",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
"gpuForwardQueueObserved": true,
"acceleration": "partial"
}
},
{
"precision": "q4",
"device": "webgpu",
"status": "pass",
"quality": {
"passed": true,
"validOffsetsAndScores": true,
"precision": 1,
"recall": 1,
"f1": 1,
"referenceCoverage": "complete"
},
"runtime": {
"loadMs": 1927.5999999940395,
"inferenceMs": 38.69999998807907,
"totalMs": 1966.2999999821186,
"charactersPerSecond": 775.1937986883987,
"grade": "excellent",
"actualDevice": "webgpu",
"actualPrecision": "q4",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
"gpuForwardQueueObserved": true,
"acceleration": "partial"
}
},
{
"precision": "q4",
"device": "webgpu",
"status": "pass",
"quality": {
"passed": true,
"validOffsetsAndScores": true,
"precision": 1,
"recall": 1,
"f1": 1,
"referenceCoverage": "complete"
},
"runtime": {
"loadMs": 1927.5999999940395,
"inferenceMs": 22.299999982118607,
"totalMs": 1949.8999999761581,
"charactersPerSecond": 1973.0941719857253,
"grade": "excellent",
"actualDevice": "webgpu",
"actualPrecision": "q4",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
"gpuForwardQueueObserved": true,
"acceleration": "partial"
}
},
{
"precision": "q4",
"device": "webgpu",
"status": "pass",
"quality": {
"passed": true,
"validOffsetsAndScores": true,
"precision": 1,
"recall": 1,
"f1": 1,
"referenceCoverage": "complete"
},
"runtime": {
"loadMs": 1927.5999999940395,
"inferenceMs": 22.599999994039536,
"totalMs": 1950.199999988079,
"charactersPerSecond": 1238.9380534240993,
"grade": "excellent",
"actualDevice": "webgpu",
"actualPrecision": "q4",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
"gpuForwardQueueObserved": true,
"acceleration": "partial"
}
},
{
"precision": "q4",
"device": "webgpu",
"status": "pass",
"quality": {
"passed": true,
"validOffsetsAndScores": true,
"precision": 1,
"recall": 1,
"f1": 1,
"referenceCoverage": "complete"
},
"runtime": {
"loadMs": 1927.5999999940395,
"inferenceMs": 65.19999998807907,
"totalMs": 1992.7999999821186,
"charactersPerSecond": 659.5092025745699,
"grade": "excellent",
"actualDevice": "webgpu",
"actualPrecision": "q4",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa",
"gpuForwardQueueObserved": true,
"acceleration": "partial"
}
},
{
"precision": "q8",
"device": "wasm",
"status": "pass",
"quality": {
"passed": true,
"finite": true,
"recall": 1,
"precision": 0.5,
"f1": 0.6666666666666666,
"referenceCoverage": "selected-entities"
},
"runtime": {
"loadMs": 1690.2000000178814,
"inferenceMs": 194.90000000596046,
"totalMs": 1885.1000000238419,
"charactersPerSecond": 1005.6439199281986,
"grade": "good",
"actualPrecision": "q8",
"actualDevice": "wasm",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa"
}
},
{
"precision": "q8",
"device": "wasm",
"status": "pass",
"quality": {
"passed": true,
"finite": true,
"recall": 1,
"precision": 1,
"f1": 1,
"referenceCoverage": "complete"
},
"runtime": {
"loadMs": 1690.2000000178814,
"inferenceMs": 54.900000005960464,
"totalMs": 1745.1000000238419,
"charactersPerSecond": 746.8123860755675,
"grade": "excellent",
"actualPrecision": "q8",
"actualDevice": "wasm",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa"
}
},
{
"precision": "q8",
"device": "wasm",
"status": "pass",
"quality": {
"passed": true,
"finite": true,
"recall": 1,
"precision": 1,
"f1": 1,
"referenceCoverage": "complete"
},
"runtime": {
"loadMs": 1690.2000000178814,
"inferenceMs": 40.5,
"totalMs": 1730.7000000178814,
"charactersPerSecond": 740.7407407407408,
"grade": "excellent",
"actualPrecision": "q8",
"actualDevice": "wasm",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa"
}
},
{
"precision": "q8",
"device": "wasm",
"status": "pass",
"quality": {
"passed": true,
"finite": true,
"recall": 1,
"precision": 1,
"f1": 1,
"referenceCoverage": "complete"
},
"runtime": {
"loadMs": 1690.2000000178814,
"inferenceMs": 56.099999994039536,
"totalMs": 1746.300000011921,
"charactersPerSecond": 784.3137255735272,
"grade": "excellent",
"actualPrecision": "q8",
"actualDevice": "wasm",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa"
}
},
{
"precision": "q8",
"device": "wasm",
"status": "pass",
"quality": {
"passed": true,
"finite": true,
"recall": 1,
"precision": 1,
"f1": 1,
"referenceCoverage": "complete"
},
"runtime": {
"loadMs": 1690.2000000178814,
"inferenceMs": 40.60000002384186,
"totalMs": 1730.8000000417233,
"charactersPerSecond": 689.6551720088015,
"grade": "excellent",
"actualPrecision": "q8",
"actualDevice": "wasm",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa"
}
},
{
"precision": "q8",
"device": "wasm",
"status": "pass",
"quality": {
"passed": true,
"finite": true,
"recall": 1,
"precision": 1,
"f1": 1,
"referenceCoverage": "complete"
},
"runtime": {
"loadMs": 1690.2000000178814,
"inferenceMs": 53.89999997615814,
"totalMs": 1744.0999999940395,
"charactersPerSecond": 797.7736552693952,
"grade": "excellent",
"actualPrecision": "q8",
"actualDevice": "wasm",
"fallback": false,
"version": "4.2.0",
"artifactRevision": "8e892123e8b7c2c0c2bd1dcb598b7d244c4e53aa"
}
}
]