A model is still running

A model is still running or downloading. Leaving will stop the current operation. Stay on this page to let it finish.

Skip to content
LocalAI.toolsBeta

Join the waitlist

Get an email when the new apps and model runs launch.

No account needed.

EttinX NLI

Explore text labels and scores, processed locally in your browser.

Browser inferencePowered by WebAI · Private · Unlimited runs
About this model

Compare two English statements to estimate whether the second follows from, contradicts, or is unrelated to the first. Returns scores for all three relationships; it is not a fact-checking service.

Created by
D. Lee Miller
License
MIT
Model released
Unknown
Source repository created
Sep 8, 2025
Model weights · Q8
32.4 MB

Best for

  • Compare whether one English statement entails, contradicts, or is neutral toward another.
  • Prototype lightweight claim consistency and LLM-output evaluation.
  • Benchmark browser NLI across ONNX precisions and backends.

Keep in mind

  • Designed primarily for English and may degrade on other languages or specialized domains.
  • Labels are probabilistic model judgments, not logical proofs or factuality guarantees.
  • Long inputs are truncated at the configured token limit and local attention can miss distant relationships.
  • Ambiguity, unstated world knowledge, negation, numerical reasoning, and adversarial phrasing can cause errors.
  • Do not use the classification alone for safety-critical or high-impact decisions.
  • Six short English sanity fixtures only; not broad factuality, formal-logic or multilingual validation.

Processed on your deviceInference runs in this browser. Input/output sharing requires consent for each run. Basic run logs include device information and approximate connection location. Model and runtime files download from external hosts. Saved downloads may be cleared by your browser.

Sources & technical details
Original model
dleemiller/EttinX-nli-xs
Release verification
Unknown
Release evidence
Exact original checkpoint public release date has not been verified. Repository creation, training, paper, artifact conversion and update dates are not release evidence.
Source updated
Sep 9, 2025
Browser model files
onnx-community/EttinX-nli-xs-ONNX
Files updated
Sep 1, 2026
Artifact revision
cf5995a136f48843191ba185bd3430e18b0ffc2f

Input

TEXT → LABELS

Sample result

EttinX NLI XS — 32M Cross-Encoder
Advanced settings 1
Maximum combined premise/hypothesis token count after truncation. Lower values may process less text but truncate relevant context sooner. Higher values retain more context, within the model limit, and can need more memory and time.

Output

Explore your text’s labels

Enter your text or try the sample to see predicted labels.

Benchmark evidence

Saved worker evidence is separate from benchmarks run on your device. It does not guarantee speed or quality on every browser.

EttinX NLI XS — 32M Cross-Encoder

58 configurations tested
Passed54
Failed4
TestedSep 15, 2026
RuntimeTransformers.js 4.2.0

Quality criteria

All six frozen cases must have the expected label and per-case minimum margin with finite normalized complete three-class probabilities. XS original three-case evidence reused with original times, plus independent three added cases; no sibling precision/backend inheritance.

PrecisionDeviceResult
Q4GPU · WebGPUAcceleratedPassedVery fast
FP32GPU · WebGPUAcceleratedPassedVery fast
Q4GPU · WebGPUAcceleratedPassedVery fast
BNB4GPU · WebGPUAcceleratedPassedVery fast
BNB4GPU · WebGPUAcceleratedPassedVery fast
FP32GPU · WebGPUAcceleratedPassedVery fast
UINT8GPU · WebGPUAcceleratedPassedVery fast
Q8GPU · WebGPUAcceleratedPassedVery fast
INT8GPU · WebGPUAcceleratedPassedVery fast
UINT8GPU · WebGPUAcceleratedPassedVery fast
Q8GPU · WebGPUAcceleratedPassedVery fast
INT8GPU · WebGPUAcceleratedPassedVery fast
FP32GPU · WebGPUAcceleratedPassedVery fast
BNB4GPU · WebGPUAcceleratedPassedVery fast
Q4GPU · WebGPUAcceleratedPassedVery fast
BNB4GPU · WebGPUAcceleratedPassedFast
Q8GPU · WebGPUAcceleratedPassedFast
INT8GPU · WebGPUAcceleratedPassedFast
UINT8GPU · WebGPUAcceleratedPassedFast
Q8GPU · WebGPUAcceleratedPassedFast
UINT8GPU · WebGPUAcceleratedPassedFast
Q4GPU · WebGPUAcceleratedPassedFast
INT8GPU · WebGPUAcceleratedPassedFast
FP32GPU · WebGPUAcceleratedPassedFast
FP32CPU · WASMPassedVery fast
FP32CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
INT8CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
UINT8CPU · WASMPassedVery fast
INT8CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
UINT8CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
BNB4CPU · WASMPassedVery fast
BNB4CPU · WASMPassedVery fast
Q4CPU · WASMPassedVery fast
Q4CPU · WASMPassedVery fast
FP32CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
INT8CPU · WASMPassedVery fast
UINT8CPU · WASMPassedVery fast
Q4CPU · WASMPassedVery fast
BNB4CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
FP32CPU · WASMPassedVery fast
INT8CPU · WASMPassedVery fast
UINT8CPU · WASMPassedVery fast
BNB4CPU · WASMPassedFast
Q4CPU · WASMPassedFast
FP16CPU · WASMFailed—
FP16GPU · WebGPUFailed—
Q4F16CPU · WASMFailed—
Q4F16GPU · WebGPUFailed—
Test setup & sample details
Quality gate
All six frozen cases must have the expected label and per-case minimum margin with finite normalized complete three-class probabilities. XS original three-case evidence reused with original times, plus independent three added cases; no sibling precision/backend inheritance.
Tested
2026-09-15T12:52:16.195Z
Environment
Isolated headless Chrome on macOS; Transformers.js 4.2.0
Runtime
Transformers.js 4.2.0
Artifact revision
cf5995a136f48843191ba185bd3430e18b0ffc2f
Fixture
{
  "file": "model-samples/browser/ettinx-nli/quality-gates.json",
  "url": "https://assets.localai.tools/samples/v1/files/85a255ca69a81f4851b7bb6dfe9bdd69be90fb6e769760ea6de1d3b4e2ddc207/ettinx-nli-quality-gates.json",
  "size": 2264,
  "sha1": "5fb79c4a66c12418e28abe244fd155713e8bd891",
  "sha256": "85a255ca69a81f4851b7bb6dfe9bdd69be90fb6e769760ea6de1d3b4e2ddc207"
}
Rerun when
artifact revision change; runtime version change; fixture or quality-gate change; browser/backend behavior change
Per-case quality & failure details
[
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "cases": [
        {
          "expected": "entailment",
          "actual": "entailment",
          "finite": true,
          "margin": 0.9348974209781319,
          "minimumMargin": 0.3,
          "pass": true
        },
        {
          "expected": "contradiction",
          "actual": "contradiction",
          "finite": true,
          "margin": 0.9997462882602456,
          "minimumMargin": 0.3,
          "pass": true
        },
        {
          "expected": "entailment",
          "actual": "entailment",
          "finite": true,
          "margin": 0.9828258181954121,
          "minimumMargin": 0.15,
          "pass": true
        }
      ],
      "grade": "nli-pass"
    },
    "runtime": {
      "loadMs": 9634.600000023842,
      "inferenceMs": 69.7999999821186,
      "totalMs": 9798,
      "grade": "excellent",
      "pairsPerSecond": 42.97994270442036
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "cases": [
        {
          "expected": "entailment",
          "actual": "entailment",
          "finite": true,
          "margin": 0.9348975111783933,
          "minimumMargin": 0.3,
          "pass": true
        },
        {
          "expected": "contradiction",
          "actual": "contradiction",
          "finite": true,
          "margin": 0.9997462882143131,
          "minimumMargin": 0.3,
          "pass": true
        },
        {
          "expected": "entailment",
          "actual": "entailment",
          "finite": true,
          "margin": 0.982825985060039,
          "minimumMargin": 0.15,
          "pass": true
        }
      ],
      "grade": "nli-pass"
    },
    "runtime": {
      "loadMs": 10304.59999999404,
      "inferenceMs": 317.80000001192093,
      "totalMs": 10722.09999999404,
      "grade": "good",
      "pairsPerSecond": 9.43989930738662
    }
  },
  {
    "precision": "fp16",
    "device": "wasm",
    "status": "fail",
    "quality": "Not embedded",
    "runtime": {
      "loadMs": null,
      "inferenceMs": null,
      "totalMs": 5229.300000011921,
      "grade": "failed"
    },
    "failure": "Error: Can't create a session. ERROR_CODE: 1, ERROR_MESSAGE: Type Error: Type (tensor(float16)) of output arg (/Cast_1_output_0) of node (/Cast_1) does not match expected type (tensor(float))."
  },
  {
    "precision": "fp16",
    "device": "webgpu",
    "status": "fail",
    "quality": "Not embedded",
    "runtime": {
      "loadMs": null,
      "inferenceMs": null,
      "totalMs": 5037.899999976158,
      "grade": "failed"
    },
    "failure": "Error: Can't create a session. ERROR_CODE: 1, ERROR_MESSAGE: Type Error: Type (tensor(float16)) of output arg (/Cast_1_output_0) of node (/Cast_1) does not match expected type (tensor(float))."
  },
  {
    "precision": "int8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "cases": [
        {
          "expected": "entailment",
          "actual": "entailment",
          "finite": true,
          "margin": 0.9421899525497719,
          "minimumMargin": 0.3,
          "pass": true
        },
        {
          "expected": "contradiction",
          "actual": "contradiction",
          "finite": true,
          "margin": 0.9992550970649349,
          "minimumMargin": 0.3,
          "pass": true
        },
        {
          "expected": "entailment",
          "actual": "entailment",
          "finite": true,
          "margin": 0.9708945043089913,
          "minimumMargin": 0.15,
          "pass": true
        }
      ],
      "grade": "nli-pass"
    },
    "runtime": {
      "loadMs": 4269.4000000059605,
      "inferenceMs": 71,
      "totalMs": 4523.299999982119,
      "grade": "excellent",
      "pairsPerSecond": 42.25352112676056
    }
  },
  {
    "precision": "int8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "cases": [
        {
          "expected": "entailment",
          "actual": "entailment",
          "finite": true,
          "margin": 0.9421898516197966,
          "minimumMargin": 0.3,
          "pass": true
        },
        {
          "expected": "contradiction",
          "actual": "contradiction",
          "finite": true,
          "margin": 0.9992550970649349,
          "minimumMargin": 0.3,
          "pass": true
        },
        {
          "expected": "entailment",
          "actual": "entailment",
          "finite": true,
          "margin": 0.9708945164656116,
          "minimumMargin": 0.15,
          "pass": true
        }
      ],
      "grade": "nli-pass"
    },
    "runtime": {
      "loadMs": 4394.0999999940395,
      "inferenceMs": 289.90000000596046,
      "totalMs": 4780.5,
      "grade": "good",
      "pairsPerSecond": 10.348395998407447
    }
  },
  {
    "precision": "uint8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "cases": [
        {
          "expected": "entailment",
          "actual": "entailment",
          "finite": true,
          "margin": 0.9077236297893401,
          "minimumMargin": 0.3,
          "pass": true
        },
        {
          "expected": "contradiction",
          "actual": "contradiction",
          "finite": true,
          "margin": 0.999403466661996,
          "minimumMargin": 0.3,
          "pass": true
        },
        {
          "expected": "entailment",
          "actual": "entailment",
          "finite": true,
          "margin": 0.9694324941237493,
          "minimumMargin": 0.15,
          "pass": true
        }
      ],
      "grade": "nli-pass"
    },
    "runtime": {
      "loadMs": 4948.199999988079,
      "inferenceMs": 71.5,
      "totalMs": 5160.0999999940395,
      "grade": "excellent",
      "pairsPerSecond": 41.95804195804196
    }
  },
  {
    "precision": "uint8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "cases": [
        {
          "expected": "entailment",
          "actual": "entailment",
          "finite": true,
          "margin": 0.9077237456137992,
          "minimumMargin": 0.3,
          "pass": true
        },
        {
          "expected": "contradiction",
          "actual": "contradiction",
          "finite": true,
          "margin": 0.9994034653005069,
          "minimumMargin": 0.3,
          "pass": true
        },
        {
          "expected": "entailment",
          "actual": "entailment",
          "finite": true,
          "margin": 0.9684620590199027,
          "minimumMargin": 0.15,
          "pass": true
        }
      ],
      "grade": "nli-pass"
    },
    "runtime": {
      "loadMs": 4201.5,
      "inferenceMs": 206.90000000596046,
      "totalMs": 4581.100000023842,
      "grade": "good",
      "pairsPerSecond": 14.499758336943328
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "cases": [
        {
          "expected": "entailment",
          "actual": "entailment",
          "finite": true,
          "margin": 0.9421899525497719,
          "minimumMargin": 0.3,
          "pass": true
        },
        {
          "expected": "contradiction",
          "actual": "contradiction",
          "finite": true,
          "margin": 0.9992550970649349,
          "minimumMargin": 0.3,
          "pass": true
        },
        {
          "expected": "entailment",
          "actual": "entailment",
          "finite": true,
          "margin": 0.9708945043089913,
          "minimumMargin": 0.15,
          "pass": true
        }
      ],
      "grade": "nli-pass"
    },
    "runtime": {
      "loadMs": 4252.800000011921,
      "inferenceMs": 68.80000001192093,
      "totalMs": 4427.699999988079,
      "grade": "excellent",
      "pairsPerSecond": 43.604651155235345
    }
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "cases": [
        {
          "expected": "entailment",
          "actual": "entailment",
          "finite": true,
          "margin": 0.9421898516197966,
          "minimumMargin": 0.3,
          "pass": true
        },
        {
          "expected": "contradiction",
          "actual": "contradiction",
          "finite": true,
          "margin": 0.9992550970649349,
          "minimumMargin": 0.3,
          "pass": true
        },
        {
          "expected": "entailment",
          "actual": "entailment",
          "finite": true,
          "margin": 0.9708945164656116,
          "minimumMargin": 0.15,
          "pass": true
        }
      ],
      "grade": "nli-pass"
    },
    "runtime": {
      "loadMs": 4123.800000011921,
      "inferenceMs": 202.19999998807907,
      "totalMs": 4412.5,
      "grade": "good",
      "pairsPerSecond": 14.836795253100238
    }
  },
  {
    "precision": "q4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "cases": [
        {
          "expected": "entailment",
          "actual": "entailment",
          "finite": true,
          "margin": 0.8586604888902396,
          "minimumMargin": 0.3,
          "pass": true
        },
        {
          "expected": "contradiction",
          "actual": "contradiction",
          "finite": true,
          "margin": 0.9995681430491034,
          "minimumMargin": 0.3,
          "pass": true
        },
        {
          "expected": "entailment",
          "actual": "entailment",
          "finite": true,
          "margin": 0.931758709483561,
          "minimumMargin": 0.15,
          "pass": true
        }
      ],
      "grade": "nli-pass"
    },
    "runtime": {
      "loadMs": 25404.70000001788,
      "inferenceMs": 106.19999998807907,
      "totalMs": 29241,
      "grade": "excellent",
      "pairsPerSecond": 28.248587573792367
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "cases": [
        {
          "expected": "entailment",
          "actual": "entailment",
          "finite": true,
          "margin": 0.8586619773056341,
          "minimumMargin": 0.3,
          "pass": true
        },
        {
          "expected": "contradiction",
          "actual": "contradiction",
          "finite": true,
          "margin": 0.9995681412532368,
          "minimumMargin": 0.3,
          "pass": true
        },
        {
          "expected": "entailment",
          "actual": "entailment",
          "finite": true,
          "margin": 0.9317590704410151,
          "minimumMargin": 0.15,
          "pass": true
        }
      ],
      "grade": "nli-pass"
    },
    "runtime": {
      "loadMs": 18898.5,
      "inferenceMs": 288.40000000596046,
      "totalMs": 21088.30000001192,
      "grade": "good",
      "pairsPerSecond": 10.402219139868231
    }
  },
  {
    "precision": "q4f16",
    "device": "wasm",
    "status": "fail",
    "quality": "Not embedded",
    "runtime": {
      "loadMs": null,
      "inferenceMs": null,
      "totalMs": 16376.5,
      "grade": "failed"
    },
    "failure": "Error: Can't create a session. ERROR_CODE: 1, ERROR_MESSAGE: Type Error: Type (tensor(float16)) of output arg (/Cast_1_output_0) of node (/Cast_1) does not match expected type (tensor(float))."
  },
  {
    "precision": "q4f16",
    "device": "webgpu",
    "status": "fail",
    "quality": "Not embedded",
    "runtime": {
      "loadMs": null,
      "inferenceMs": null,
      "totalMs": 15038.299999982119,
      "grade": "failed"
    },
    "failure": "Error: Can't create a session. ERROR_CODE: 1, ERROR_MESSAGE: Type Error: Type (tensor(float16)) of output arg (/Cast_1_output_0) of node (/Cast_1) does not match expected type (tensor(float))."
  },
  {
    "precision": "bnb4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "cases": [
        {
          "expected": "entailment",
          "actual": "entailment",
          "finite": true,
          "margin": 0.8586604888902396,
          "minimumMargin": 0.3,
          "pass": true
        },
        {
          "expected": "contradiction",
          "actual": "contradiction",
          "finite": true,
          "margin": 0.9995681430491034,
          "minimumMargin": 0.3,
          "pass": true
        },
        {
          "expected": "entailment",
          "actual": "entailment",
          "finite": true,
          "margin": 0.931758709483561,
          "minimumMargin": 0.15,
          "pass": true
        }
      ],
      "grade": "nli-pass"
    },
    "runtime": {
      "loadMs": 19335.40000000596,
      "inferenceMs": 105.40000000596046,
      "totalMs": 20751.19999998808,
      "grade": "excellent",
      "pairsPerSecond": 28.462998100857185
    }
  },
  {
    "precision": "bnb4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "cases": [
        {
          "expected": "entailment",
          "actual": "entailment",
          "finite": true,
          "margin": 0.8586619773056341,
          "minimumMargin": 0.3,
          "pass": true
        },
        {
          "expected": "contradiction",
          "actual": "contradiction",
          "finite": true,
          "margin": 0.9995681412532368,
          "minimumMargin": 0.3,
          "pass": true
        },
        {
          "expected": "entailment",
          "actual": "entailment",
          "finite": true,
          "margin": 0.9317590704410151,
          "minimumMargin": 0.15,
          "pass": true
        }
      ],
      "grade": "nli-pass"
    },
    "runtime": {
      "loadMs": 20732.09999999404,
      "inferenceMs": 113.90000000596046,
      "totalMs": 22250.600000023842,
      "grade": "excellent",
      "pairsPerSecond": 26.338893765083476
    }
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9937077714710486,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1908.9000000059605,
      "inferenceMs": 31.099999994039536,
      "totalMs": 1940,
      "pairsPerSecond": 32.154340842175394,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "contradiction",
      "margin": 0.9895947333553039,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1908.9000000059605,
      "inferenceMs": 10.299999982118607,
      "totalMs": 1919.199999988079,
      "pairsPerSecond": 97.08737880932598,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9861083342119112,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1908.9000000059605,
      "inferenceMs": 10.5,
      "totalMs": 1919.4000000059605,
      "pairsPerSecond": 95.23809523809524,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9937077683645019,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1958.9000000059605,
      "inferenceMs": 85.09999999403954,
      "totalMs": 2044,
      "pairsPerSecond": 11.750881316921747,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "contradiction",
      "margin": 0.9895947361146832,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1958.9000000059605,
      "inferenceMs": 28.600000023841858,
      "totalMs": 1987.5000000298023,
      "pairsPerSecond": 34.96503493588701,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9861082919168208,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1958.9000000059605,
      "inferenceMs": 21.099999994039536,
      "totalMs": 1980,
      "pairsPerSecond": 47.393364942297936,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "int8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9763729440912856,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 916.3999999761581,
      "inferenceMs": 34.29999998211861,
      "totalMs": 950.6999999582767,
      "pairsPerSecond": 29.154518965636253,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "int8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "contradiction",
      "margin": 0.9838062331929446,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 916.3999999761581,
      "inferenceMs": 11.5,
      "totalMs": 927.8999999761581,
      "pairsPerSecond": 86.95652173913044,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "int8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.978804847561861,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 916.3999999761581,
      "inferenceMs": 11.799999982118607,
      "totalMs": 928.1999999582767,
      "pairsPerSecond": 84.74576284028579,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "int8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9762451474043524,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 960,
      "inferenceMs": 125.69999998807907,
      "totalMs": 1085.699999988079,
      "pairsPerSecond": 7.955449483650249,
      "grade": "good",
      "actualDevice": "webgpu",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "int8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "contradiction",
      "margin": 0.9838062150472762,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 960,
      "inferenceMs": 58.30000001192093,
      "totalMs": 1018.3000000119209,
      "pairsPerSecond": 17.152658658585324,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "int8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9788048684966374,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 960,
      "inferenceMs": 52.900000005960464,
      "totalMs": 1012.9000000059605,
      "pairsPerSecond": 18.90359168028971,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "uint8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9933587858816335,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1007.6999999880791,
      "inferenceMs": 34.900000005960464,
      "totalMs": 1042.5999999940395,
      "pairsPerSecond": 28.65329512404622,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "uint8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "contradiction",
      "margin": 0.9152550423406945,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1007.6999999880791,
      "inferenceMs": 11.600000023841858,
      "totalMs": 1019.3000000119209,
      "pairsPerSecond": 86.20689637454029,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "uint8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9879818206585347,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1007.6999999880791,
      "inferenceMs": 12.299999982118607,
      "totalMs": 1019.9999999701977,
      "pairsPerSecond": 81.30081312632291,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "uint8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9933588004329331,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 981.1999999880791,
      "inferenceMs": 129.2999999821186,
      "totalMs": 1110.4999999701977,
      "pairsPerSecond": 7.733952050566851,
      "grade": "good",
      "actualDevice": "webgpu",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "uint8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "contradiction",
      "margin": 0.9152550219595118,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 981.1999999880791,
      "inferenceMs": 53.60000002384186,
      "totalMs": 1034.800000011921,
      "pairsPerSecond": 18.65671640961174,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "uint8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9879818161374019,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 981.1999999880791,
      "inferenceMs": 49.29999998211861,
      "totalMs": 1030.4999999701977,
      "pairsPerSecond": 20.283975666586322,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9763729440912856,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 906.4000000059605,
      "inferenceMs": 34.099999994039536,
      "totalMs": 940.5,
      "pairsPerSecond": 29.325513201606853,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "contradiction",
      "margin": 0.9838062331929446,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 906.4000000059605,
      "inferenceMs": 11.599999994039536,
      "totalMs": 918,
      "pairsPerSecond": 86.2068965960201,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.978804847561861,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 906.4000000059605,
      "inferenceMs": 12.100000023841858,
      "totalMs": 918.5000000298023,
      "pairsPerSecond": 82.64462793633045,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9762451474043524,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 976.7999999821186,
      "inferenceMs": 122,
      "totalMs": 1098.7999999821186,
      "pairsPerSecond": 8.19672131147541,
      "grade": "good",
      "actualDevice": "webgpu",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "contradiction",
      "margin": 0.9838062150472762,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 976.7999999821186,
      "inferenceMs": 56.599999994039536,
      "totalMs": 1033.3999999761581,
      "pairsPerSecond": 17.667844524828773,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9788048684966374,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 976.7999999821186,
      "inferenceMs": 50.30000001192093,
      "totalMs": 1027.0999999940395,
      "pairsPerSecond": 19.880715701053745,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9835005489209638,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1197.2999999821186,
      "inferenceMs": 46.19999998807907,
      "totalMs": 1243.4999999701977,
      "pairsPerSecond": 21.645021650606683,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "contradiction",
      "margin": 0.9875688396313099,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1197.2999999821186,
      "inferenceMs": 23.80000001192093,
      "totalMs": 1221.0999999940395,
      "pairsPerSecond": 42.01680670164372,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9772584155029673,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1197.2999999821186,
      "inferenceMs": 23.69999998807907,
      "totalMs": 1220.9999999701977,
      "pairsPerSecond": 42.19409284822754,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9835005392242704,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1233.5999999940395,
      "inferenceMs": 87.30000001192093,
      "totalMs": 1320.9000000059605,
      "pairsPerSecond": 11.454753721230798,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "contradiction",
      "margin": 0.9875688545978833,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1233.5999999940395,
      "inferenceMs": 22.5,
      "totalMs": 1256.0999999940395,
      "pairsPerSecond": 44.44444444444444,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9772584580200314,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1233.5999999940395,
      "inferenceMs": 19.400000005960464,
      "totalMs": 1253,
      "pairsPerSecond": 51.54639173674018,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "bnb4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9835005489209638,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1262.199999988079,
      "inferenceMs": 46.20000001788139,
      "totalMs": 1308.4000000059605,
      "pairsPerSecond": 21.64502163664409,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "bnb4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "contradiction",
      "margin": 0.9875688396313099,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1262.199999988079,
      "inferenceMs": 23.099999994039536,
      "totalMs": 1285.2999999821186,
      "pairsPerSecond": 43.290043301213366,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "bnb4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9772584155029673,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1262.199999988079,
      "inferenceMs": 23.599999994039536,
      "totalMs": 1285.7999999821186,
      "pairsPerSecond": 42.37288136663398,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "bnb4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9835005392242704,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1301.300000011921,
      "inferenceMs": 85.90000000596046,
      "totalMs": 1387.2000000178814,
      "pairsPerSecond": 11.641443538191055,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "bnb4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "contradiction",
      "margin": 0.9875688545978833,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1301.300000011921,
      "inferenceMs": 26.5,
      "totalMs": 1327.800000011921,
      "pairsPerSecond": 37.735849056603776,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "bnb4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9772584580200314,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1301.300000011921,
      "inferenceMs": 22.69999998807907,
      "totalMs": 1324,
      "pairsPerSecond": 44.05286345925776,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "actualLabel": "entailment",
      "expectedLabel": "entailment",
      "margin": 0.9421899525497719,
      "minimumMargin": 0.3
    },
    "runtime": {
      "loadMs": 1296.7999999821186,
      "inferenceMs": 33.099999994039536,
      "totalMs": 1329.8999999761581,
      "pairsPerSecond": 30.21148036797808,
      "grade": "excellent",
      "actualPrecision": "q8",
      "actualDevice": "wasm",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "actualLabel": "contradiction",
      "expectedLabel": "contradiction",
      "margin": 0.9992550970649349,
      "minimumMargin": 0.3
    },
    "runtime": {
      "loadMs": 1296.7999999821186,
      "inferenceMs": 19.099999994039536,
      "totalMs": 1315.8999999761581,
      "pairsPerSecond": 52.356020958746925,
      "grade": "excellent",
      "actualPrecision": "q8",
      "actualDevice": "wasm",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "actualLabel": "entailment",
      "expectedLabel": "entailment",
      "margin": 0.9708945043089913,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1296.7999999821186,
      "inferenceMs": 13.100000023841858,
      "totalMs": 1309.9000000059605,
      "pairsPerSecond": 76.33587772366495,
      "grade": "excellent",
      "actualPrecision": "q8",
      "actualDevice": "wasm",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "actualLabel": "neutral",
      "expectedLabel": "neutral",
      "margin": 0.9763729440912856,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1296.7999999821186,
      "inferenceMs": 11.900000005960464,
      "totalMs": 1308.699999988079,
      "pairsPerSecond": 84.03361340328745,
      "grade": "excellent",
      "actualPrecision": "q8",
      "actualDevice": "wasm",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "actualLabel": "contradiction",
      "expectedLabel": "contradiction",
      "margin": 0.9838062331929446,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1296.7999999821186,
      "inferenceMs": 11,
      "totalMs": 1307.7999999821186,
      "pairsPerSecond": 90.9090909090909,
      "grade": "excellent",
      "actualPrecision": "q8",
      "actualDevice": "wasm",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "actualLabel": "neutral",
      "expectedLabel": "neutral",
      "margin": 0.978804847561861,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1296.7999999821186,
      "inferenceMs": 12.099999994039536,
      "totalMs": 1308.8999999761581,
      "pairsPerSecond": 82.64462813988433,
      "grade": "excellent",
      "actualPrecision": "q8",
      "actualDevice": "wasm",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "cf5995a136f48843191ba185bd3430e18b0ffc2f"
    }
  }
]

EttinX NLI XXS — 17M Cross-Encoder

82 configurations tested
Passed68
Failed14
TestedNov 12, 2026
RuntimeTransformers.js 4.2.0

Quality criteria

All six frozen cases must have the expected label and per-case minimum margin with finite normalized complete three-class probabilities. XS original three-case evidence reused with original times, plus independent three added cases; no sibling precision/backend inheritance.

PrecisionDeviceResult
FP32GPU · WebGPUAcceleratedPassedVery fast
BNB4GPU · WebGPUAcceleratedPassedVery fast
BNB4GPU · WebGPUAcceleratedPassedVery fast
Q4GPU · WebGPUAcceleratedPassedVery fast
BNB4GPU · WebGPUAcceleratedPassedVery fast
Q4GPU · WebGPUAcceleratedPassedVery fast
FP32GPU · WebGPUAcceleratedPassedVery fast
Q4GPU · WebGPUAcceleratedPassedVery fast
FP32GPU · WebGPUAcceleratedPassedVery fast
FP32GPU · WebGPUAcceleratedPassedVery fast
BNB4GPU · WebGPUAcceleratedPassedVery fast
Q4GPU · WebGPUAcceleratedPassedVery fast
FP32GPU · WebGPUAcceleratedPassedVery fast
INT8GPU · WebGPUAcceleratedPassedVery fast
INT8GPU · WebGPUAcceleratedPassedVery fast
Q8GPU · WebGPUAcceleratedPassedVery fast
Q8GPU · WebGPUAcceleratedPassedVery fast
UINT8GPU · WebGPUAcceleratedPassedVery fast
Q8GPU · WebGPUAcceleratedPassedVery fast
UINT8GPU · WebGPUAcceleratedPassedVery fast
INT8GPU · WebGPUAcceleratedPassedVery fast
Q8GPU · WebGPUAcceleratedPassedVery fast
INT8GPU · WebGPUAcceleratedPassedVery fast
UINT8GPU · WebGPUAcceleratedPassedVery fast
UINT8GPU · WebGPUAcceleratedPassedVery fast
BNB4GPU · WebGPUAcceleratedPassedVery fast
Q4GPU · WebGPUAcceleratedPassedFast
UINT8GPU · WebGPUAcceleratedPassedFast
Q8GPU · WebGPUAcceleratedPassedFast
INT8GPU · WebGPUAcceleratedPassedFast
FP32GPU · WebGPUAcceleratedPassedFast
FP32CPU · WASMPassedVery fast
FP32CPU · WASMPassedVery fast
FP32CPU · WASMPassedVery fast
FP32CPU · WASMPassedVery fast
FP32CPU · WASMPassedVery fast
FP32CPU · WASMPassedVery fast
UINT8CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
INT8CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
FP32CPU · WASMPassedVery fast
INT8CPU · WASMPassedVery fast
FP32CPU · WASMPassedVery fast
UINT8CPU · WASMPassedVery fast
INT8CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
UINT8CPU · WASMPassedVery fast
FP32CPU · WASMPassedVery fast
FP32CPU · WASMPassedVery fast
INT8CPU · WASMPassedVery fast
Q4CPU · WASMPassedVery fast
BNB4CPU · WASMPassedVery fast
UINT8CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
BNB4CPU · WASMPassedVery fast
Q4CPU · WASMPassedVery fast
BNB4CPU · WASMPassedVery fast
Q4CPU · WASMPassedVery fast
Q4CPU · WASMPassedVery fast
BNB4CPU · WASMPassedVery fast
FP32CPU · WASMPassedVery fast
FP32CPU · WASMPassedVery fast
Q8CPU · WASMPassedVery fast
INT8CPU · WASMPassedVery fast
UINT8CPU · WASMPassedVery fast
Q4CPU · WASMPassedVery fast
BNB4CPU · WASMPassedVery fast
INT8CPU · WASMFailed—
INT8GPU · WebGPUFailed—
UINT8CPU · WASMFailed—
UINT8GPU · WebGPUFailed—
Q8CPU · WASMFailed—
Q8GPU · WebGPUFailed—
Q4CPU · WASMFailed—
Q4GPU · WebGPUFailed—
BNB4CPU · WASMFailed—
BNB4GPU · WebGPUFailed—
FP16CPU · WASMFailed—
FP16GPU · WebGPUFailed—
Q4F16CPU · WASMFailed—
Q4F16GPU · WebGPUFailed—
Test setup & sample details
Quality gate
All six frozen cases must have the expected label and per-case minimum margin with finite normalized complete three-class probabilities. XS original three-case evidence reused with original times, plus independent three added cases; no sibling precision/backend inheritance.
Tested
2026-11-12T22:06:35.923Z
Environment
Isolated headless Chrome on macOS; Transformers.js 4.2.0
Runtime
Transformers.js 4.2.0
Artifact revision
73b90d860eddcece951b2f6776145fbc4df5be77
Fixture
{
  "file": "model-samples/browser/ettinx-nli/quality-gates.json",
  "url": "https://assets.localai.tools/samples/v1/files/85a255ca69a81f4851b7bb6dfe9bdd69be90fb6e769760ea6de1d3b4e2ddc207/ettinx-nli-quality-gates.json",
  "size": 2264,
  "sha1": "5fb79c4a66c12418e28abe244fd155713e8bd891",
  "sha256": "85a255ca69a81f4851b7bb6dfe9bdd69be90fb6e769760ea6de1d3b4e2ddc207"
}
Rerun when
artifact revision change; runtime version change; fixture or quality-gate change; browser/backend behavior change
Per-case quality & failure details
[
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "entailment",
      "actualLabel": "entailment",
      "margin": 0.9350984861121548,
      "minimumMargin": 0.3
    },
    "runtime": {
      "loadMs": 1608.300000011921,
      "inferenceMs": 23.69999998807907,
      "totalMs": 1632,
      "pairsPerSecond": 42.19409284822754,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "contradiction",
      "margin": 0.9994085136875476,
      "minimumMargin": 0.3
    },
    "runtime": {
      "loadMs": 1608.300000011921,
      "inferenceMs": 7.199999988079071,
      "totalMs": 1615.5,
      "pairsPerSecond": 138.88888911884507,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "entailment",
      "actualLabel": "entailment",
      "margin": 0.9768407095158342,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1608.300000011921,
      "inferenceMs": 5,
      "totalMs": 1613.300000011921,
      "pairsPerSecond": 200,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9936191446056236,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1608.300000011921,
      "inferenceMs": 4.399999976158142,
      "totalMs": 1612.699999988079,
      "pairsPerSecond": 227.2727285042282,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "contradiction",
      "margin": 0.8207416211183234,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1608.300000011921,
      "inferenceMs": 4.0999999940395355,
      "totalMs": 1612.4000000059605,
      "pairsPerSecond": 243.90243937896875,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9908070544115444,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1608.300000011921,
      "inferenceMs": 4.299999982118607,
      "totalMs": 1612.5999999940395,
      "pairsPerSecond": 232.55814050196827,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "entailment",
      "actualLabel": "entailment",
      "margin": 0.9350985012586827,
      "minimumMargin": 0.3
    },
    "runtime": {
      "loadMs": 1174.300000011921,
      "inferenceMs": 265.40000000596046,
      "totalMs": 1439.7000000178814,
      "pairsPerSecond": 3.76789751310302,
      "grade": "good",
      "actualDevice": "webgpu",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "contradiction",
      "margin": 0.999408512176222,
      "minimumMargin": 0.3
    },
    "runtime": {
      "loadMs": 1174.300000011921,
      "inferenceMs": 14.599999994039536,
      "totalMs": 1188.9000000059605,
      "pairsPerSecond": 68.49315071289391,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "entailment",
      "actualLabel": "entailment",
      "margin": 0.9768407586680403,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1174.300000011921,
      "inferenceMs": 8.299999982118607,
      "totalMs": 1182.5999999940395,
      "pairsPerSecond": 120.4819279704078,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9936191625566761,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1174.300000011921,
      "inferenceMs": 15.5,
      "totalMs": 1189.800000011921,
      "pairsPerSecond": 64.51612903225806,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "contradiction",
      "margin": 0.8207435248027218,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1174.300000011921,
      "inferenceMs": 13.5,
      "totalMs": 1187.800000011921,
      "pairsPerSecond": 74.07407407407408,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9908070550986127,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1174.300000011921,
      "inferenceMs": 17.399999976158142,
      "totalMs": 1191.699999988079,
      "pairsPerSecond": 57.47126444656447,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "fp32",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "int8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "entailment",
      "actualLabel": "entailment",
      "margin": 0.9383783136290375,
      "minimumMargin": 0.3
    },
    "runtime": {
      "loadMs": 883.5,
      "inferenceMs": 25.899999976158142,
      "totalMs": 909.3999999761581,
      "pairsPerSecond": 38.6100386455805,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "int8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "contradiction",
      "margin": 0.9987182238128872,
      "minimumMargin": 0.3
    },
    "runtime": {
      "loadMs": 883.5,
      "inferenceMs": 7.699999988079071,
      "totalMs": 891.1999999880791,
      "pairsPerSecond": 129.87013007119126,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "int8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "entailment",
      "actualLabel": "entailment",
      "margin": 0.9600203728067864,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 883.5,
      "inferenceMs": 5.300000011920929,
      "totalMs": 888.8000000119209,
      "pairsPerSecond": 188.67924485863549,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "int8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9942391852034771,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 883.5,
      "inferenceMs": 4.9000000059604645,
      "totalMs": 888.4000000059605,
      "pairsPerSecond": 204.08163240481198,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "int8",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "passed": false,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "entailment",
      "margin": 0.9592294142072597,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 883.5,
      "inferenceMs": 4.699999988079071,
      "totalMs": 888.1999999880791,
      "pairsPerSecond": 212.76595798646125,
      "grade": "failed",
      "actualDevice": "wasm",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "int8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.2119948474763742,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 883.5,
      "inferenceMs": 4.600000023841858,
      "totalMs": 888.1000000238419,
      "pairsPerSecond": 217.39130322108423,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "int8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "entailment",
      "actualLabel": "entailment",
      "margin": 0.9383782707616056,
      "minimumMargin": 0.3
    },
    "runtime": {
      "loadMs": 932.9000000059605,
      "inferenceMs": 174,
      "totalMs": 1106.9000000059605,
      "pairsPerSecond": 5.747126436781609,
      "grade": "good",
      "actualDevice": "webgpu",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "int8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "contradiction",
      "margin": 0.9987520258449952,
      "minimumMargin": 0.3
    },
    "runtime": {
      "loadMs": 932.9000000059605,
      "inferenceMs": 34.20000001788139,
      "totalMs": 967.1000000238419,
      "pairsPerSecond": 29.2397660665834,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "int8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "entailment",
      "actualLabel": "entailment",
      "margin": 0.9600203892235909,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 932.9000000059605,
      "inferenceMs": 28.69999998807907,
      "totalMs": 961.5999999940395,
      "pairsPerSecond": 34.843205589385484,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "int8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9942391767635343,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 932.9000000059605,
      "inferenceMs": 34.69999998807907,
      "totalMs": 967.5999999940395,
      "pairsPerSecond": 28.818443813934945,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "int8",
    "device": "webgpu",
    "status": "fail",
    "quality": {
      "passed": false,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "entailment",
      "margin": 0.9601093577230962,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 932.9000000059605,
      "inferenceMs": 26.799999982118607,
      "totalMs": 959.6999999880791,
      "pairsPerSecond": 37.31343286071702,
      "grade": "failed",
      "actualDevice": "webgpu",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "int8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.2119948474763742,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 932.9000000059605,
      "inferenceMs": 31.799999982118607,
      "totalMs": 964.6999999880791,
      "pairsPerSecond": 31.446540898185784,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "int8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "uint8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "entailment",
      "actualLabel": "entailment",
      "margin": 0.9524276491522621,
      "minimumMargin": 0.3
    },
    "runtime": {
      "loadMs": 892.4000000059605,
      "inferenceMs": 26.30000001192093,
      "totalMs": 918.7000000178814,
      "pairsPerSecond": 38.02281367097843,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "uint8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "contradiction",
      "margin": 0.99829158648646,
      "minimumMargin": 0.3
    },
    "runtime": {
      "loadMs": 892.4000000059605,
      "inferenceMs": 8,
      "totalMs": 900.4000000059605,
      "pairsPerSecond": 125,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "uint8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "entailment",
      "actualLabel": "entailment",
      "margin": 0.9746504510953395,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 892.4000000059605,
      "inferenceMs": 5.700000017881393,
      "totalMs": 898.1000000238419,
      "pairsPerSecond": 175.438595940862,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "uint8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9909989742106378,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 892.4000000059605,
      "inferenceMs": 5.299999982118607,
      "totalMs": 897.6999999880791,
      "pairsPerSecond": 188.67924591959394,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "uint8",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "passed": false,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "entailment",
      "margin": 0.9512866541296199,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 892.4000000059605,
      "inferenceMs": 4.600000023841858,
      "totalMs": 897.0000000298023,
      "pairsPerSecond": 217.39130322108423,
      "grade": "failed",
      "actualDevice": "wasm",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "uint8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.8264800267398531,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 892.4000000059605,
      "inferenceMs": 4.5999999940395355,
      "totalMs": 897,
      "pairsPerSecond": 217.39130462951155,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "uint8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "entailment",
      "actualLabel": "entailment",
      "margin": 0.9524276491522621,
      "minimumMargin": 0.3
    },
    "runtime": {
      "loadMs": 881.8000000119209,
      "inferenceMs": 106.59999999403954,
      "totalMs": 988.4000000059605,
      "pairsPerSecond": 9.380863039924149,
      "grade": "good",
      "actualDevice": "webgpu",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "uint8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "contradiction",
      "margin": 0.9984724434129094,
      "minimumMargin": 0.3
    },
    "runtime": {
      "loadMs": 881.8000000119209,
      "inferenceMs": 36.599999994039536,
      "totalMs": 918.4000000059605,
      "pairsPerSecond": 27.322404376034267,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "uint8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "entailment",
      "actualLabel": "entailment",
      "margin": 0.9746504420468045,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 881.8000000119209,
      "inferenceMs": 34,
      "totalMs": 915.8000000119209,
      "pairsPerSecond": 29.41176470588235,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "uint8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9909989852839836,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 881.8000000119209,
      "inferenceMs": 36.099999994039536,
      "totalMs": 917.9000000059605,
      "pairsPerSecond": 27.700831029504428,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "uint8",
    "device": "webgpu",
    "status": "fail",
    "quality": {
      "passed": false,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "entailment",
      "margin": 0.9512865906490161,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 881.8000000119209,
      "inferenceMs": 30.099999994039536,
      "totalMs": 911.9000000059605,
      "pairsPerSecond": 33.222591368705054,
      "grade": "failed",
      "actualDevice": "webgpu",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "uint8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.8264800267398531,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 881.8000000119209,
      "inferenceMs": 33.5,
      "totalMs": 915.3000000119209,
      "pairsPerSecond": 29.850746268656717,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "uint8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "entailment",
      "actualLabel": "entailment",
      "margin": 0.9383783136290375,
      "minimumMargin": 0.3
    },
    "runtime": {
      "loadMs": 877.4000000059605,
      "inferenceMs": 24.19999998807907,
      "totalMs": 901.5999999940395,
      "pairsPerSecond": 41.322314069942166,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "contradiction",
      "margin": 0.9987182238128872,
      "minimumMargin": 0.3
    },
    "runtime": {
      "loadMs": 877.4000000059605,
      "inferenceMs": 8.099999994039536,
      "totalMs": 885.5,
      "pairsPerSecond": 123.45679021430368,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "entailment",
      "actualLabel": "entailment",
      "margin": 0.9600203728067864,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 877.4000000059605,
      "inferenceMs": 5.5999999940395355,
      "totalMs": 883,
      "pairsPerSecond": 178.57142876149442,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9942391852034771,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 877.4000000059605,
      "inferenceMs": 4.800000011920929,
      "totalMs": 882.2000000178814,
      "pairsPerSecond": 208.3333328159319,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "passed": false,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "entailment",
      "margin": 0.9592294142072597,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 877.4000000059605,
      "inferenceMs": 4.800000011920929,
      "totalMs": 882.2000000178814,
      "pairsPerSecond": 208.3333328159319,
      "grade": "failed",
      "actualDevice": "wasm",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.2119948474763742,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 877.4000000059605,
      "inferenceMs": 4.5999999940395355,
      "totalMs": 882,
      "pairsPerSecond": 217.39130462951155,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "entailment",
      "actualLabel": "entailment",
      "margin": 0.9383782707616056,
      "minimumMargin": 0.3
    },
    "runtime": {
      "loadMs": 956.4000000059605,
      "inferenceMs": 106.90000000596046,
      "totalMs": 1063.300000011921,
      "pairsPerSecond": 9.35453694989937,
      "grade": "good",
      "actualDevice": "webgpu",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "contradiction",
      "margin": 0.9987520258449952,
      "minimumMargin": 0.3
    },
    "runtime": {
      "loadMs": 956.4000000059605,
      "inferenceMs": 33.099999994039536,
      "totalMs": 989.5,
      "pairsPerSecond": 30.21148036797808,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "entailment",
      "actualLabel": "entailment",
      "margin": 0.9600203892235909,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 956.4000000059605,
      "inferenceMs": 32.400000005960464,
      "totalMs": 988.8000000119209,
      "pairsPerSecond": 30.864197525186267,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9942391767635343,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 956.4000000059605,
      "inferenceMs": 34.30000001192093,
      "totalMs": 990.7000000178814,
      "pairsPerSecond": 29.154518940304694,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "fail",
    "quality": {
      "passed": false,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "entailment",
      "margin": 0.9601093577230962,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 956.4000000059605,
      "inferenceMs": 30.69999998807907,
      "totalMs": 987.0999999940395,
      "pairsPerSecond": 32.573289914928466,
      "grade": "failed",
      "actualDevice": "webgpu",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.2119948474763742,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 956.4000000059605,
      "inferenceMs": 33.5,
      "totalMs": 989.9000000059605,
      "pairsPerSecond": 29.850746268656717,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q8",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "entailment",
      "actualLabel": "entailment",
      "margin": 0.941080574506218,
      "minimumMargin": 0.3
    },
    "runtime": {
      "loadMs": 1438.2000000178814,
      "inferenceMs": 27.599999994039536,
      "totalMs": 1465.800000011921,
      "pairsPerSecond": 36.23188406579561,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "contradiction",
      "margin": 0.9995407793659462,
      "minimumMargin": 0.3
    },
    "runtime": {
      "loadMs": 1438.2000000178814,
      "inferenceMs": 10.800000011920929,
      "totalMs": 1449.0000000298023,
      "pairsPerSecond": 92.59259249038985,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "entailment",
      "actualLabel": "entailment",
      "margin": 0.974452366199523,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1438.2000000178814,
      "inferenceMs": 9.099999994039536,
      "totalMs": 1447.300000011921,
      "pairsPerSecond": 109.89010996208748,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9932167021951046,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1438.2000000178814,
      "inferenceMs": 7.9000000059604645,
      "totalMs": 1446.1000000238419,
      "pairsPerSecond": 126.5822783855077,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q4",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "passed": false,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "entailment",
      "margin": 0.2727725984247315,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1438.2000000178814,
      "inferenceMs": 8.199999988079071,
      "totalMs": 1446.4000000059605,
      "pairsPerSecond": 121.95121968948438,
      "grade": "failed",
      "actualDevice": "wasm",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9909578959517175,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1438.2000000178814,
      "inferenceMs": 8.200000017881393,
      "totalMs": 1446.4000000357628,
      "pairsPerSecond": 121.95121924626125,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "entailment",
      "actualLabel": "entailment",
      "margin": 0.941080588046131,
      "minimumMargin": 0.3
    },
    "runtime": {
      "loadMs": 1359.9000000059605,
      "inferenceMs": 103.09999999403954,
      "totalMs": 1463,
      "pairsPerSecond": 9.699321048087414,
      "grade": "good",
      "actualDevice": "webgpu",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "contradiction",
      "margin": 0.9995407792336828,
      "minimumMargin": 0.3
    },
    "runtime": {
      "loadMs": 1359.9000000059605,
      "inferenceMs": 14.5,
      "totalMs": 1374.4000000059605,
      "pairsPerSecond": 68.96551724137932,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "entailment",
      "actualLabel": "entailment",
      "margin": 0.9744523583278167,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1359.9000000059605,
      "inferenceMs": 11.199999988079071,
      "totalMs": 1371.0999999940395,
      "pairsPerSecond": 89.28571438074721,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.993216738199461,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1359.9000000059605,
      "inferenceMs": 17.30000001192093,
      "totalMs": 1377.2000000178814,
      "pairsPerSecond": 57.80346816826179,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "fail",
    "quality": {
      "passed": false,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "entailment",
      "margin": 0.2727741719589165,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1359.9000000059605,
      "inferenceMs": 8.199999988079071,
      "totalMs": 1368.0999999940395,
      "pairsPerSecond": 121.95121968948438,
      "grade": "failed",
      "actualDevice": "webgpu",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9909579547107967,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1359.9000000059605,
      "inferenceMs": 12.900000005960464,
      "totalMs": 1372.800000011921,
      "pairsPerSecond": 77.51937980914329,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "q4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "bnb4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "entailment",
      "actualLabel": "entailment",
      "margin": 0.941080574506218,
      "minimumMargin": 0.3
    },
    "runtime": {
      "loadMs": 1083.6000000238419,
      "inferenceMs": 28.900000005960464,
      "totalMs": 1112.5000000298023,
      "pairsPerSecond": 34.60207611743099,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "bnb4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "contradiction",
      "margin": 0.9995407793659462,
      "minimumMargin": 0.3
    },
    "runtime": {
      "loadMs": 1083.6000000238419,
      "inferenceMs": 10.900000005960464,
      "totalMs": 1094.5000000298023,
      "pairsPerSecond": 91.743119215887,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "bnb4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "entailment",
      "actualLabel": "entailment",
      "margin": 0.974452366199523,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1083.6000000238419,
      "inferenceMs": 8.900000005960464,
      "totalMs": 1092.5000000298023,
      "pairsPerSecond": 112.35955048654887,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "bnb4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9932167021951046,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1083.6000000238419,
      "inferenceMs": 7.9000000059604645,
      "totalMs": 1091.5000000298023,
      "pairsPerSecond": 126.5822783855077,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "bnb4",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "passed": false,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "entailment",
      "margin": 0.2727725984247315,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1083.6000000238419,
      "inferenceMs": 8,
      "totalMs": 1091.6000000238419,
      "pairsPerSecond": 125,
      "grade": "failed",
      "actualDevice": "wasm",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "bnb4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9909578959517175,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1083.6000000238419,
      "inferenceMs": 8.099999994039536,
      "totalMs": 1091.7000000178814,
      "pairsPerSecond": 123.45679021430368,
      "grade": "excellent",
      "actualDevice": "wasm",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": false,
      "acceleration": "cpu"
    }
  },
  {
    "precision": "bnb4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "entailment",
      "actualLabel": "entailment",
      "margin": 0.941080588046131,
      "minimumMargin": 0.3
    },
    "runtime": {
      "loadMs": 1039.7000000178814,
      "inferenceMs": 87.69999998807907,
      "totalMs": 1127.4000000059605,
      "pairsPerSecond": 11.402508553431339,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "bnb4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "contradiction",
      "margin": 0.9995407792336828,
      "minimumMargin": 0.3
    },
    "runtime": {
      "loadMs": 1039.7000000178814,
      "inferenceMs": 11.100000023841858,
      "totalMs": 1050.8000000417233,
      "pairsPerSecond": 90.09008989658422,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "bnb4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "entailment",
      "actualLabel": "entailment",
      "margin": 0.9744523583278167,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1039.7000000178814,
      "inferenceMs": 9.799999982118607,
      "totalMs": 1049.5,
      "pairsPerSecond": 102.04081651271756,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "bnb4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.993216738199461,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1039.7000000178814,
      "inferenceMs": 16.19999998807907,
      "totalMs": 1055.9000000059605,
      "pairsPerSecond": 61.72839510715184,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "bnb4",
    "device": "webgpu",
    "status": "fail",
    "quality": {
      "passed": false,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "contradiction",
      "actualLabel": "entailment",
      "margin": 0.2727741719589165,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1039.7000000178814,
      "inferenceMs": 11.099999994039536,
      "totalMs": 1050.800000011921,
      "pairsPerSecond": 90.09009013846655,
      "grade": "failed",
      "actualDevice": "webgpu",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "bnb4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "allLabels": true,
      "expectedLabel": "neutral",
      "actualLabel": "neutral",
      "margin": 0.9909579547107967,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1039.7000000178814,
      "inferenceMs": 11.300000011920929,
      "totalMs": 1051.0000000298023,
      "pairsPerSecond": 88.49557512788058,
      "grade": "excellent",
      "actualDevice": "webgpu",
      "actualPrecision": "bnb4",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77",
      "gpuForwardQueueObserved": true,
      "acceleration": "partial"
    }
  },
  {
    "precision": "fp16",
    "device": "wasm",
    "status": "fail",
    "quality": "Not embedded",
    "runtime": {
      "loadMs": null,
      "inferenceMs": null,
      "totalMs": null,
      "grade": "failed"
    },
    "failure": "Error: page.evaluate: Error: [WorkerError:runtime_error] init: Can't create a session. ERROR_CODE: 1, ERROR_MESSAGE: Type Error: Type (tensor(float16)) of output arg (/Cast_1_output_0) of node (/Cast_1) does not match expected type (tensor(float)).\n    at createError (http://127.0.0.1:57167/dist/index.mjs:13:17)\n    at createWorkerError (http://127.0.0.1:57167/dist/index.mjs:29:10)\n    at WorkerManager.parseWorkerError (http://127.0.0.1:57167/dist/index.mjs:713:12)\n    at Worker.handleMessage (http://127.0.0.1:57167/dist/index.mjs:687:42)"
  },
  {
    "precision": "fp16",
    "device": "webgpu",
    "status": "fail",
    "quality": "Not embedded",
    "runtime": {
      "loadMs": null,
      "inferenceMs": null,
      "totalMs": null,
      "grade": "failed"
    },
    "failure": "Error: page.evaluate: Error: [WorkerError:runtime_error] init: Can't create a session. ERROR_CODE: 1, ERROR_MESSAGE: Type Error: Type (tensor(float16)) of output arg (/Cast_1_output_0) of node (/Cast_1) does not match expected type (tensor(float)).\n    at createError (http://127.0.0.1:57167/dist/index.mjs:13:17)\n    at createWorkerError (http://127.0.0.1:57167/dist/index.mjs:29:10)\n    at WorkerManager.parseWorkerError (http://127.0.0.1:57167/dist/index.mjs:713:12)\n    at Worker.handleMessage (http://127.0.0.1:57167/dist/index.mjs:687:42)"
  },
  {
    "precision": "q4f16",
    "device": "wasm",
    "status": "fail",
    "quality": "Not embedded",
    "runtime": {
      "loadMs": null,
      "inferenceMs": null,
      "totalMs": null,
      "grade": "failed"
    },
    "failure": "Error: page.evaluate: Error: [WorkerError:runtime_error] init: Can't create a session. ERROR_CODE: 1, ERROR_MESSAGE: Type Error: Type (tensor(float16)) of output arg (/Cast_1_output_0) of node (/Cast_1) does not match expected type (tensor(float)).\n    at createError (http://127.0.0.1:57167/dist/index.mjs:13:17)\n    at createWorkerError (http://127.0.0.1:57167/dist/index.mjs:29:10)\n    at WorkerManager.parseWorkerError (http://127.0.0.1:57167/dist/index.mjs:713:12)\n    at Worker.handleMessage (http://127.0.0.1:57167/dist/index.mjs:687:42)"
  },
  {
    "precision": "q4f16",
    "device": "webgpu",
    "status": "fail",
    "quality": "Not embedded",
    "runtime": {
      "loadMs": null,
      "inferenceMs": null,
      "totalMs": null,
      "grade": "failed"
    },
    "failure": "Error: page.evaluate: Error: [WorkerError:runtime_error] init: Can't create a session. ERROR_CODE: 1, ERROR_MESSAGE: Type Error: Type (tensor(float16)) of output arg (/Cast_1_output_0) of node (/Cast_1) does not match expected type (tensor(float)).\n    at createError (http://127.0.0.1:57167/dist/index.mjs:13:17)\n    at createWorkerError (http://127.0.0.1:57167/dist/index.mjs:29:10)\n    at WorkerManager.parseWorkerError (http://127.0.0.1:57167/dist/index.mjs:713:12)\n    at Worker.handleMessage (http://127.0.0.1:57167/dist/index.mjs:687:42)"
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "actualLabel": "entailment",
      "expectedLabel": "entailment",
      "margin": 0.9350984861121548,
      "minimumMargin": 0.3
    },
    "runtime": {
      "loadMs": 1203.5,
      "inferenceMs": 23.099999994039536,
      "totalMs": 1226.5999999940395,
      "pairsPerSecond": 43.290043301213366,
      "grade": "excellent",
      "actualPrecision": "fp32",
      "actualDevice": "wasm",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77"
    }
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "actualLabel": "contradiction",
      "expectedLabel": "contradiction",
      "margin": 0.9994085136875476,
      "minimumMargin": 0.3
    },
    "runtime": {
      "loadMs": 1203.5,
      "inferenceMs": 7.100000023841858,
      "totalMs": 1210.6000000238419,
      "pairsPerSecond": 140.84506994957633,
      "grade": "excellent",
      "actualPrecision": "fp32",
      "actualDevice": "wasm",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77"
    }
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "actualLabel": "entailment",
      "expectedLabel": "entailment",
      "margin": 0.9768407095158342,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1203.5,
      "inferenceMs": 4.899999976158142,
      "totalMs": 1208.3999999761581,
      "pairsPerSecond": 204.08163364605824,
      "grade": "excellent",
      "actualPrecision": "fp32",
      "actualDevice": "wasm",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77"
    }
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "actualLabel": "neutral",
      "expectedLabel": "neutral",
      "margin": 0.9936191446056236,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1203.5,
      "inferenceMs": 4.399999976158142,
      "totalMs": 1207.8999999761581,
      "pairsPerSecond": 227.2727285042282,
      "grade": "excellent",
      "actualPrecision": "fp32",
      "actualDevice": "wasm",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77"
    }
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "actualLabel": "contradiction",
      "expectedLabel": "contradiction",
      "margin": 0.8207416211183234,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1203.5,
      "inferenceMs": 4,
      "totalMs": 1207.5,
      "pairsPerSecond": 250,
      "grade": "excellent",
      "actualPrecision": "fp32",
      "actualDevice": "wasm",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77"
    }
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "passed": true,
      "finite": true,
      "actualLabel": "neutral",
      "expectedLabel": "neutral",
      "margin": 0.9908070544115444,
      "minimumMargin": 0.15
    },
    "runtime": {
      "loadMs": 1203.5,
      "inferenceMs": 4.200000017881393,
      "totalMs": 1207.7000000178814,
      "pairsPerSecond": 238.09523708155368,
      "grade": "excellent",
      "actualPrecision": "fp32",
      "actualDevice": "wasm",
      "fallback": false,
      "version": "4.2.0",
      "artifactRevision": "73b90d860eddcece951b2f6776145fbc4df5be77"
    }
  }
]

Something not quite right?

Tell us what happened with EttinX NLI. Loading, results, or the page itself—we’re here for all of it.

Attachments Optional

Up to 3 files · 50 MB each

Browser, OS, CPU/GPU, memory, screen, storage, and network details are included automatically. Model inputs, results, and browsing history are not collected.