A model is still running

A model is still running or downloading. Leaving will stop the current operation. Stay on this page to let it finish.

Skip to content
LocalAI.toolsBeta

Join the waitlist

Get an email when the new apps and model runs launch.

No account needed.

GLiNER 2.5

Extract named entities with text spans and classify short text using your own labels with Fastino GLiNER2.5 multilingual boundary model. Returns complete native grouped entities/confidence/offsets or classification labels/confidence locally.

Desktop inferencePrivate · Runs on your computer
About this model

Extract named entities with text spans and classify short text using your own labels with Fastino GLiNER2.5 multilingual boundary model. Returns complete native grouped entities/confidence/offsets or classification labels/confidence locally.

Created by
Fastino
License
Apache-2.0
Model released
Aug 24, 2026
Source repository created
Aug 14, 2026
Model weights · FP32
1.1 GB

Best for

  • Extract user-defined entity types from short multilingual text with review
  • Classify short text against user-supplied labels

Keep in mind

  • Only short-text entity extraction and single-label classification exposed; relations, records, span attributes, joint constraints and long-document APIs are not available in this adapter.
  • Small authored English/Spanish/entity-negative/sentiment suite does not establish broad multilingual, domain or safety quality. Scores are uncalibrated; false positives and missed entities remain possible.
  • Text exceeds384token adapter budget or schema exceeds96tokens rejects; shorten input. These are conservative adapter limits, not advertised model context maxima. Offsets are Python Unicode code points, end-exclusive, not JavaScript UTF16 indices.
  • Entity label wording and classification choices affect predictions. No high-impact or automatic privacy-redaction guarantee. Input instructions can mislead extraction.
  • Only measured FP32CPU/Metal onM3Max/macOS27.2supported. Reducedprecisionprobes retained but not selectable; otherOS/chips/Windowsprovidersunverified.
  • Encoder/boundaryparameters and encoderactivations verified onselecteddevice; tokenization/schema/decoding usesCPU, so GPUaccelerationispartial.
  • Model/runtimeinstallondemand inapp-ownedisolatedCPython3.13.18, no systemPython. Upstream packageCIfocuses3.10–3.12; local3.13evidenceis scoped tothisbuild.

Processed on your deviceYour input is processed locally in the desktop app. Model and runtime files download from external hosts.

Target platforms · verification required

  • macos · aarch64, x86_64
  • windows · x86_64

Recommended configuration

FP32 · mps (verified platform only)

Sources & technical details
Original model
https://huggingface.co/fastino/gliner2.5-multi-v1
Release verification
Verified
Release evidence
Original Fastino August24announcement explicitly releases Multi/Base/Small2.5checkpoints. HFcreationAugust14andartifactupdatesareseparate.
Source updated
Oct 8, 2026
Native model files
fastino/gliner2.5-multi-v1
Files updated
Oct 8, 2026
Artifact revision
cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3

Desktop app

Sample result

GLiNER 2.5 Multilingual

Run GLiNER 2.5 on your computer

Download the desktop app to load this model, provide input and view results locally.

Public desktop downloads are coming soon.

Device requirements

macOS Apple SiliconCPU / FP32Tested16.0 GiBRAM estimate
macOS Apple SiliconMPS / FP32Tested16.0 GiBRAM estimate
macOS Apple SiliconMPS / FP16Unverified16.0 GiBRAM estimate
macOS Apple SiliconMPS / BF16Unverified16.0 GiBRAM estimate
Windows Intel / AMDCPU / FP32Unverified16.0 GiBRAM estimate
macOS Intel / AMDCPU / FP32Unverified16.0 GiBRAM estimate
If your device falls short

MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.

GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.

PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.

Benchmark evidence

Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.

GLiNER 2.5 Multilingual

120 configurations tested
Passed120
Failed0
TestedNov 2, 2026
Runtimegliner2 2.1.0

Quality criteria

{ "version": 1, "minimumEntityF1": 1, "classificationExactMatch": true, "requireExactOffsets": true, "minimumUsableCharactersPerSecond": 20, "goodCharactersPerSecond": 200, "scope": "Short authored English/Spanish entity cases, negative no-entity case and sentiment classification; not broad multilingual, relations/records, long-context or safety validation." }

PrecisionDeviceResultPlatformInference / load
FP32mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6427 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6427 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6427 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6427 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6427 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6427 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6427 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6427 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6427 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6427 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6427 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6427 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6428 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6428 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6428 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6429 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6429 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6429 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6429 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6429 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6429 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6429 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6429 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6429 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6430 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6430 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6430 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6431 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6431 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6432 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6443 ms / 0 ms
FP16mpsAcceleratedPassedFastmacos · aarch64241 ms / 0 ms
FP32mpsAcceleratedPassedModeratemacos · aarch64294 ms / 4970 ms
FP16mpsAcceleratedPassedModeratemacos · aarch64312 ms / 4995 ms
BF16mpsAcceleratedPassedModeratemacos · aarch64313 ms / 5011 ms
BF16mpsAcceleratedPassedModeratemacos · aarch64330 ms / 5018 ms
FP32mpsAcceleratedPassedModeratemacos · aarch64331 ms / 4955 ms
FP32mpsAcceleratedPassedModeratemacos · aarch64333 ms / 0 ms
FP16mpsAcceleratedPassedModeratemacos · aarch64338 ms / 5029 ms
BF16mpsAcceleratedPassedModeratemacos · aarch64339 ms / 0 ms
FP16mpsAcceleratedPassedModeratemacos · aarch641076 ms / 0 ms
BF16mpsAcceleratedPassedModeratemacos · aarch641091 ms / 0 ms
FP32mpsAcceleratedPassedSlowmacos · aarch641655 ms / 0 ms
FP16mpsAcceleratedPassedSlowmacos · aarch642401 ms / 5011 ms
FP32mpsAcceleratedPassedSlowmacos · aarch642571 ms / 4925 ms
BF16mpsAcceleratedPassedSlowmacos · aarch642635 ms / 4999 ms
FP32cpuPassedVery fastmacos · aarch6432 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6432 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6433 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6433 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6433 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6433 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6433 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6433 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6433 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6433 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6433 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6434 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6434 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6434 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6434 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6434 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6434 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6434 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6434 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6434 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6434 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6434 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6434 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6434 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6435 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6435 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6435 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6435 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6435 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6435 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6435 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6436 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6436 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6436 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6437 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6438 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6455 ms / 4909 ms
FP32cpuPassedVery fastmacos · aarch6456 ms / 4956 ms
FP32cpuPassedVery fastmacos · aarch6456 ms / 4898 ms
FP32cpuPassedVery fastmacos · aarch6457 ms / 4919 ms
FP32cpuPassedVery fastmacos · aarch6458 ms / 4985 ms
FP32cpuPassedVery fastmacos · aarch6458 ms / 4949 ms
Test setup & sample details
Quality gate
{ "version": 1, "minimumEntityF1": 1, "classificationExactMatch": true, "requireExactOffsets": true, "minimumUsableCharactersPerSecond": 20, "goodCharactersPerSecond": 200, "scope": "Short authored English/Spanish entity cases, negative no-entity case and sentiment classification; not broad multilingual, relations/records, long-context or safety validation." }
Tested
2026-11-02T18:27:44.617959+00:00
Environment
{ "hardware": "Apple M3 Max", "os": "macOS-27.2-arm64-arm-64bit-Mach-O", "runtime": "GLiNER2 2.1.0/Transformers5.22.1/Torch2.10.0", "interpreterScope": "App-ownedCPython3.13.18 private probe venv; normal packaged provision separate" }
Runtime
gliner2 2.1.0
Artifact revision
cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3
Fixture
{
  "file": "model-samples/gliner25-english.json",
  "url": "https://assets.localai.tools/samples/v1/files/c6e1685902f07fa1fcdac9ae2c5c0321666b177d44a4d57dc8ead34d1814856a/gliner25-english.json",
  "size": 220,
  "sha1": "d0c84a8c5df62d994efecc3a515c7af6e6d65d5a",
  "sha256": "c6e1685902f07fa1fcdac9ae2c5c0321666b177d44a4d57dc8ead34d1814856a"
}
Rerun when
Pinnedmodel/tokenizer/configrevision; PinnedGLiNER2/Transformers/Torch/OS/backendbehavior; Fixture/expectedoutput/qualitygate; Schema/preprocessing/threshold/decoding/limits
Per-case quality & failure details
[
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 4919.380082996213,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 57.31000000378117,
      "durationMs": 57.31000000378117,
      "charactersPerSecond": 506.019891783051,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 4976.690082999994,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1869316096
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 34.496457999921404,
      "durationMs": 34.496457999921404,
      "charactersPerSecond": 1072.5738857039844,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 37,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 34.496457999921404,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1869316096
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.966958005796187,
      "durationMs": 31.966958005796187,
      "charactersPerSecond": 1783.0911527354235,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 57,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 31.966958005796187,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1869316096
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 32.83999999985099,
      "durationMs": 32.83999999985099,
      "charactersPerSecond": 883.0694275314125,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 32.83999999985099,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1869316096
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 32.91266599262599,
      "durationMs": 32.91266599262599,
      "charactersPerSecond": 881.1197490503317,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 32.91266599262599,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1869316096
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 34.213666993309744,
      "durationMs": 34.213666993309744,
      "charactersPerSecond": 847.61449293555,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 34.213666993309744,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1869316096
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 33.35395899193827,
      "durationMs": 33.35395899193827,
      "charactersPerSecond": 869.4620032065569,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 33.35395899193827,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1869316096
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 34.124124998925254,
      "durationMs": 34.124124998925254,
      "charactersPerSecond": 849.8386405779887,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 34.124124998925254,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1869316096
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 34.178667003288865,
      "durationMs": 34.178667003288865,
      "charactersPerSecond": 848.4824758440537,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 34.178667003288865,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1869316096
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 4955.837624991545,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 56.11104200943373,
      "durationMs": 56.11104200943373,
      "charactersPerSecond": 516.8323196550929,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 5011.948667000979,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1860632576
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 34.02283300238196,
      "durationMs": 34.02283300238196,
      "charactersPerSecond": 852.3687606487588,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 34.02283300238196,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1860632576
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 33.90837500046473,
      "durationMs": 33.90837500046473,
      "charactersPerSecond": 855.2459384916718,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 33.90837500046473,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1860632576
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 34.59754100185819,
      "durationMs": 34.59754100185819,
      "charactersPerSecond": 838.2098600141104,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 34.59754100185819,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1860632576
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 33.84054200432729,
      "durationMs": 33.84054200432729,
      "charactersPerSecond": 856.9602696165944,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 33.84054200432729,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1860632576
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 33.36637500615325,
      "durationMs": 33.36637500615325,
      "charactersPerSecond": 869.1384663348049,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 33.36637500615325,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1860632576
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 4984.655499996734,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 57.51824998878874,
      "durationMs": 57.51824998878874,
      "charactersPerSecond": 504.18780136135194,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 5042.173749985523,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1861861376
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 33.81816699402407,
      "durationMs": 33.81816699402407,
      "charactersPerSecond": 857.5272576164322,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 33.81816699402407,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1861861376
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 33.51862498675473,
      "durationMs": 33.51862498675473,
      "charactersPerSecond": 865.1906219738931,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 33.51862498675473,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1861861376
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 35.307209007442,
      "durationMs": 35.307209007442,
      "charactersPerSecond": 821.3620055294494,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 35.307209007442,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1861861376
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 33.504250008263625,
      "durationMs": 33.504250008263625,
      "charactersPerSecond": 865.561831494432,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 33.504250008263625,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1861861376
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 33.03829200740438,
      "durationMs": 33.03829200740438,
      "charactersPerSecond": 877.7693469596026,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 33.03829200740438,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1861861376
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 4908.657749998383,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 55.22145799477585,
      "durationMs": 55.22145799477585,
      "charactersPerSecond": 525.1581731641984,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 4963.879207993159,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1871888384
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 35.272332999738865,
      "durationMs": 35.272332999738865,
      "charactersPerSecond": 1048.9807975070412,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 37,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 35.272332999738865,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1871888384
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 32.499207998625934,
      "durationMs": 32.499207998625934,
      "charactersPerSecond": 1753.8888948435285,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 57,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 32.499207998625934,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1871888384
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 33.172291005030274,
      "durationMs": 33.172291005030274,
      "charactersPerSecond": 874.2236101691744,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 33.172291005030274,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1871888384
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 34.29204199346714,
      "durationMs": 34.29204199346714,
      "charactersPerSecond": 845.677256709434,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 34.29204199346714,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1871888384
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 34.945625011459924,
      "durationMs": 34.945625011459924,
      "charactersPerSecond": 829.8606761358499,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 34.945625011459924,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1871888384
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 34.92091700900346,
      "durationMs": 34.92091700900346,
      "charactersPerSecond": 830.4478371092918,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 34.92091700900346,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1871888384
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 34.394208996673115,
      "durationMs": 34.394208996673115,
      "charactersPerSecond": 843.1651968738433,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 34.394208996673115,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1871888384
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 34.89725000690669,
      "durationMs": 34.89725000690669,
      "charactersPerSecond": 831.0110393873576,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 34.89725000690669,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1871888384
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 4897.547083004611,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 56.43083300674334,
      "durationMs": 56.43083300674334,
      "charactersPerSecond": 513.9034541016712,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 4953.977916011354,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1868546048
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 33.34300000278745,
      "durationMs": 33.34300000278745,
      "charactersPerSecond": 869.7477730730775,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 33.34300000278745,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1868546048
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 32.89462499378715,
      "durationMs": 32.89462499378715,
      "charactersPerSecond": 881.6029976167009,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 32.89462499378715,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1868546048
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 34.54925000551157,
      "durationMs": 34.54925000551157,
      "charactersPerSecond": 839.3814625606545,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 34.54925000551157,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1868546048
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 33.23100000852719,
      "durationMs": 33.23100000852719,
      "charactersPerSecond": 872.6791246895519,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 33.23100000852719,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1868546048
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 33.85049999633338,
      "durationMs": 33.85049999633338,
      "charactersPerSecond": 856.7081727933478,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 33.85049999633338,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1868546048
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 4949.262833993998,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 57.73379201127682,
      "durationMs": 57.73379201127682,
      "charactersPerSecond": 502.3054781216448,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 5006.996626005275,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1864794112
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 35.65812500892207,
      "durationMs": 35.65812500892207,
      "charactersPerSecond": 813.2788808369444,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 35.65812500892207,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1864794112
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 36.59012500429526,
      "durationMs": 36.59012500429526,
      "charactersPerSecond": 792.5635672629086,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 36.59012500429526,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1864794112
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 35.973666002973914,
      "durationMs": 35.973666002973914,
      "charactersPerSecond": 806.1452507398772,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 35.973666002973914,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1864794112
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 35.603166004875675,
      "durationMs": 35.603166004875675,
      "charactersPerSecond": 814.5343028209512,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 35.603166004875675,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1864794112
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 38.40087501157541,
      "durationMs": 38.40087501157541,
      "charactersPerSecond": 755.1911249745834,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 38.40087501157541,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1864794112
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 4925.435415992979,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 2570.6382079952164,
      "durationMs": 2570.6382079952164,
      "charactersPerSecond": 11.28124522144112,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1210466304,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 7496.073623988195,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "slow",
      "observedResidentBytesAtCaseEnd": 1232404480
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 43.070625004475005,
      "durationMs": 43.070625004475005,
      "charactersPerSecond": 859.0541696610097,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 37,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1210466304,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 43.070625004475005,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1232404480
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 333.3967910002684,
      "durationMs": 333.3967910002684,
      "charactersPerSecond": 170.9674524130441,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 57,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1218969600,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 333.3967910002684,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1232404480
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 1655.1996670023073,
      "durationMs": 1655.1996670023073,
      "charactersPerSecond": 17.52054484914271,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1219592192,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 1655.1996670023073,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "slow",
      "observedResidentBytesAtCaseEnd": 1232404480
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 28.705332995741628,
      "durationMs": 28.705332995741628,
      "charactersPerSecond": 1010.2652355331354,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1219592192,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 28.705332995741628,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1232404480
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.54574999178294,
      "durationMs": 26.54574999178294,
      "charactersPerSecond": 1092.4535946046637,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1219592192,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 26.54574999178294,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1232404480
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.701749997097068,
      "durationMs": 25.701749997097068,
      "charactersPerSecond": 1128.3278377260483,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1219592192,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.701749997097068,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1232404480
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.961874998756684,
      "durationMs": 25.961874998756684,
      "charactersPerSecond": 1117.0225571684946,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1219592192,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.961874998756684,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1232404480
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.92350000143051,
      "durationMs": 26.92350000143051,
      "charactersPerSecond": 1077.1259308209987,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1219592192,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 26.92350000143051,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1232404480
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.87399999902118,
      "durationMs": 25.87399999902118,
      "charactersPerSecond": 1120.8162634728715,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1219592192,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.87399999902118,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1232404480
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.89737500238698,
      "durationMs": 25.89737500238698,
      "charactersPerSecond": 1119.8046132987242,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1219592192,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.89737500238698,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1232404480
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.61641699867323,
      "durationMs": 25.61641699867323,
      "charactersPerSecond": 1132.0865053649782,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1219592192,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.61641699867323,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1232404480
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.00891698966734,
      "durationMs": 26.00891698966734,
      "charactersPerSecond": 1115.0022129533859,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1219592192,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 26.00891698966734,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1232404480
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.651417003246024,
      "durationMs": 25.651417003246024,
      "charactersPerSecond": 1130.541833081979,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1219592192,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.651417003246024,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1232404480
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.227249996736646,
      "durationMs": 26.227249996736646,
      "charactersPerSecond": 1105.7201957356701,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1219592192,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 26.227249996736646,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1232404480
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.582082991604693,
      "durationMs": 25.582082991604693,
      "charactersPerSecond": 1133.6058916514721,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1219592192,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.582082991604693,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1232404480
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.144459010334685,
      "durationMs": 25.144459010334685,
      "charactersPerSecond": 1153.3356111611167,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1219592192,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.144459010334685,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1232404480
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.469709013123065,
      "durationMs": 25.469709013123065,
      "charactersPerSecond": 1138.6074330514723,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1219592192,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.469709013123065,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1232404480
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.940916999592446,
      "durationMs": 26.940916999592446,
      "charactersPerSecond": 1076.429581088079,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1219592192,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 26.940916999592446,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1232404480
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.527958005317487,
      "durationMs": 26.527958005317487,
      "charactersPerSecond": 1093.1862902597704,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1219592192,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 26.527958005317487,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1232404480
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.698541998281144,
      "durationMs": 25.698541998281144,
      "charactersPerSecond": 1128.4686890773678,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1219592192,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.698541998281144,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1232404480
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.24779200030025,
      "durationMs": 25.24779200030025,
      "charactersPerSecond": 1148.6152927612493,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1219592192,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.24779200030025,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1232404480
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.489041989203542,
      "durationMs": 25.489041989203542,
      "charactersPerSecond": 1137.7438199632454,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1219592192,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.489041989203542,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1232404480
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.530999995884486,
      "durationMs": 26.530999995884486,
      "charactersPerSecond": 1093.060947740323,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1219592192,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 26.530999995884486,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1232404480
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 4954.922249991796,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 330.6269169988809,
      "durationMs": 330.6269169988809,
      "charactersPerSecond": 87.7121568420219,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1210482688,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 5285.549166990677,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1156022272
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 29.33587499137502,
      "durationMs": 29.33587499137502,
      "charactersPerSecond": 988.5507082548664,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1210482688,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 29.33587499137502,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1156022272
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 27.08695799810812,
      "durationMs": 27.08695799810812,
      "charactersPerSecond": 1070.625944856026,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1210482688,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 27.08695799810812,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1156022272
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 28.11737501178868,
      "durationMs": 28.11737501178868,
      "charactersPerSecond": 1031.3907321661877,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1210482688,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 28.11737501178868,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1156022272
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 28.532291005831212,
      "durationMs": 28.532291005831212,
      "charactersPerSecond": 1016.3922691687535,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1210482688,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 28.532291005831212,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1156022272
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 28.170040997792967,
      "durationMs": 28.170040997792967,
      "charactersPerSecond": 1029.4624705115643,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1210482688,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 28.170040997792967,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1156022272
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 4970.404667008552,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 293.7294580042362,
      "durationMs": 293.7294580042362,
      "charactersPerSecond": 98.73030848537417,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1210482688,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 5264.134125012788,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1159299072
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.276332995621487,
      "durationMs": 26.276332995621487,
      "charactersPerSecond": 1103.6547605342178,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1210482688,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 26.276332995621487,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1159299072
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.403832991491072,
      "durationMs": 26.403832991491072,
      "charactersPerSecond": 1098.325383642048,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1210482688,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 26.403832991491072,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1159299072
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.05445899826009,
      "durationMs": 26.05445899826009,
      "charactersPerSecond": 1113.0532398287992,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1210482688,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 26.05445899826009,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1159299072
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.406250002561137,
      "durationMs": 25.406250002561137,
      "charactersPerSecond": 1141.4514143990784,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1210482688,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.406250002561137,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1159299072
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.470166990999132,
      "durationMs": 25.470166990999132,
      "charactersPerSecond": 1138.5869598047107,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1210482688,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.470166990999132,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1159299072
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 5011.177874999703,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 2401.123124989681,
      "durationMs": 2401.123124989681,
      "charactersPerSecond": 12.077681355938227,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 7412.300999989384,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "slow",
      "observedResidentBytesAtCaseEnd": 1247838208
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 28.533667005831376,
      "durationMs": 28.533667005831376,
      "charactersPerSecond": 1296.7138080232862,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 37,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 28.533667005831376,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1247838208
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 241.4461250009481,
      "durationMs": 241.4461250009481,
      "charactersPerSecond": 236.07751004401572,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 57,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153974272,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 241.4461250009481,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1247838208
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 1075.5690000078175,
      "durationMs": 1075.5690000078175,
      "charactersPerSecond": 26.96247288624832,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1154613248,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 1075.5690000078175,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1247838208
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.164125000941567,
      "durationMs": 31.164125000941567,
      "charactersPerSecond": 930.5571710780847,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1154613248,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 31.164125000941567,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1247838208
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 29.142957995645702,
      "durationMs": 29.142957995645702,
      "charactersPerSecond": 995.0945955565985,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1154613248,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 29.142957995645702,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1247838208
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 30.761832997086458,
      "durationMs": 30.761832997086458,
      "charactersPerSecond": 942.7266575027136,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1154613248,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 30.761832997086458,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1247838208
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 28.75141600088682,
      "durationMs": 28.75141600088682,
      "charactersPerSecond": 1008.6459741358656,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1154613248,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 28.75141600088682,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1247838208
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 30.341332996613346,
      "durationMs": 30.341332996613346,
      "charactersPerSecond": 955.7918896719843,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1154613248,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 30.341332996613346,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1247838208
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 5028.514457997517,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 337.8405830007978,
      "durationMs": 337.8405830007978,
      "charactersPerSecond": 85.83930249709378,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153875968,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 5366.3550409983145,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1174388736
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 27.004916002624668,
      "durationMs": 27.004916002624668,
      "charactersPerSecond": 1073.8785485272913,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153875968,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 27.004916002624668,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1174388736
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 27.187208004761487,
      "durationMs": 27.187208004761487,
      "charactersPerSecond": 1066.6781228481066,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153875968,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 27.187208004761487,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1174388736
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.222832991858013,
      "durationMs": 25.222832991858013,
      "charactersPerSecond": 1149.7518938241897,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153875968,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 25.222832991858013,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1174388736
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.693791995057836,
      "durationMs": 26.693791995057836,
      "charactersPerSecond": 1086.3949192894415,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153875968,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 26.693791995057836,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1174388736
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 27.285042000585236,
      "durationMs": 27.285042000585236,
      "charactersPerSecond": 1062.8534124806545,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153875968,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 27.285042000585236,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1174388736
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 4995.020084010321,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 311.95779200061224,
      "durationMs": 311.95779200061224,
      "charactersPerSecond": 92.96129394306998,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153875968,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 5306.977876010933,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1163739136
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.566166994394735,
      "durationMs": 25.566166994394735,
      "charactersPerSecond": 1134.3116082421786,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153875968,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 25.566166994394735,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1163739136
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.082959011546336,
      "durationMs": 26.082959011546336,
      "charactersPerSecond": 1111.8370422298465,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153875968,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 26.082959011546336,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1163739136
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.331832996220328,
      "durationMs": 26.331832996220328,
      "charactersPerSecond": 1101.3285707896848,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153875968,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 26.331832996220328,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1163739136
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.652041003922932,
      "durationMs": 25.652041003922932,
      "charactersPerSecond": 1130.5143320005245,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153875968,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 25.652041003922932,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1163739136
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.146833999315277,
      "durationMs": 25.146833999315277,
      "charactersPerSecond": 1153.2266845516076,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153875968,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 25.146833999315277,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1163739136
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 4999.3616249994375,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 2634.946874997695,
      "durationMs": 2634.946874997695,
      "charactersPerSecond": 11.00591449306748,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 7634.3084999971325,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "slow",
      "observedResidentBytesAtCaseEnd": 1246134272
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 32.21658400434535,
      "durationMs": 32.21658400434535,
      "charactersPerSecond": 1148.4768215962767,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 37,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 32.21658400434535,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1246134272
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 339.3949579913169,
      "durationMs": 339.3949579913169,
      "charactersPerSecond": 167.94592452801933,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 57,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153974272,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 339.3949579913169,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1246134272
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 1091.1788340017665,
      "durationMs": 1091.1788340017665,
      "charactersPerSecond": 26.57676184356143,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1154613248,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 1091.1788340017665,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1246134272
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 29.038708002190106,
      "durationMs": 29.038708002190106,
      "charactersPerSecond": 998.667020509756,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1154613248,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 29.038708002190106,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1246134272
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.96920800372027,
      "durationMs": 26.96920800372027,
      "charactersPerSecond": 1075.300394286684,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1154613248,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 26.96920800372027,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1246134272
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 30.39337499649264,
      "durationMs": 30.39337499649264,
      "charactersPerSecond": 954.1553053369877,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1154613248,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 30.39337499649264,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1246134272
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 27.958792008575983,
      "durationMs": 27.958792008575983,
      "charactersPerSecond": 1037.2408075107337,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1154613248,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 27.958792008575983,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1246134272
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 29.344249996938743,
      "durationMs": 29.344249996938743,
      "charactersPerSecond": 988.2685706066893,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1154613248,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 29.344249996938743,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1246134272
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 5017.7452089992585,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 329.730583995115,
      "durationMs": 329.730583995115,
      "charactersPerSecond": 87.95059180931071,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153875968,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 5347.4757929943735,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1169915904
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.46449999883771,
      "durationMs": 26.46449999883771,
      "charactersPerSecond": 1095.8075913496816,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153875968,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 26.46449999883771,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1169915904
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.411124999867752,
      "durationMs": 26.411124999867752,
      "charactersPerSecond": 1098.022140296758,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153875968,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 26.411124999867752,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1169915904
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.982291001128033,
      "durationMs": 25.982291001128033,
      "charactersPerSecond": 1116.144838757327,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153875968,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 25.982291001128033,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1169915904
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.072874999954365,
      "durationMs": 26.072874999954365,
      "charactersPerSecond": 1112.267059158254,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153875968,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 26.072874999954365,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1169915904
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.310416996944696,
      "durationMs": 25.310416996944696,
      "charactersPerSecond": 1145.7732997248006,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153875968,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 25.310416996944696,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1169915904
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 5011.1343750031665,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 312.63029100955464,
      "durationMs": 312.63029100955464,
      "charactersPerSecond": 92.76132490665691,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153875968,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 5323.764666012721,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1169604608
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 29.52229201036971,
      "durationMs": 29.52229201036971,
      "charactersPerSecond": 982.308554830829,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153875968,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 29.52229201036971,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1169604608
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 28.575042000738904,
      "durationMs": 28.575042000738904,
      "charactersPerSecond": 1014.871649156285,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153875968,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 28.575042000738904,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1169604608
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.214583005639724,
      "durationMs": 26.214583005639724,
      "charactersPerSecond": 1106.2544841457532,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153875968,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 26.214583005639724,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1169604608
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 27.01454200723674,
      "durationMs": 27.01454200723674,
      "charactersPerSecond": 1073.4958968481267,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153875968,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 27.01454200723674,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1169604608
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.802499993005767,
      "durationMs": 25.802499993005767,
      "charactersPerSecond": 1123.9221008763093,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153875968,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 25.802499993005767,
      "artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1169604608
    }
  }
]

GLiNER 2.5 Base English

120 configurations tested
Passed120
Failed0
TestedNov 2, 2026
Runtimegliner2 2.1.0

Quality criteria

{ "version": 1, "minimumEntityF1": 1, "classificationExactMatch": true, "requireExactOffsets": true, "minimumUsableCharactersPerSecond": 20, "goodCharactersPerSecond": 200, "scope": "Two short authored English entity cases, negative no-entity case and sentiment classification; not multilingual, broad domain, relations/records, long-context or safety validation." }

PrecisionDeviceResultPlatformInference / load
BF16mpsAcceleratedPassedVery fastmacos · aarch6424 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6424 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6424 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6427 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6427 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6427 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6427 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6427 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6427 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6427 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6427 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6427 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6427 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6428 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6428 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6428 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6429 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6429 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6430 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6431 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6431 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6431 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6433 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6433 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6436 ms / 0 ms
FP32mpsAcceleratedPassedFastmacos · aarch64123 ms / 0 ms
BF16mpsAcceleratedPassedFastmacos · aarch64124 ms / 0 ms
FP32mpsAcceleratedPassedFastmacos · aarch64149 ms / 0 ms
FP16mpsAcceleratedPassedModeratemacos · aarch64148 ms / 0 ms
BF16mpsAcceleratedPassedModeratemacos · aarch64206 ms / 0 ms
FP16mpsAcceleratedPassedModeratemacos · aarch64227 ms / 0 ms
FP32mpsAcceleratedPassedModeratemacos · aarch64287 ms / 3002 ms
FP32mpsAcceleratedPassedModeratemacos · aarch64289 ms / 3001 ms
BF16mpsAcceleratedPassedModeratemacos · aarch64291 ms / 3017 ms
BF16mpsAcceleratedPassedModeratemacos · aarch64293 ms / 3014 ms
FP32mpsAcceleratedPassedModeratemacos · aarch64294 ms / 3047 ms
BF16mpsAcceleratedPassedModeratemacos · aarch64294 ms / 3040 ms
FP16mpsAcceleratedPassedModeratemacos · aarch64296 ms / 3020 ms
FP16mpsAcceleratedPassedModeratemacos · aarch64303 ms / 2997 ms
FP16mpsAcceleratedPassedModeratemacos · aarch64352 ms / 3022 ms
FP32cpuPassedVery fastmacos · aarch6430 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6431 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6431 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6431 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6431 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6431 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6431 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6431 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6431 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6431 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6431 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6431 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6431 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6431 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6431 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6431 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6431 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6431 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6431 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6431 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6431 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6431 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6432 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6432 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6432 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6432 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6432 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6432 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6432 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6432 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6432 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6432 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6432 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6432 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6432 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6433 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6452 ms / 2957 ms
FP32cpuPassedVery fastmacos · aarch6452 ms / 2872 ms
FP32cpuPassedVery fastmacos · aarch6452 ms / 2879 ms
FP32cpuPassedVery fastmacos · aarch6453 ms / 2897 ms
FP32cpuPassedVery fastmacos · aarch6453 ms / 2919 ms
FP32cpuPassedVery fastmacos · aarch6453 ms / 2951 ms
Test setup & sample details
Quality gate
{ "version": 1, "minimumEntityF1": 1, "classificationExactMatch": true, "requireExactOffsets": true, "minimumUsableCharactersPerSecond": 20, "goodCharactersPerSecond": 200, "scope": "Two short authored English entity cases, negative no-entity case and sentiment classification; not multilingual, broad domain, relations/records, long-context or safety validation." }
Tested
2026-11-02T18:58:34.265218+00:00
Environment
{ "hardware": "Apple M3 Max", "os": "macOS-27.2-arm64-arm-64bit-Mach-O", "runtime": "GLiNER2 2.1.0/Transformers5.22.1/Torch2.10.0", "interpreterScope": "App-ownedCPython3.13.18 private probe venv; normal packaged provision separate" }
Runtime
gliner2 2.1.0
Artifact revision
54785d51df8d86a0d8f2eb212fec15871aad2c4d
Fixture
{
  "file": "model-samples/gliner25-base-english.json",
  "url": "https://assets.localai.tools/samples/v1/files/c6e1685902f07fa1fcdac9ae2c5c0321666b177d44a4d57dc8ead34d1814856a/gliner25-base-english.json",
  "size": 220,
  "sha1": "d0c84a8c5df62d994efecc3a515c7af6e6d65d5a",
  "sha256": "c6e1685902f07fa1fcdac9ae2c5c0321666b177d44a4d57dc8ead34d1814856a"
}
Rerun when
Pinnedmodel/tokenizer/configrevision; PinnedGLiNER2/Transformers/Torch/OS/backendbehavior; Fixture/expectedoutput/qualitygate; Schema/preprocessing/threshold/decoding/limits
Per-case quality & failure details
[
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 2956.7122500011465,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 51.879209000617266,
      "durationMs": 51.879209000617266,
      "charactersPerSecond": 558.9907895406608,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 3008.5914590017637,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1323663360
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.383667010231875,
      "durationMs": 31.383667010231875,
      "charactersPerSecond": 1051.5023623351967,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 33,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 31.383667010231875,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1323663360
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 29.70758400624618,
      "durationMs": 29.70758400624618,
      "charactersPerSecond": 1918.7019714566975,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 57,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 29.70758400624618,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1323663360
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 30.891417001839727,
      "durationMs": 30.891417001839727,
      "charactersPerSecond": 938.7720867020414,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 30.891417001839727,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1323663360
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.32512500451412,
      "durationMs": 31.32512500451412,
      "charactersPerSecond": 925.7744381170368,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 31.32512500451412,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1323663360
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 30.99262499017641,
      "durationMs": 30.99262499017641,
      "charactersPerSecond": 935.7064788539853,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 30.99262499017641,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1323663360
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.063542002812028,
      "durationMs": 31.063542002812028,
      "charactersPerSecond": 933.5702927043791,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 31.063542002812028,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1323663360
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.08254200196825,
      "durationMs": 31.08254200196825,
      "charactersPerSecond": 932.9996239742433,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 31.08254200196825,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1323663360
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 30.810582989943214,
      "durationMs": 30.810582989943214,
      "charactersPerSecond": 941.2350298423694,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 30.810582989943214,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1323663360
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 2897.4346249888185,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 52.68187499314081,
      "durationMs": 52.68187499314081,
      "charactersPerSecond": 550.4739534000224,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 2950.1164999819594,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1320550400
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 30.927499989047647,
      "durationMs": 30.927499989047647,
      "charactersPerSecond": 937.6768251643284,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 30.927499989047647,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1320550400
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 30.99225000187289,
      "durationMs": 30.99225000187289,
      "charactersPerSecond": 935.7178003613001,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 30.99225000187289,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1320550400
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.152499999734573,
      "durationMs": 31.152499999734573,
      "charactersPerSecond": 930.9044218039351,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 31.152499999734573,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1320550400
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.079415988642722,
      "durationMs": 31.079415988642722,
      "charactersPerSecond": 933.0934664472911,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 31.079415988642722,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1320550400
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.061417001183145,
      "durationMs": 31.061417001183145,
      "charactersPerSecond": 933.6341609558693,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 31.061417001183145,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1320550400
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 2950.588541003526,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 53.01245900045615,
      "durationMs": 53.01245900045615,
      "charactersPerSecond": 547.0412153443112,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 3003.6010000039823,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1322696704
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.163084000581875,
      "durationMs": 31.163084000581875,
      "charactersPerSecond": 930.5882562668866,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 31.163084000581875,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1322696704
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.14199999254197,
      "durationMs": 31.14199999254197,
      "charactersPerSecond": 931.2182906346752,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 31.14199999254197,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1322696704
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 30.93595799873583,
      "durationMs": 30.93595799873583,
      "charactersPerSecond": 937.4204607203391,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 30.93595799873583,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1322696704
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.118917002459057,
      "durationMs": 31.118917002459057,
      "charactersPerSecond": 931.9090377633767,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 31.118917002459057,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1322696704
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.103166998946108,
      "durationMs": 31.103166998946108,
      "charactersPerSecond": 932.3809373168535,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 31.103166998946108,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1322696704
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 2879.34650000534,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 52.41266600205563,
      "durationMs": 52.41266600205563,
      "charactersPerSecond": 553.301371826089,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 2931.759166007396,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1324597248
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 32.55008300766349,
      "durationMs": 32.55008300766349,
      "charactersPerSecond": 1013.8222993849381,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 33,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 32.55008300766349,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1324597248
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 30.895625008270144,
      "durationMs": 30.895625008270144,
      "charactersPerSecond": 1844.9214082816657,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 57,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 30.895625008270144,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1324597248
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.86758400988765,
      "durationMs": 31.86758400988765,
      "charactersPerSecond": 910.0156444555722,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 31.86758400988765,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1324597248
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 32.04929099592846,
      "durationMs": 32.04929099592846,
      "charactersPerSecond": 904.8562105066275,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 32.04929099592846,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1324597248
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 32.06495901395101,
      "durationMs": 32.06495901395101,
      "charactersPerSecond": 904.4140673119997,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 32.06495901395101,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1324597248
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 32.10845899593551,
      "durationMs": 32.10845899593551,
      "charactersPerSecond": 903.1887828584674,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 32.10845899593551,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1324597248
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.509124994045123,
      "durationMs": 31.509124994045123,
      "charactersPerSecond": 920.3683061805327,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 31.509124994045123,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1324597248
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.76054199866485,
      "durationMs": 31.76054199866485,
      "charactersPerSecond": 913.0826546102111,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 31.76054199866485,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1324597248
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 2919.0209999942454,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 52.72004099970218,
      "durationMs": 52.72004099970218,
      "charactersPerSecond": 550.075444747166,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 2971.7410409939475,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1318518784
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 32.23274998890702,
      "durationMs": 32.23274998890702,
      "charactersPerSecond": 899.7060446279149,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 32.23274998890702,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1318518784
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.575332992360927,
      "durationMs": 31.575332992360927,
      "charactersPerSecond": 918.4384534286944,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 31.575332992360927,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1318518784
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.705500005045906,
      "durationMs": 31.705500005045906,
      "charactersPerSecond": 914.6678019707833,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 31.705500005045906,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1318518784
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.672915996750817,
      "durationMs": 31.672915996750817,
      "charactersPerSecond": 915.6087807947642,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 31.672915996750817,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1318518784
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.203457998344675,
      "durationMs": 31.203457998344675,
      "charactersPerSecond": 929.3841727906706,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 31.203457998344675,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1318518784
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 2872.408875002293,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 52.21108300611377,
      "durationMs": 52.21108300611377,
      "charactersPerSecond": 555.4376260803513,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 2924.6199580084067,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1322287104
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.780542005435564,
      "durationMs": 31.780542005435564,
      "charactersPerSecond": 912.5080369944604,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 31.780542005435564,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1322287104
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.63841599598527,
      "durationMs": 31.63841599598527,
      "charactersPerSecond": 916.6072032076426,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 31.63841599598527,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1322287104
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.91316599259153,
      "durationMs": 31.91316599259153,
      "charactersPerSecond": 908.7158574844061,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 31.91316599259153,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1322287104
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.291041988879442,
      "durationMs": 31.291041988879442,
      "charactersPerSecond": 926.7828156795272,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 31.291041988879442,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1322287104
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.316959008108824,
      "durationMs": 31.316959008108824,
      "charactersPerSecond": 926.0158367385256,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 31.316959008108824,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1322287104
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 3046.8984999897657,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 293.5419170098612,
      "durationMs": 293.5419170098612,
      "charactersPerSecond": 98.79338629183162,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1145454592,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 3340.440416999627,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1088618496
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 148.96320800471585,
      "durationMs": 148.96320800471585,
      "charactersPerSecond": 221.53121191479235,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 33,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1146044416,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 148.96320800471585,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1088618496
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 33.11216700240038,
      "durationMs": 33.11216700240038,
      "charactersPerSecond": 1721.4216150778634,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 57,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1146093568,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 33.11216700240038,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1088618496
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 123.07950000104029,
      "durationMs": 123.07950000104029,
      "charactersPerSecond": 235.62006670286186,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1146404864,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 123.07950000104029,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1088618496
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 27.838124995469116,
      "durationMs": 27.838124995469116,
      "charactersPerSecond": 1041.7368269134502,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1146404864,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 27.838124995469116,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1088618496
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.72254100232385,
      "durationMs": 25.72254100232385,
      "charactersPerSecond": 1127.4158333494368,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1146404864,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.72254100232385,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1088618496
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.359000006574206,
      "durationMs": 25.359000006574206,
      "charactersPerSecond": 1143.578216510189,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1146404864,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.359000006574206,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1088618496
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.61329200398177,
      "durationMs": 25.61329200398177,
      "charactersPerSecond": 1132.2246275680511,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1146404864,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.61329200398177,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1088618496
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.866083004279062,
      "durationMs": 26.866083004279062,
      "charactersPerSecond": 1079.42791643207,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1146404864,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 26.866083004279062,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1088618496
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.605832997825928,
      "durationMs": 25.605832997825928,
      "charactersPerSecond": 1132.554445796091,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1146404864,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.605832997825928,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1088618496
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.186124999891035,
      "durationMs": 25.186124999891035,
      "charactersPerSecond": 1151.427621363964,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1146404864,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.186124999891035,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1088618496
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.319125008536503,
      "durationMs": 25.319125008536503,
      "charactersPerSecond": 1145.3792336908352,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1146404864,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.319125008536503,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1088618496
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.728125008754432,
      "durationMs": 25.728125008754432,
      "charactersPerSecond": 1127.1711401484663,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1146404864,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.728125008754432,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1088618496
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.857999993604608,
      "durationMs": 25.857999993604608,
      "charactersPerSecond": 1121.5097844834286,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1146388480,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.857999993604608,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1088618496
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.732250000350177,
      "durationMs": 26.732250000350177,
      "charactersPerSecond": 1084.8319913071334,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1146388480,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 26.732250000350177,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1088618496
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.05774999735877,
      "durationMs": 25.05774999735877,
      "charactersPerSecond": 1157.326575732329,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1146388480,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.05774999735877,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1088618496
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 24.95249999628868,
      "durationMs": 24.95249999628868,
      "charactersPerSecond": 1162.2081957444475,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1146388480,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 24.95249999628868,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1088618496
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.46591700229328,
      "durationMs": 25.46591700229328,
      "charactersPerSecond": 1138.7769777694816,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1146388480,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.46591700229328,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1088618496
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 24.547875000280328,
      "durationMs": 24.547875000280328,
      "charactersPerSecond": 1181.3649857541163,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1146388480,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 24.547875000280328,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1088618496
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.378167007351294,
      "durationMs": 26.378167007351294,
      "charactersPerSecond": 1099.3940553912646,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1146388480,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 26.378167007351294,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1088618496
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.09754199127201,
      "durationMs": 25.09754199127201,
      "charactersPerSecond": 1155.491641774526,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1146388480,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.09754199127201,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1088618496
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.912832996458746,
      "durationMs": 26.912832996458746,
      "charactersPerSecond": 1077.552853830583,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1146388480,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 26.912832996458746,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1088618496
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.45741699577775,
      "durationMs": 25.45741699577775,
      "charactersPerSecond": 1139.1572053366533,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1146388480,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.45741699577775,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1088618496
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 24.527499990654178,
      "durationMs": 24.527499990654178,
      "charactersPerSecond": 1182.3463463887472,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1146388480,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 24.527499990654178,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1088618496
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 3002.3077920050127,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 286.5780420106603,
      "durationMs": 286.5780420106603,
      "charactersPerSecond": 101.19407543066835,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1145454592,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 3288.885834015673,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 989937664
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.764333990286104,
      "durationMs": 26.764333990286104,
      "charactersPerSecond": 1083.5315390446597,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1145454592,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 26.764333990286104,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 989937664
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.563999995938502,
      "durationMs": 25.563999995938502,
      "charactersPerSecond": 1134.4077610940149,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1145454592,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.563999995938502,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 989937664
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.26895800838247,
      "durationMs": 25.26895800838247,
      "charactersPerSecond": 1147.6531794615287,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1145454592,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.26895800838247,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 989937664
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 24.23433399235364,
      "durationMs": 24.23433399235364,
      "charactersPerSecond": 1196.649349189873,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1145454592,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 24.23433399235364,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 989937664
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.368667003931478,
      "durationMs": 25.368667003931478,
      "charactersPerSecond": 1143.1424440040844,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1145454592,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.368667003931478,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 989937664
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 3000.6198750052135,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 288.7225410086103,
      "durationMs": 288.7225410086103,
      "charactersPerSecond": 100.44245211576731,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1145454592,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 3289.342416013824,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 991838208
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 28.542166997794993,
      "durationMs": 28.542166997794993,
      "charactersPerSecond": 1016.0405831218203,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1145454592,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 28.542166997794993,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 991838208
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 27.26599999004975,
      "durationMs": 27.26599999004975,
      "charactersPerSecond": 1063.5956873242517,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1145454592,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 27.26599999004975,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 991838208
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.92650000588037,
      "durationMs": 25.92650000588037,
      "charactersPerSecond": 1118.546660498815,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1145454592,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.92650000588037,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 991838208
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.62166600546334,
      "durationMs": 25.62166600546334,
      "charactersPerSecond": 1131.8545793944975,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1145454592,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.62166600546334,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 991838208
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 24.837457996909507,
      "durationMs": 24.837457996909507,
      "charactersPerSecond": 1167.591305181409,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1145454592,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 24.837457996909507,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 991838208
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 2997.492832990247,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 302.7504170022439,
      "durationMs": 302.7504170022439,
      "charactersPerSecond": 95.78847252185638,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 3300.2432499924907,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1102643200
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 226.96966599323787,
      "durationMs": 226.96966599323787,
      "charactersPerSecond": 145.39387832109324,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 33,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1154465792,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 226.96966599323787,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1102643200
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 36.159124996629544,
      "durationMs": 36.159124996629544,
      "charactersPerSecond": 1576.365578683474,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 57,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1154514944,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 36.159124996629544,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1102643200
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 148.39066700369585,
      "durationMs": 148.39066700369585,
      "charactersPerSecond": 195.43008051360616,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1154842624,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 148.39066700369585,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1102643200
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 27.45800001139287,
      "durationMs": 27.45800001139287,
      "charactersPerSecond": 1056.1584961747878,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1154842624,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 27.45800001139287,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1102643200
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 27.334166996297427,
      "durationMs": 27.334166996297427,
      "charactersPerSecond": 1060.9432511306534,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1154842624,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 27.334166996297427,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1102643200
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.71062499191612,
      "durationMs": 25.71062499191612,
      "charactersPerSecond": 1127.938352689525,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1154842624,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 25.71062499191612,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1102643200
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.053333000163548,
      "durationMs": 26.053333000163548,
      "charactersPerSecond": 1113.1013448382191,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1154842624,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 26.053333000163548,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1102643200
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 27.228499995544553,
      "durationMs": 27.228499995544553,
      "charactersPerSecond": 1065.0605066289118,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1154826240,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 27.228499995544553,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1102643200
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 3020.4344170051627,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 296.023458999116,
      "durationMs": 296.023458999116,
      "charactersPerSecond": 97.96520889949673,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 3316.4578760042787,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1004765184
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.518249996821396,
      "durationMs": 25.518249996821396,
      "charactersPerSecond": 1136.441566471537,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 25.518249996821396,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1004765184
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 24.5728329900885,
      "durationMs": 24.5728329900885,
      "charactersPerSecond": 1180.1651039461835,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 24.5728329900885,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1004765184
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.421541999094188,
      "durationMs": 25.421541999094188,
      "charactersPerSecond": 1140.7647892103996,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 25.421541999094188,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1004765184
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.03154199803248,
      "durationMs": 25.03154199803248,
      "charactersPerSecond": 1158.5382954945183,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 25.03154199803248,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1004765184
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 24.650916995597072,
      "durationMs": 24.650916995597072,
      "charactersPerSecond": 1176.4268244130521,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 24.650916995597072,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1004765184
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 3021.8924999935552,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 352.2694999992382,
      "durationMs": 352.2694999992382,
      "charactersPerSecond": 82.32333483331006,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 3374.1619999927934,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1006272512
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.43958300643135,
      "durationMs": 31.43958300643135,
      "charactersPerSecond": 922.4040914940792,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 31.43958300643135,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1006272512
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 29.477082993253134,
      "durationMs": 29.477082993253134,
      "charactersPerSecond": 983.8151219589017,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 29.477082993253134,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1006272512
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 27.96495900838636,
      "durationMs": 27.96495900838636,
      "charactersPerSecond": 1037.0120689718603,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 27.96495900838636,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1006272512
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 30.7394999981625,
      "durationMs": 30.7394999981625,
      "charactersPerSecond": 943.4115714872889,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 30.7394999981625,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1006272512
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 27.381207997677848,
      "durationMs": 27.381207997677848,
      "charactersPerSecond": 1059.1205472913919,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 27.381207997677848,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1006272512
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 3013.8396249967627,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 292.6162499934435,
      "durationMs": 292.6162499934435,
      "charactersPerSecond": 99.10591090088056,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 3306.455874990206,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1103872000
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 205.68916699266993,
      "durationMs": 205.68916699266993,
      "charactersPerSecond": 160.43625671922726,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 33,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1154465792,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 205.68916699266993,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1103872000
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 33.27066700148862,
      "durationMs": 33.27066700148862,
      "charactersPerSecond": 1713.220837966659,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 57,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1154514944,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 33.27066700148862,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1103872000
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 123.51208399923053,
      "durationMs": 123.51208399923053,
      "charactersPerSecond": 234.79483999460868,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1154842624,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 123.51208399923053,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1103872000
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 27.57329199812375,
      "durationMs": 27.57329199812375,
      "charactersPerSecond": 1051.7423890471016,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1154842624,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 27.57329199812375,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1103872000
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 30.587667002691887,
      "durationMs": 30.587667002691887,
      "charactersPerSecond": 948.0945374960384,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1154842624,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 30.587667002691887,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1103872000
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 30.053458001930267,
      "durationMs": 30.053458001930267,
      "charactersPerSecond": 964.9471950328443,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1154842624,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 30.053458001930267,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1103872000
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.115541986655444,
      "durationMs": 26.115541986655444,
      "charactersPerSecond": 1110.4498621862208,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1154842624,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 26.115541986655444,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1103872000
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.390875001903623,
      "durationMs": 25.390875001903623,
      "charactersPerSecond": 1142.1426003564584,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1154842624,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 25.390875001903623,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1103872000
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 3040.014792000875,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 294.03541699866764,
      "durationMs": 294.03541699866764,
      "charactersPerSecond": 98.62757451471028,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 3334.0502089995425,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1003044864
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.715166997746564,
      "durationMs": 26.715166997746564,
      "charactersPerSecond": 1085.5256866800107,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 26.715166997746564,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1003044864
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.379499991890043,
      "durationMs": 26.379499991890043,
      "charactersPerSecond": 1099.3385018258718,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 26.379499991890043,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1003044864
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 24.91395799734164,
      "durationMs": 24.91395799734164,
      "charactersPerSecond": 1164.0061367645537,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 24.91395799734164,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1003044864
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 24.40670900978148,
      "durationMs": 24.40670900978148,
      "charactersPerSecond": 1188.197883966153,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 24.40670900978148,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1003044864
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.60575000825338,
      "durationMs": 25.60575000825338,
      "charactersPerSecond": 1132.5581164641758,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 25.60575000825338,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1003044864
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 3017.095374991186,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 291.036416994757,
      "durationMs": 291.036416994757,
      "charactersPerSecond": 99.6438875225791,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 3308.131791985943,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1003208704
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 24.86124999995809,
      "durationMs": 24.86124999995809,
      "charactersPerSecond": 1166.4739303152048,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 24.86124999995809,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1003208704
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.528124999254942,
      "durationMs": 25.528124999254942,
      "charactersPerSecond": 1136.0019586572216,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 25.528124999254942,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1003208704
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 24.9932079896098,
      "durationMs": 24.9932079896098,
      "charactersPerSecond": 1160.3152349252607,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 24.9932079896098,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1003208704
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.21283400710672,
      "durationMs": 25.21283400710672,
      "charactersPerSecond": 1150.207866034647,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 25.21283400710672,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1003208704
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 24.205666995840147,
      "durationMs": 24.205666995840147,
      "charactersPerSecond": 1198.066552141851,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1153859584,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 24.205666995840147,
      "artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1003208704
    }
  }
]

GLiNER 2.5 Small English

120 configurations tested
Passed120
Failed0
TestedNov 2, 2026
Runtimegliner2 2.1.0

Quality criteria

{ "version": 1, "minimumEntityF1": 1, "classificationExactMatch": true, "requireExactOffsets": true, "minimumUsableCharactersPerSecond": 20, "goodCharactersPerSecond": 200, "scope": "Two short authored English entity cases, negative no-entity case and sentiment classification; not multilingual, broad domain, relations/records, long-context or safety validation." }

PrecisionDeviceResultPlatformInference / load
FP32mpsAcceleratedPassedVery fastmacos · aarch6422 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6422 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6422 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6423 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6423 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6423 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6423 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6423 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6423 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6423 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6423 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6423 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6424 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6424 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6424 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6424 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6424 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6424 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6424 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6424 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6424 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6424 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6424 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6424 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6424 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6424 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6424 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6425 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6426 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6427 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6427 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6427 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6427 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6427 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6428 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6428 ms / 0 ms
FP16mpsAcceleratedPassedVery fastmacos · aarch6428 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6428 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6428 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6429 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6430 ms / 0 ms
FP32mpsAcceleratedPassedVery fastmacos · aarch6431 ms / 0 ms
BF16mpsAcceleratedPassedVery fastmacos · aarch6432 ms / 0 ms
FP32mpsAcceleratedPassedFastmacos · aarch64128 ms / 0 ms
BF16mpsAcceleratedPassedFastmacos · aarch64130 ms / 0 ms
FP16mpsAcceleratedPassedFastmacos · aarch64135 ms / 0 ms
BF16mpsAcceleratedPassedFastmacos · aarch64151 ms / 0 ms
FP32mpsAcceleratedPassedFastmacos · aarch64158 ms / 0 ms
FP16mpsAcceleratedPassedFastmacos · aarch64160 ms / 0 ms
FP16mpsAcceleratedPassedModeratemacos · aarch64265 ms / 0 ms
BF16mpsAcceleratedPassedModeratemacos · aarch64266 ms / 0 ms
FP32mpsAcceleratedPassedModeratemacos · aarch64283 ms / 1472 ms
FP32mpsAcceleratedPassedModeratemacos · aarch64286 ms / 1492 ms
FP32mpsAcceleratedPassedModeratemacos · aarch64308 ms / 0 ms
BF16mpsAcceleratedPassedModeratemacos · aarch64313 ms / 1475 ms
FP16mpsAcceleratedPassedModeratemacos · aarch64318 ms / 1541 ms
FP16mpsAcceleratedPassedModeratemacos · aarch64320 ms / 1546 ms
BF16mpsAcceleratedPassedModeratemacos · aarch64348 ms / 1515 ms
FP16mpsAcceleratedPassedModeratemacos · aarch64730 ms / 1502 ms
FP32mpsAcceleratedPassedModeratemacos · aarch64776 ms / 1489 ms
BF16mpsAcceleratedPassedModeratemacos · aarch64778 ms / 1513 ms
FP32cpuPassedVery fastmacos · aarch6411 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6412 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6412 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6412 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6412 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6412 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6412 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6412 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6412 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6413 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6413 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6413 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6413 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6413 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6413 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6413 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6413 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6413 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6413 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6413 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6413 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6413 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6413 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6414 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6414 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6414 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6414 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6414 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6414 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6415 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6415 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6415 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6415 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6415 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6415 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6415 ms / 0 ms
FP32cpuPassedVery fastmacos · aarch6431 ms / 1377 ms
FP32cpuPassedVery fastmacos · aarch6432 ms / 1369 ms
FP32cpuPassedVery fastmacos · aarch6433 ms / 1348 ms
FP32cpuPassedVery fastmacos · aarch6435 ms / 1354 ms
FP32cpuPassedVery fastmacos · aarch6435 ms / 1371 ms
FP32cpuPassedVery fastmacos · aarch6436 ms / 1370 ms
Test setup & sample details
Quality gate
{ "version": 1, "minimumEntityF1": 1, "classificationExactMatch": true, "requireExactOffsets": true, "minimumUsableCharactersPerSecond": 20, "goodCharactersPerSecond": 200, "scope": "Two short authored English entity cases, negative no-entity case and sentiment classification; not multilingual, broad domain, relations/records, long-context or safety validation." }
Tested
2026-11-02T18:40:45.942246+00:00
Environment
{ "hardware": "Apple M3 Max", "os": "macOS-27.2-arm64-arm-64bit-Mach-O", "runtime": "GLiNER2 2.1.0/Transformers5.22.1/Torch2.10.0", "interpreterScope": "App-ownedCPython3.13.18 private probe venv; normal packaged provision separate" }
Runtime
gliner2 2.1.0
Artifact revision
df5910e44bc4ffdb0d95399a83b0ca4516349aa5
Fixture
{
  "file": "model-samples/gliner25-small-english.json",
  "url": "https://assets.localai.tools/samples/v1/files/c6e1685902f07fa1fcdac9ae2c5c0321666b177d44a4d57dc8ead34d1814856a/gliner25-small-english.json",
  "size": 220,
  "sha1": "d0c84a8c5df62d994efecc3a515c7af6e6d65d5a",
  "sha256": "c6e1685902f07fa1fcdac9ae2c5c0321666b177d44a4d57dc8ead34d1814856a"
}
Rerun when
Pinnedmodel/tokenizer/configrevision; PinnedGLiNER2/Transformers/Torch/OS/backendbehavior; Fixture/expectedoutput/qualitygate; Schema/preprocessing/threshold/decoding/limits
Per-case quality & failure details
[
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 1376.7339589976473,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.426791989360936,
      "durationMs": 31.426791989360936,
      "charactersPerSecond": 922.7795191382407,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 1408.1607509870082,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 830455808
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 12.644500005990267,
      "durationMs": 12.644500005990267,
      "charactersPerSecond": 2609.8303597901395,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 33,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 12.644500005990267,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 830455808
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 11.195708008017391,
      "durationMs": 11.195708008017391,
      "charactersPerSecond": 5091.236745293962,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 57,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 11.195708008017391,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 830455808
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 12.423542008036748,
      "durationMs": 12.423542008036748,
      "charactersPerSecond": 2334.277936295462,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 12.423542008036748,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 830455808
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 13.179292000131682,
      "durationMs": 13.179292000131682,
      "charactersPerSecond": 2200.4216918261045,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 13.179292000131682,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 830455808
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 12.712249998003244,
      "durationMs": 12.712249998003244,
      "charactersPerSecond": 2281.2641353462313,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 12.712249998003244,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 830455808
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 12.398667007801123,
      "durationMs": 12.398667007801123,
      "charactersPerSecond": 2338.961114267645,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 12.398667007801123,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 830455808
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 12.236499998834915,
      "durationMs": 12.236499998834915,
      "charactersPerSecond": 2369.9587302546647,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 12.236499998834915,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 830455808
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 12.816375005058944,
      "durationMs": 12.816375005058944,
      "charactersPerSecond": 2262.7302953099434,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 12.816375005058944,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 830455808
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 1371.091916997102,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 35.04462499404326,
      "durationMs": 35.04462499404326,
      "charactersPerSecond": 827.5163453719165,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 1406.1365419911454,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 829210624
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 13.407374994130805,
      "durationMs": 13.407374994130805,
      "charactersPerSecond": 2162.9886545796626,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 13.407374994130805,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 829210624
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 12.781041994458064,
      "durationMs": 12.781041994458064,
      "charactersPerSecond": 2268.98558134576,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 12.781041994458064,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 829210624
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 13.287624999065883,
      "durationMs": 13.287624999065883,
      "charactersPerSecond": 2182.4818206442983,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 13.287624999065883,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 829210624
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 14.644916009274311,
      "durationMs": 14.644916009274311,
      "charactersPerSecond": 1980.2093765259508,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 14.644916009274311,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 829210624
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 14.16629200684838,
      "durationMs": 14.16629200684838,
      "charactersPerSecond": 2047.1129626567483,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 14.16629200684838,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 829210624
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 1369.4134580000537,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.866541001363657,
      "durationMs": 31.866541001363657,
      "charactersPerSecond": 910.0454297427201,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 1401.2799990014173,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 828112896
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 12.201166013255715,
      "durationMs": 12.201166013255715,
      "charactersPerSecond": 2376.822015903523,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 12.201166013255715,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 828112896
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 12.188334003440104,
      "durationMs": 12.188334003440104,
      "charactersPerSecond": 2379.3243598193876,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 12.188334003440104,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 828112896
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 12.073958991095424,
      "durationMs": 12.073958991095424,
      "charactersPerSecond": 2401.863383947848,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 12.073958991095424,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 828112896
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 12.69408399821259,
      "durationMs": 12.69408399821259,
      "charactersPerSecond": 2284.52876190857,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 12.69408399821259,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 828112896
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 12.025999996694736,
      "durationMs": 12.025999996694736,
      "charactersPerSecond": 2411.4418765982414,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 1,
      "totalMs": 12.025999996694736,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 828112896
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 1348.4633750049397,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 33.16233400255442,
      "durationMs": 33.16233400255442,
      "charactersPerSecond": 874.4860961163408,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 1381.6257090074942,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 833667072
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 14.726083987625316,
      "durationMs": 14.726083987625316,
      "charactersPerSecond": 2240.92162096391,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 33,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 14.726083987625316,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 833667072
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 12.009167010546662,
      "durationMs": 12.009167010546662,
      "charactersPerSecond": 4746.37416150026,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 57,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 12.009167010546662,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 833667072
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 13.022541999816895,
      "durationMs": 13.022541999816895,
      "charactersPerSecond": 2226.907772722696,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 13.022541999816895,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 833667072
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 14.0769160061609,
      "durationMs": 14.0769160061609,
      "charactersPerSecond": 2060.110324399738,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 14.0769160061609,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 833667072
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 15.016666991868988,
      "durationMs": 15.016666991868988,
      "charactersPerSecond": 1931.187527545394,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 15.016666991868988,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 833667072
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 13.325707986950874,
      "durationMs": 13.325707986950874,
      "charactersPerSecond": 2176.2445964145463,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 13.325707986950874,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 833667072
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 14.081165994866751,
      "durationMs": 14.081165994866751,
      "charactersPerSecond": 2059.488540265193,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 14.081165994866751,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 833667072
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 13.325208012247458,
      "durationMs": 13.325208012247458,
      "charactersPerSecond": 2176.326251218408,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 13.325208012247458,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 833667072
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 1370.4027090134332,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 36.17300000041723,
      "durationMs": 36.17300000041723,
      "charactersPerSecond": 801.702927588685,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 1406.5757090138504,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 831979520
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 14.558666996890679,
      "durationMs": 14.558666996890679,
      "charactersPerSecond": 1991.9406087242453,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 14.558666996890679,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 831979520
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 15.07341698743403,
      "durationMs": 15.07341698743403,
      "charactersPerSecond": 1923.9167883550147,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 15.07341698743403,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 831979520
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 14.689791001728736,
      "durationMs": 14.689791001728736,
      "charactersPerSecond": 1974.160149493427,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 14.689791001728736,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 831979520
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 15.004707995103672,
      "durationMs": 15.004707995103672,
      "charactersPerSecond": 1932.7267154724545,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 15.004707995103672,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 831979520
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 13.877292003598996,
      "durationMs": 13.877292003598996,
      "charactersPerSecond": 2089.7448862846595,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 13.877292003598996,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 831979520
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 1354.1347499995027,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 34.91829099948518,
      "durationMs": 34.91829099948518,
      "charactersPerSecond": 830.5102904499984,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 1389.0530409989879,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 827228160
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 13.31637499970384,
      "durationMs": 13.31637499970384,
      "charactersPerSecond": 2177.7698510777122,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 13.31637499970384,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 827228160
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 13.591625000117347,
      "durationMs": 13.591625000117347,
      "charactersPerSecond": 2133.6668720443377,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 13.591625000117347,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 827228160
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 13.884875006624497,
      "durationMs": 13.884875006624497,
      "charactersPerSecond": 2088.6036054457854,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 13.884875006624497,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 827228160
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 13.443209012621082,
      "durationMs": 13.443209012621082,
      "charactersPerSecond": 2157.2230241137745,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 13.443209012621082,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 827228160
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "cpu/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 13.11912499659229,
      "durationMs": 13.11912499659229,
      "charactersPerSecond": 2210.5132779459595,
      "activationPlacement": {
        "encoderOutput": "cpu"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": null,
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 13.11912499659229,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 827228160
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 1488.945374992909,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 775.9275830030674,
      "durationMs": 775.9275830030674,
      "charactersPerSecond": 37.374621852933096,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1178976256,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 2264.8729579959763,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1091321856
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 308.17945799208246,
      "durationMs": 308.17945799208246,
      "charactersPerSecond": 107.0804660862497,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 33,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1179516928,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 308.17945799208246,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1091321856
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 158.03837499697693,
      "durationMs": 158.03837499697693,
      "charactersPerSecond": 360.67189377953514,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 57,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1179549696,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 158.03837499697693,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1091321856
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 127.66000001283828,
      "durationMs": 127.66000001283828,
      "charactersPerSecond": 227.1659094241233,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1179844608,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 127.66000001283828,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1091321856
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.33170799992513,
      "durationMs": 31.33170799992513,
      "charactersPerSecond": 925.5799268928876,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1179844608,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 31.33170799992513,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1091321856
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 24.280083991470747,
      "durationMs": 24.280083991470747,
      "charactersPerSecond": 1194.3945502901593,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1179844608,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 24.280083991470747,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1091321856
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 24.79362499434501,
      "durationMs": 24.79362499434501,
      "charactersPerSecond": 1169.6555064704896,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1179844608,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 24.79362499434501,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1091321856
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.505749992793426,
      "durationMs": 26.505749992793426,
      "charactersPerSecond": 1094.1022234000068,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1179844608,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 26.505749992793426,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1091321856
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 23.560417001135647,
      "durationMs": 23.560417001135647,
      "charactersPerSecond": 1230.8780442469315,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1179844608,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 23.560417001135647,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1091321856
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 28.703082993160933,
      "durationMs": 28.703082993160933,
      "charactersPerSecond": 1010.3444290952931,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1179844608,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 28.703082993160933,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1091321856
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 27.184499995200895,
      "durationMs": 27.184499995200895,
      "charactersPerSecond": 1066.7843809935666,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1179844608,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 27.184499995200895,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1091321856
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 23.542499999166466,
      "durationMs": 23.542499999166466,
      "charactersPerSecond": 1231.8148030594355,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1179844608,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 23.542499999166466,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1091321856
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 23.574249993544072,
      "durationMs": 23.574249993544072,
      "charactersPerSecond": 1230.155784720269,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1179844608,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 23.574249993544072,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1091321856
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 24.912417007726617,
      "durationMs": 24.912417007726617,
      "charactersPerSecond": 1164.0781378621598,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1179844608,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 24.912417007726617,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1091321856
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 23.04795901000034,
      "durationMs": 23.04795901000034,
      "charactersPerSecond": 1258.2459031368944,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1179844608,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 23.04795901000034,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1091321856
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 23.134333998314105,
      "durationMs": 23.134333998314105,
      "charactersPerSecond": 1253.5480814841417,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1179844608,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 23.134333998314105,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1091321856
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 23.52316699398216,
      "durationMs": 23.52316699398216,
      "charactersPerSecond": 1232.827195735122,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1179844608,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 23.52316699398216,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1091321856
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 22.862874990096316,
      "durationMs": 22.862874990096316,
      "charactersPerSecond": 1268.431901611768,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1179844608,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 22.862874990096316,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1091321856
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 22.302041994407773,
      "durationMs": 22.302041994407773,
      "charactersPerSecond": 1300.3293603012557,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1179844608,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 22.302041994407773,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1091321856
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 23.47383400774561,
      "durationMs": 23.47383400774561,
      "charactersPerSecond": 1235.4181251529228,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1179844608,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 23.47383400774561,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1091321856
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 23.3316669909982,
      "durationMs": 23.3316669909982,
      "charactersPerSecond": 1242.9459074308213,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1179844608,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 23.3316669909982,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1091321856
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 28.302499995334074,
      "durationMs": 28.302499995334074,
      "charactersPerSecond": 1024.6444662054912,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1179844608,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 28.302499995334074,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1091321856
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 24.43587500602007,
      "durationMs": 24.43587500602007,
      "charactersPerSecond": 1186.7796832671434,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1179844608,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 24.43587500602007,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1091321856
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 23.002500005532056,
      "durationMs": 23.002500005532056,
      "charactersPerSecond": 1260.732528769723,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1179844608,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 23.002500005532056,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1091321856
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 1472.2061670036055,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 282.90445799939334,
      "durationMs": 282.90445799939334,
      "charactersPerSecond": 102.50810540448319,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1178976256,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 1755.1106250029989,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 987348992
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.805583005421795,
      "durationMs": 25.805583005421795,
      "charactersPerSecond": 1123.787825057355,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1178976256,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.805583005421795,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 987348992
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 29.921833993284963,
      "durationMs": 29.921833993284963,
      "charactersPerSecond": 969.1919287603881,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1178976256,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 29.921833993284963,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 987348992
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 23.437791009200737,
      "durationMs": 23.437791009200737,
      "charactersPerSecond": 1237.3179703076864,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1178976256,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 23.437791009200737,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 987348992
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 22.38908299477771,
      "durationMs": 22.38908299477771,
      "charactersPerSecond": 1295.274130109049,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1178976256,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 22.38908299477771,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 987348992
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 22.470582989626564,
      "durationMs": 22.470582989626564,
      "charactersPerSecond": 1290.5762175101424,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1178976256,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 22.470582989626564,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 987348992
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 1491.564500000095,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 285.76541699294467,
      "durationMs": 285.76541699294467,
      "charactersPerSecond": 101.48183886336389,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1178976256,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 1777.3299169930397,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 987414528
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.06149999680929,
      "durationMs": 25.06149999680929,
      "charactersPerSecond": 1157.1534027768546,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1178976256,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 25.06149999680929,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 987414528
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 23.694957999396138,
      "durationMs": 23.694957999396138,
      "charactersPerSecond": 1223.8890653758094,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1178976256,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 23.694957999396138,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 987414528
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 23.26254200306721,
      "durationMs": 23.26254200306721,
      "charactersPerSecond": 1246.6393395947998,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1178976256,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 23.26254200306721,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 987414528
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.41679099178873,
      "durationMs": 26.41679099178873,
      "charactersPerSecond": 1097.7866315789158,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1178976256,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 26.41679099178873,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 987414528
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float32": 334
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 24.98233300866559,
      "durationMs": 24.98233300866559,
      "charactersPerSecond": 1160.820328107099,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1178976256,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "totalMs": 24.98233300866559,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 987414528
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 1502.478999987943,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 730.0254169967957,
      "durationMs": 730.0254169967957,
      "charactersPerSecond": 39.724644272388794,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162215424,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 2232.504416984739,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1199669248
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 264.6890420001,
      "durationMs": 264.6890420001,
      "charactersPerSecond": 124.67459835374495,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 33,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162772480,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 264.6890420001,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1199669248
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 160.40479199727997,
      "durationMs": 160.40479199727997,
      "charactersPerSecond": 355.3509797947094,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 57,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162805248,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 160.40479199727997,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1199669248
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 135.0033750059083,
      "durationMs": 135.0033750059083,
      "charactersPerSecond": 214.8094445692994,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1163116544,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 135.0033750059083,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1199669248
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.20054199360311,
      "durationMs": 26.20054199360311,
      "charactersPerSecond": 1106.8473319017744,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1163116544,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 26.20054199360311,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1199669248
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 24.39395900000818,
      "durationMs": 24.39395900000818,
      "charactersPerSecond": 1188.8189202904816,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1163116544,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 24.39395900000818,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1199669248
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.385624991031364,
      "durationMs": 25.385624991031364,
      "charactersPerSecond": 1142.378807307111,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1163116544,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 25.385624991031364,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1199669248
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 23.588834010297433,
      "durationMs": 23.588834010297433,
      "charactersPerSecond": 1229.3952294267867,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1163116544,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 23.588834010297433,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1199669248
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.81400001165457,
      "durationMs": 26.81400001165457,
      "charactersPerSecond": 1081.5245762435777,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1163116544,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 26.81400001165457,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1199669248
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 1545.9377920051338,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 320.406291008112,
      "durationMs": 320.406291008112,
      "charactersPerSecond": 90.51008302226431,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162215424,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 1866.3440830132458,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1098465280
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 27.591875012149103,
      "durationMs": 27.591875012149103,
      "charactersPerSecond": 1051.0340448857094,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162215424,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 27.591875012149103,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1098465280
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 27.75483299046755,
      "durationMs": 27.75483299046755,
      "charactersPerSecond": 1044.8630697925694,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162215424,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 27.75483299046755,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1098465280
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 24.649124999996275,
      "durationMs": 24.649124999996275,
      "charactersPerSecond": 1176.5123508442748,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162215424,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 24.649124999996275,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1098465280
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.489584004390053,
      "durationMs": 25.489584004390053,
      "charactersPerSecond": 1137.7196267701092,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162215424,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 25.489584004390053,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1098465280
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 24.70141700177919,
      "durationMs": 24.70141700177919,
      "charactersPerSecond": 1174.0217169691598,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162215424,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 24.70141700177919,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1098465280
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 1541.1867500079097,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 318.0857920087874,
      "durationMs": 318.0857920087874,
      "charactersPerSecond": 91.17037204603861,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162215424,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 1859.2725420166971,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1098137600
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 27.94370800256729,
      "durationMs": 27.94370800256729,
      "charactersPerSecond": 1037.800709817597,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162215424,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 27.94370800256729,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1098137600
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.87958300136961,
      "durationMs": 25.87958300136961,
      "charactersPerSecond": 1120.5744697843566,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162215424,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 25.87958300136961,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1098137600
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 24.69112499966286,
      "durationMs": 24.69112499966286,
      "charactersPerSecond": 1174.5110844643966,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162215424,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 24.69112499966286,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1098137600
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 24.552583010517992,
      "durationMs": 24.552583010517992,
      "charactersPerSecond": 1181.1384564946504,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162215424,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 24.552583010517992,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1098137600
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.float16": 334
      },
      "parameterDtype": "torch.float16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.05537499766797,
      "durationMs": 26.05537499766797,
      "charactersPerSecond": 1113.014109472444,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162215424,
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "totalMs": 26.05537499766797,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1098137600
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 1512.6468329981435,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 777.7936249913182,
      "durationMs": 777.7936249913182,
      "charactersPerSecond": 37.28495460518039,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162215424,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 2290.4404579894617,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1197637632
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 266.1305840010755,
      "durationMs": 266.1305840010755,
      "charactersPerSecond": 123.99927698601766,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 33,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162772480,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 266.1305840010755,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1197637632
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 150.8566249976866,
      "durationMs": 150.8566249976866,
      "charactersPerSecond": 377.84220614026134,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 57,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162805248,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 150.8566249976866,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1197637632
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 129.7135829954641,
      "durationMs": 129.7135829954641,
      "charactersPerSecond": 223.56949311171283,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1163116544,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 129.7135829954641,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1197637632
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 24.42383300513029,
      "durationMs": 24.42383300513029,
      "charactersPerSecond": 1187.3648167307922,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1163116544,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 24.42383300513029,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1197637632
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.9074580098968,
      "durationMs": 25.9074580098968,
      "charactersPerSecond": 1119.3687929136788,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1163116544,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 25.9074580098968,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1197637632
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 23.970374997588806,
      "durationMs": 23.970374997588806,
      "charactersPerSecond": 1209.8267133041152,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1163116544,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 23.970374997588806,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1197637632
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 24.084917007712647,
      "durationMs": 24.084917007712647,
      "charactersPerSecond": 1204.0730715706186,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1163116544,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 24.084917007712647,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1197637632
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 22.823625011369586,
      "durationMs": 22.823625011369586,
      "charactersPerSecond": 1270.6132345564586,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1163116544,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 22.823625011369586,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1197637632
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 1515.0920000014594,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 347.52733299683314,
      "durationMs": 347.52733299683314,
      "charactersPerSecond": 83.44667381965108,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162215424,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 1862.6193329982925,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1097646080
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.2061670034891,
      "durationMs": 25.2061670034891,
      "charactersPerSecond": 1150.5120947578325,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162215424,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 25.2061670034891,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1097646080
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 24.32704200327862,
      "durationMs": 24.32704200327862,
      "charactersPerSecond": 1192.0890339274126,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162215424,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 24.32704200327862,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1097646080
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 23.734917005640455,
      "durationMs": 23.734917005640455,
      "charactersPerSecond": 1221.8285824681136,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162215424,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 23.734917005640455,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1097646080
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 24.850125002558343,
      "durationMs": 24.850125002558343,
      "charactersPerSecond": 1166.9961417503705,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162215424,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 24.850125002558343,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1097646080
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 24.320625001564622,
      "durationMs": 24.320625001564622,
      "charactersPerSecond": 1192.4035668546487,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162215424,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 24.320625001564622,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1097646080
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 1475.3739169973414,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 313.39566700626165,
      "durationMs": 313.39566700626165,
      "charactersPerSecond": 92.53478287375485,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162215424,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 1788.769584003603,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "acceptable",
      "observedResidentBytesAtCaseEnd": 1097170944
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 31.557041991618462,
      "durationMs": 31.557041991618462,
      "charactersPerSecond": 918.9707960493379,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162215424,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 31.557041991618462,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "good",
      "observedResidentBytesAtCaseEnd": 1097170944
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.680249997298233,
      "durationMs": 26.680249997298233,
      "charactersPerSecond": 1086.9463368198078,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162215424,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 26.680249997298233,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1097170944
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 28.421583003364503,
      "durationMs": 28.421583003364503,
      "charactersPerSecond": 1020.351329360051,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162215424,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 28.421583003364503,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1097170944
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 25.40483299526386,
      "durationMs": 25.40483299526386,
      "charactersPerSecond": 1141.515081221214,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162215424,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 25.40483299526386,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1097170944
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "entityF1": 1,
      "exactOffsets": true,
      "classificationExactMatch": true,
      "passed": true
    },
    "runtime": {
      "engine": "gliner2",
      "version": "2.1.0",
      "transformersVersion": "5.22.1",
      "torchVersion": "2.10.0",
      "loadMs": 0,
      "placement": {
        "mps:0/torch.bfloat16": 334
      },
      "parameterDtype": "torch.bfloat16",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
      "inferenceMs": 26.77645800577011,
      "durationMs": 26.77645800577011,
      "charactersPerSecond": 1083.0409307217085,
      "activationPlacement": {
        "encoderOutput": "mps:0"
      },
      "inputCharacters": 29,
      "threshold": 0.5,
      "driverAllocatedMemoryBytes": 1162215424,
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "totalMs": 26.77645800577011,
      "artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
      "fallback": false,
      "grade": "excellent",
      "observedResidentBytesAtCaseEnd": 1097170944
    }
  }
]

Something not quite right?

Tell us what happened with GLiNER 2.5. Loading, results, or the page itself—we’re here for all of it.

Attachments Optional

Up to 3 files · 50 MB each

Browser, OS, CPU/GPU, memory, screen, storage, and network details are included automatically. Model inputs, results, and browsing history are not collected.