GLiNER 2.5
Extract named entities with text spans and classify short text using your own labels with Fastino GLiNER2.5 multilingual boundary model. Returns complete native grouped entities/confidence/offsets or classification labels/confidence locally.
Desktop app
Run GLiNER 2.5 on your computer
Download the desktop app to load this model, provide input and view results locally.
Public desktop downloads are coming soon.Device requirements
If your device falls short
MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.
GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.
PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.
Benchmark evidence
Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.
GLiNER 2.5 Multilingual
120 configurations testedQuality criteria
{ "version": 1, "minimumEntityF1": 1, "classificationExactMatch": true, "requireExactOffsets": true, "minimumUsableCharactersPerSecond": 20, "goodCharactersPerSecond": 200, "scope": "Short authored English/Spanish entity cases, negative no-entity case and sentiment classification; not broad multilingual, relations/records, long-context or safety validation." }
| Precision | Device | Result | Platform | Inference / load | |
|---|---|---|---|---|---|
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 28 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 28 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 28 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 29 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 29 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 29 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 29 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 29 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 29 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 29 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 29 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 29 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 30 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 30 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 30 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 31 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 31 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 32 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 43 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 241 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 294 ms / 4970 ms |
FP16 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 312 ms / 4995 ms |
BF16 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 313 ms / 5011 ms |
BF16 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 330 ms / 5018 ms |
FP32 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 331 ms / 4955 ms |
FP32 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 333 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 338 ms / 5029 ms |
BF16 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 339 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 1076 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 1091 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Slow | macos · aarch64 | 1655 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Slow | macos · aarch64 | 2401 ms / 5011 ms |
FP32 | mpsAccelerated | Passed | Slow | macos · aarch64 | 2571 ms / 4925 ms |
BF16 | mpsAccelerated | Passed | Slow | macos · aarch64 | 2635 ms / 4999 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 32 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 32 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 33 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 33 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 33 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 33 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 33 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 33 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 33 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 33 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 33 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 34 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 34 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 34 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 34 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 34 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 34 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 34 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 34 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 34 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 34 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 34 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 34 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 34 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 35 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 35 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 35 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 35 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 35 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 35 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 35 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 36 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 36 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 36 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 37 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 38 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 55 ms / 4909 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 56 ms / 4956 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 56 ms / 4898 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 57 ms / 4919 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 58 ms / 4985 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 58 ms / 4949 ms |
Test setup & sample details
- Quality gate
- { "version": 1, "minimumEntityF1": 1, "classificationExactMatch": true, "requireExactOffsets": true, "minimumUsableCharactersPerSecond": 20, "goodCharactersPerSecond": 200, "scope": "Short authored English/Spanish entity cases, negative no-entity case and sentiment classification; not broad multilingual, relations/records, long-context or safety validation." }
- Tested
- 2026-11-02T18:27:44.617959+00:00
- Environment
- { "hardware": "Apple M3 Max", "os": "macOS-27.2-arm64-arm-64bit-Mach-O", "runtime": "GLiNER2 2.1.0/Transformers5.22.1/Torch2.10.0", "interpreterScope": "App-ownedCPython3.13.18 private probe venv; normal packaged provision separate" }
- Runtime
- gliner2 2.1.0
- Artifact revision
- cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3
- Fixture
{ "file": "model-samples/gliner25-english.json", "url": "https://assets.localai.tools/samples/v1/files/c6e1685902f07fa1fcdac9ae2c5c0321666b177d44a4d57dc8ead34d1814856a/gliner25-english.json", "size": 220, "sha1": "d0c84a8c5df62d994efecc3a515c7af6e6d65d5a", "sha256": "c6e1685902f07fa1fcdac9ae2c5c0321666b177d44a4d57dc8ead34d1814856a" }- Rerun when
- Pinnedmodel/tokenizer/configrevision; PinnedGLiNER2/Transformers/Torch/OS/backendbehavior; Fixture/expectedoutput/qualitygate; Schema/preprocessing/threshold/decoding/limits
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 4919.380082996213,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 57.31000000378117,
"durationMs": 57.31000000378117,
"charactersPerSecond": 506.019891783051,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 4976.690082999994,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1869316096
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 34.496457999921404,
"durationMs": 34.496457999921404,
"charactersPerSecond": 1072.5738857039844,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 37,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 34.496457999921404,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1869316096
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.966958005796187,
"durationMs": 31.966958005796187,
"charactersPerSecond": 1783.0911527354235,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 57,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 31.966958005796187,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1869316096
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 32.83999999985099,
"durationMs": 32.83999999985099,
"charactersPerSecond": 883.0694275314125,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 32.83999999985099,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1869316096
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 32.91266599262599,
"durationMs": 32.91266599262599,
"charactersPerSecond": 881.1197490503317,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 32.91266599262599,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1869316096
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 34.213666993309744,
"durationMs": 34.213666993309744,
"charactersPerSecond": 847.61449293555,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 34.213666993309744,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1869316096
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 33.35395899193827,
"durationMs": 33.35395899193827,
"charactersPerSecond": 869.4620032065569,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 33.35395899193827,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1869316096
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 34.124124998925254,
"durationMs": 34.124124998925254,
"charactersPerSecond": 849.8386405779887,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 34.124124998925254,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1869316096
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 34.178667003288865,
"durationMs": 34.178667003288865,
"charactersPerSecond": 848.4824758440537,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 34.178667003288865,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1869316096
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 4955.837624991545,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 56.11104200943373,
"durationMs": 56.11104200943373,
"charactersPerSecond": 516.8323196550929,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 5011.948667000979,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1860632576
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 34.02283300238196,
"durationMs": 34.02283300238196,
"charactersPerSecond": 852.3687606487588,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 34.02283300238196,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1860632576
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 33.90837500046473,
"durationMs": 33.90837500046473,
"charactersPerSecond": 855.2459384916718,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 33.90837500046473,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1860632576
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 34.59754100185819,
"durationMs": 34.59754100185819,
"charactersPerSecond": 838.2098600141104,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 34.59754100185819,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1860632576
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 33.84054200432729,
"durationMs": 33.84054200432729,
"charactersPerSecond": 856.9602696165944,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 33.84054200432729,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1860632576
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 33.36637500615325,
"durationMs": 33.36637500615325,
"charactersPerSecond": 869.1384663348049,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 33.36637500615325,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1860632576
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 4984.655499996734,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 57.51824998878874,
"durationMs": 57.51824998878874,
"charactersPerSecond": 504.18780136135194,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 5042.173749985523,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1861861376
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 33.81816699402407,
"durationMs": 33.81816699402407,
"charactersPerSecond": 857.5272576164322,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 33.81816699402407,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1861861376
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 33.51862498675473,
"durationMs": 33.51862498675473,
"charactersPerSecond": 865.1906219738931,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 33.51862498675473,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1861861376
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 35.307209007442,
"durationMs": 35.307209007442,
"charactersPerSecond": 821.3620055294494,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 35.307209007442,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1861861376
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 33.504250008263625,
"durationMs": 33.504250008263625,
"charactersPerSecond": 865.561831494432,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 33.504250008263625,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1861861376
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 33.03829200740438,
"durationMs": 33.03829200740438,
"charactersPerSecond": 877.7693469596026,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 33.03829200740438,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1861861376
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 4908.657749998383,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 55.22145799477585,
"durationMs": 55.22145799477585,
"charactersPerSecond": 525.1581731641984,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 4963.879207993159,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1871888384
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 35.272332999738865,
"durationMs": 35.272332999738865,
"charactersPerSecond": 1048.9807975070412,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 37,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 35.272332999738865,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1871888384
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 32.499207998625934,
"durationMs": 32.499207998625934,
"charactersPerSecond": 1753.8888948435285,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 57,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 32.499207998625934,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1871888384
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 33.172291005030274,
"durationMs": 33.172291005030274,
"charactersPerSecond": 874.2236101691744,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 33.172291005030274,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1871888384
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 34.29204199346714,
"durationMs": 34.29204199346714,
"charactersPerSecond": 845.677256709434,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 34.29204199346714,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1871888384
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 34.945625011459924,
"durationMs": 34.945625011459924,
"charactersPerSecond": 829.8606761358499,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 34.945625011459924,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1871888384
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 34.92091700900346,
"durationMs": 34.92091700900346,
"charactersPerSecond": 830.4478371092918,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 34.92091700900346,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1871888384
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 34.394208996673115,
"durationMs": 34.394208996673115,
"charactersPerSecond": 843.1651968738433,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 34.394208996673115,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1871888384
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 34.89725000690669,
"durationMs": 34.89725000690669,
"charactersPerSecond": 831.0110393873576,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 34.89725000690669,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1871888384
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 4897.547083004611,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 56.43083300674334,
"durationMs": 56.43083300674334,
"charactersPerSecond": 513.9034541016712,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 4953.977916011354,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1868546048
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 33.34300000278745,
"durationMs": 33.34300000278745,
"charactersPerSecond": 869.7477730730775,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 33.34300000278745,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1868546048
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 32.89462499378715,
"durationMs": 32.89462499378715,
"charactersPerSecond": 881.6029976167009,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 32.89462499378715,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1868546048
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 34.54925000551157,
"durationMs": 34.54925000551157,
"charactersPerSecond": 839.3814625606545,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 34.54925000551157,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1868546048
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 33.23100000852719,
"durationMs": 33.23100000852719,
"charactersPerSecond": 872.6791246895519,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 33.23100000852719,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1868546048
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 33.85049999633338,
"durationMs": 33.85049999633338,
"charactersPerSecond": 856.7081727933478,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 33.85049999633338,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1868546048
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 4949.262833993998,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 57.73379201127682,
"durationMs": 57.73379201127682,
"charactersPerSecond": 502.3054781216448,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 5006.996626005275,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1864794112
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 35.65812500892207,
"durationMs": 35.65812500892207,
"charactersPerSecond": 813.2788808369444,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 35.65812500892207,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1864794112
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 36.59012500429526,
"durationMs": 36.59012500429526,
"charactersPerSecond": 792.5635672629086,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 36.59012500429526,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1864794112
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 35.973666002973914,
"durationMs": 35.973666002973914,
"charactersPerSecond": 806.1452507398772,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 35.973666002973914,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1864794112
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 35.603166004875675,
"durationMs": 35.603166004875675,
"charactersPerSecond": 814.5343028209512,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 35.603166004875675,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1864794112
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 38.40087501157541,
"durationMs": 38.40087501157541,
"charactersPerSecond": 755.1911249745834,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 38.40087501157541,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1864794112
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 4925.435415992979,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 2570.6382079952164,
"durationMs": 2570.6382079952164,
"charactersPerSecond": 11.28124522144112,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1210466304,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 7496.073623988195,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "slow",
"observedResidentBytesAtCaseEnd": 1232404480
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 43.070625004475005,
"durationMs": 43.070625004475005,
"charactersPerSecond": 859.0541696610097,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 37,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1210466304,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 43.070625004475005,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1232404480
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 333.3967910002684,
"durationMs": 333.3967910002684,
"charactersPerSecond": 170.9674524130441,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 57,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1218969600,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 333.3967910002684,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1232404480
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 1655.1996670023073,
"durationMs": 1655.1996670023073,
"charactersPerSecond": 17.52054484914271,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1219592192,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 1655.1996670023073,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "slow",
"observedResidentBytesAtCaseEnd": 1232404480
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 28.705332995741628,
"durationMs": 28.705332995741628,
"charactersPerSecond": 1010.2652355331354,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1219592192,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 28.705332995741628,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1232404480
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.54574999178294,
"durationMs": 26.54574999178294,
"charactersPerSecond": 1092.4535946046637,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1219592192,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 26.54574999178294,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1232404480
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.701749997097068,
"durationMs": 25.701749997097068,
"charactersPerSecond": 1128.3278377260483,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1219592192,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.701749997097068,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1232404480
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.961874998756684,
"durationMs": 25.961874998756684,
"charactersPerSecond": 1117.0225571684946,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1219592192,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.961874998756684,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1232404480
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.92350000143051,
"durationMs": 26.92350000143051,
"charactersPerSecond": 1077.1259308209987,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1219592192,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 26.92350000143051,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1232404480
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.87399999902118,
"durationMs": 25.87399999902118,
"charactersPerSecond": 1120.8162634728715,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1219592192,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.87399999902118,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1232404480
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.89737500238698,
"durationMs": 25.89737500238698,
"charactersPerSecond": 1119.8046132987242,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1219592192,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.89737500238698,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1232404480
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.61641699867323,
"durationMs": 25.61641699867323,
"charactersPerSecond": 1132.0865053649782,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1219592192,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.61641699867323,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1232404480
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.00891698966734,
"durationMs": 26.00891698966734,
"charactersPerSecond": 1115.0022129533859,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1219592192,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 26.00891698966734,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1232404480
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.651417003246024,
"durationMs": 25.651417003246024,
"charactersPerSecond": 1130.541833081979,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1219592192,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.651417003246024,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1232404480
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.227249996736646,
"durationMs": 26.227249996736646,
"charactersPerSecond": 1105.7201957356701,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1219592192,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 26.227249996736646,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1232404480
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.582082991604693,
"durationMs": 25.582082991604693,
"charactersPerSecond": 1133.6058916514721,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1219592192,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.582082991604693,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1232404480
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.144459010334685,
"durationMs": 25.144459010334685,
"charactersPerSecond": 1153.3356111611167,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1219592192,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.144459010334685,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1232404480
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.469709013123065,
"durationMs": 25.469709013123065,
"charactersPerSecond": 1138.6074330514723,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1219592192,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.469709013123065,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1232404480
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.940916999592446,
"durationMs": 26.940916999592446,
"charactersPerSecond": 1076.429581088079,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1219592192,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 26.940916999592446,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1232404480
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.527958005317487,
"durationMs": 26.527958005317487,
"charactersPerSecond": 1093.1862902597704,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1219592192,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 26.527958005317487,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1232404480
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.698541998281144,
"durationMs": 25.698541998281144,
"charactersPerSecond": 1128.4686890773678,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1219592192,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.698541998281144,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1232404480
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.24779200030025,
"durationMs": 25.24779200030025,
"charactersPerSecond": 1148.6152927612493,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1219592192,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.24779200030025,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1232404480
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.489041989203542,
"durationMs": 25.489041989203542,
"charactersPerSecond": 1137.7438199632454,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1219592192,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.489041989203542,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1232404480
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.530999995884486,
"durationMs": 26.530999995884486,
"charactersPerSecond": 1093.060947740323,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1219592192,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 26.530999995884486,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1232404480
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 4954.922249991796,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 330.6269169988809,
"durationMs": 330.6269169988809,
"charactersPerSecond": 87.7121568420219,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1210482688,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 5285.549166990677,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1156022272
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 29.33587499137502,
"durationMs": 29.33587499137502,
"charactersPerSecond": 988.5507082548664,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1210482688,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 29.33587499137502,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1156022272
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 27.08695799810812,
"durationMs": 27.08695799810812,
"charactersPerSecond": 1070.625944856026,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1210482688,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 27.08695799810812,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1156022272
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 28.11737501178868,
"durationMs": 28.11737501178868,
"charactersPerSecond": 1031.3907321661877,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1210482688,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 28.11737501178868,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1156022272
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 28.532291005831212,
"durationMs": 28.532291005831212,
"charactersPerSecond": 1016.3922691687535,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1210482688,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 28.532291005831212,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1156022272
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 28.170040997792967,
"durationMs": 28.170040997792967,
"charactersPerSecond": 1029.4624705115643,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1210482688,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 28.170040997792967,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1156022272
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 4970.404667008552,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 293.7294580042362,
"durationMs": 293.7294580042362,
"charactersPerSecond": 98.73030848537417,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1210482688,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 5264.134125012788,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1159299072
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.276332995621487,
"durationMs": 26.276332995621487,
"charactersPerSecond": 1103.6547605342178,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1210482688,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 26.276332995621487,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1159299072
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.403832991491072,
"durationMs": 26.403832991491072,
"charactersPerSecond": 1098.325383642048,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1210482688,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 26.403832991491072,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1159299072
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.05445899826009,
"durationMs": 26.05445899826009,
"charactersPerSecond": 1113.0532398287992,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1210482688,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 26.05445899826009,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1159299072
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.406250002561137,
"durationMs": 25.406250002561137,
"charactersPerSecond": 1141.4514143990784,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1210482688,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.406250002561137,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1159299072
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.470166990999132,
"durationMs": 25.470166990999132,
"charactersPerSecond": 1138.5869598047107,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1210482688,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.470166990999132,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1159299072
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 5011.177874999703,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 2401.123124989681,
"durationMs": 2401.123124989681,
"charactersPerSecond": 12.077681355938227,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 7412.300999989384,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "slow",
"observedResidentBytesAtCaseEnd": 1247838208
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 28.533667005831376,
"durationMs": 28.533667005831376,
"charactersPerSecond": 1296.7138080232862,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 37,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 28.533667005831376,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1247838208
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 241.4461250009481,
"durationMs": 241.4461250009481,
"charactersPerSecond": 236.07751004401572,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 57,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153974272,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 241.4461250009481,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1247838208
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 1075.5690000078175,
"durationMs": 1075.5690000078175,
"charactersPerSecond": 26.96247288624832,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1154613248,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 1075.5690000078175,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1247838208
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.164125000941567,
"durationMs": 31.164125000941567,
"charactersPerSecond": 930.5571710780847,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1154613248,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 31.164125000941567,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1247838208
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 29.142957995645702,
"durationMs": 29.142957995645702,
"charactersPerSecond": 995.0945955565985,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1154613248,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 29.142957995645702,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1247838208
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 30.761832997086458,
"durationMs": 30.761832997086458,
"charactersPerSecond": 942.7266575027136,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1154613248,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 30.761832997086458,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1247838208
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 28.75141600088682,
"durationMs": 28.75141600088682,
"charactersPerSecond": 1008.6459741358656,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1154613248,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 28.75141600088682,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1247838208
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 30.341332996613346,
"durationMs": 30.341332996613346,
"charactersPerSecond": 955.7918896719843,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1154613248,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 30.341332996613346,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1247838208
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 5028.514457997517,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 337.8405830007978,
"durationMs": 337.8405830007978,
"charactersPerSecond": 85.83930249709378,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153875968,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 5366.3550409983145,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1174388736
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 27.004916002624668,
"durationMs": 27.004916002624668,
"charactersPerSecond": 1073.8785485272913,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153875968,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 27.004916002624668,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1174388736
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 27.187208004761487,
"durationMs": 27.187208004761487,
"charactersPerSecond": 1066.6781228481066,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153875968,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 27.187208004761487,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1174388736
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.222832991858013,
"durationMs": 25.222832991858013,
"charactersPerSecond": 1149.7518938241897,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153875968,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 25.222832991858013,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1174388736
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.693791995057836,
"durationMs": 26.693791995057836,
"charactersPerSecond": 1086.3949192894415,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153875968,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 26.693791995057836,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1174388736
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 27.285042000585236,
"durationMs": 27.285042000585236,
"charactersPerSecond": 1062.8534124806545,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153875968,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 27.285042000585236,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1174388736
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 4995.020084010321,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 311.95779200061224,
"durationMs": 311.95779200061224,
"charactersPerSecond": 92.96129394306998,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153875968,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 5306.977876010933,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1163739136
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.566166994394735,
"durationMs": 25.566166994394735,
"charactersPerSecond": 1134.3116082421786,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153875968,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 25.566166994394735,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1163739136
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.082959011546336,
"durationMs": 26.082959011546336,
"charactersPerSecond": 1111.8370422298465,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153875968,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 26.082959011546336,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1163739136
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.331832996220328,
"durationMs": 26.331832996220328,
"charactersPerSecond": 1101.3285707896848,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153875968,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 26.331832996220328,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1163739136
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.652041003922932,
"durationMs": 25.652041003922932,
"charactersPerSecond": 1130.5143320005245,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153875968,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 25.652041003922932,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1163739136
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.146833999315277,
"durationMs": 25.146833999315277,
"charactersPerSecond": 1153.2266845516076,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153875968,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 25.146833999315277,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1163739136
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 4999.3616249994375,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 2634.946874997695,
"durationMs": 2634.946874997695,
"charactersPerSecond": 11.00591449306748,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 7634.3084999971325,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "slow",
"observedResidentBytesAtCaseEnd": 1246134272
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 32.21658400434535,
"durationMs": 32.21658400434535,
"charactersPerSecond": 1148.4768215962767,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 37,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 32.21658400434535,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1246134272
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 339.3949579913169,
"durationMs": 339.3949579913169,
"charactersPerSecond": 167.94592452801933,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 57,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153974272,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 339.3949579913169,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1246134272
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 1091.1788340017665,
"durationMs": 1091.1788340017665,
"charactersPerSecond": 26.57676184356143,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1154613248,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 1091.1788340017665,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1246134272
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 29.038708002190106,
"durationMs": 29.038708002190106,
"charactersPerSecond": 998.667020509756,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1154613248,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 29.038708002190106,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1246134272
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.96920800372027,
"durationMs": 26.96920800372027,
"charactersPerSecond": 1075.300394286684,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1154613248,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 26.96920800372027,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1246134272
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 30.39337499649264,
"durationMs": 30.39337499649264,
"charactersPerSecond": 954.1553053369877,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1154613248,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 30.39337499649264,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1246134272
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 27.958792008575983,
"durationMs": 27.958792008575983,
"charactersPerSecond": 1037.2408075107337,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1154613248,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 27.958792008575983,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1246134272
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 29.344249996938743,
"durationMs": 29.344249996938743,
"charactersPerSecond": 988.2685706066893,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1154613248,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 29.344249996938743,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1246134272
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 5017.7452089992585,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 329.730583995115,
"durationMs": 329.730583995115,
"charactersPerSecond": 87.95059180931071,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153875968,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 5347.4757929943735,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1169915904
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.46449999883771,
"durationMs": 26.46449999883771,
"charactersPerSecond": 1095.8075913496816,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153875968,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 26.46449999883771,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1169915904
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.411124999867752,
"durationMs": 26.411124999867752,
"charactersPerSecond": 1098.022140296758,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153875968,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 26.411124999867752,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1169915904
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.982291001128033,
"durationMs": 25.982291001128033,
"charactersPerSecond": 1116.144838757327,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153875968,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 25.982291001128033,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1169915904
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.072874999954365,
"durationMs": 26.072874999954365,
"charactersPerSecond": 1112.267059158254,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153875968,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 26.072874999954365,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1169915904
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.310416996944696,
"durationMs": 25.310416996944696,
"charactersPerSecond": 1145.7732997248006,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153875968,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 25.310416996944696,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1169915904
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 5011.1343750031665,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 312.63029100955464,
"durationMs": 312.63029100955464,
"charactersPerSecond": 92.76132490665691,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153875968,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 5323.764666012721,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1169604608
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 29.52229201036971,
"durationMs": 29.52229201036971,
"charactersPerSecond": 982.308554830829,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153875968,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 29.52229201036971,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1169604608
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 28.575042000738904,
"durationMs": 28.575042000738904,
"charactersPerSecond": 1014.871649156285,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153875968,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 28.575042000738904,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1169604608
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.214583005639724,
"durationMs": 26.214583005639724,
"charactersPerSecond": 1106.2544841457532,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153875968,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 26.214583005639724,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1169604608
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 27.01454200723674,
"durationMs": 27.01454200723674,
"charactersPerSecond": 1073.4958968481267,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153875968,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 27.01454200723674,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1169604608
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.802499993005767,
"durationMs": 25.802499993005767,
"charactersPerSecond": 1123.9221008763093,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153875968,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 25.802499993005767,
"artifactRevision": "cf5593a5d45e3bbf204b9df621b13b1c0cf25ee3",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1169604608
}
}
]GLiNER 2.5 Base English
120 configurations testedQuality criteria
{ "version": 1, "minimumEntityF1": 1, "classificationExactMatch": true, "requireExactOffsets": true, "minimumUsableCharactersPerSecond": 20, "goodCharactersPerSecond": 200, "scope": "Two short authored English entity cases, negative no-entity case and sentiment classification; not multilingual, broad domain, relations/records, long-context or safety validation." }
| Precision | Device | Result | Platform | Inference / load | |
|---|---|---|---|---|---|
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 24 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 24 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 24 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 28 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 28 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 28 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 29 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 29 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 30 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 31 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 31 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 31 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 33 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 33 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 36 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 123 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 124 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 149 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 148 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 206 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 227 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 287 ms / 3002 ms |
FP32 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 289 ms / 3001 ms |
BF16 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 291 ms / 3017 ms |
BF16 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 293 ms / 3014 ms |
FP32 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 294 ms / 3047 ms |
BF16 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 294 ms / 3040 ms |
FP16 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 296 ms / 3020 ms |
FP16 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 303 ms / 2997 ms |
FP16 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 352 ms / 3022 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 30 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 31 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 31 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 31 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 31 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 31 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 31 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 31 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 31 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 31 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 31 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 31 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 31 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 31 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 31 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 31 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 31 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 31 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 31 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 31 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 31 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 31 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 32 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 32 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 32 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 32 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 32 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 32 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 32 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 32 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 32 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 32 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 32 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 32 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 32 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 33 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 52 ms / 2957 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 52 ms / 2872 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 52 ms / 2879 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 53 ms / 2897 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 53 ms / 2919 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 53 ms / 2951 ms |
Test setup & sample details
- Quality gate
- { "version": 1, "minimumEntityF1": 1, "classificationExactMatch": true, "requireExactOffsets": true, "minimumUsableCharactersPerSecond": 20, "goodCharactersPerSecond": 200, "scope": "Two short authored English entity cases, negative no-entity case and sentiment classification; not multilingual, broad domain, relations/records, long-context or safety validation." }
- Tested
- 2026-11-02T18:58:34.265218+00:00
- Environment
- { "hardware": "Apple M3 Max", "os": "macOS-27.2-arm64-arm-64bit-Mach-O", "runtime": "GLiNER2 2.1.0/Transformers5.22.1/Torch2.10.0", "interpreterScope": "App-ownedCPython3.13.18 private probe venv; normal packaged provision separate" }
- Runtime
- gliner2 2.1.0
- Artifact revision
- 54785d51df8d86a0d8f2eb212fec15871aad2c4d
- Fixture
{ "file": "model-samples/gliner25-base-english.json", "url": "https://assets.localai.tools/samples/v1/files/c6e1685902f07fa1fcdac9ae2c5c0321666b177d44a4d57dc8ead34d1814856a/gliner25-base-english.json", "size": 220, "sha1": "d0c84a8c5df62d994efecc3a515c7af6e6d65d5a", "sha256": "c6e1685902f07fa1fcdac9ae2c5c0321666b177d44a4d57dc8ead34d1814856a" }- Rerun when
- Pinnedmodel/tokenizer/configrevision; PinnedGLiNER2/Transformers/Torch/OS/backendbehavior; Fixture/expectedoutput/qualitygate; Schema/preprocessing/threshold/decoding/limits
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 2956.7122500011465,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 51.879209000617266,
"durationMs": 51.879209000617266,
"charactersPerSecond": 558.9907895406608,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 3008.5914590017637,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1323663360
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.383667010231875,
"durationMs": 31.383667010231875,
"charactersPerSecond": 1051.5023623351967,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 33,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 31.383667010231875,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1323663360
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 29.70758400624618,
"durationMs": 29.70758400624618,
"charactersPerSecond": 1918.7019714566975,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 57,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 29.70758400624618,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1323663360
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 30.891417001839727,
"durationMs": 30.891417001839727,
"charactersPerSecond": 938.7720867020414,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 30.891417001839727,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1323663360
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.32512500451412,
"durationMs": 31.32512500451412,
"charactersPerSecond": 925.7744381170368,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 31.32512500451412,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1323663360
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 30.99262499017641,
"durationMs": 30.99262499017641,
"charactersPerSecond": 935.7064788539853,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 30.99262499017641,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1323663360
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.063542002812028,
"durationMs": 31.063542002812028,
"charactersPerSecond": 933.5702927043791,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 31.063542002812028,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1323663360
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.08254200196825,
"durationMs": 31.08254200196825,
"charactersPerSecond": 932.9996239742433,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 31.08254200196825,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1323663360
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 30.810582989943214,
"durationMs": 30.810582989943214,
"charactersPerSecond": 941.2350298423694,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 30.810582989943214,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1323663360
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 2897.4346249888185,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 52.68187499314081,
"durationMs": 52.68187499314081,
"charactersPerSecond": 550.4739534000224,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 2950.1164999819594,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1320550400
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 30.927499989047647,
"durationMs": 30.927499989047647,
"charactersPerSecond": 937.6768251643284,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 30.927499989047647,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1320550400
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 30.99225000187289,
"durationMs": 30.99225000187289,
"charactersPerSecond": 935.7178003613001,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 30.99225000187289,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1320550400
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.152499999734573,
"durationMs": 31.152499999734573,
"charactersPerSecond": 930.9044218039351,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 31.152499999734573,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1320550400
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.079415988642722,
"durationMs": 31.079415988642722,
"charactersPerSecond": 933.0934664472911,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 31.079415988642722,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1320550400
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.061417001183145,
"durationMs": 31.061417001183145,
"charactersPerSecond": 933.6341609558693,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 31.061417001183145,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1320550400
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 2950.588541003526,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 53.01245900045615,
"durationMs": 53.01245900045615,
"charactersPerSecond": 547.0412153443112,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 3003.6010000039823,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1322696704
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.163084000581875,
"durationMs": 31.163084000581875,
"charactersPerSecond": 930.5882562668866,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 31.163084000581875,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1322696704
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.14199999254197,
"durationMs": 31.14199999254197,
"charactersPerSecond": 931.2182906346752,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 31.14199999254197,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1322696704
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 30.93595799873583,
"durationMs": 30.93595799873583,
"charactersPerSecond": 937.4204607203391,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 30.93595799873583,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1322696704
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.118917002459057,
"durationMs": 31.118917002459057,
"charactersPerSecond": 931.9090377633767,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 31.118917002459057,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1322696704
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.103166998946108,
"durationMs": 31.103166998946108,
"charactersPerSecond": 932.3809373168535,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 31.103166998946108,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1322696704
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 2879.34650000534,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 52.41266600205563,
"durationMs": 52.41266600205563,
"charactersPerSecond": 553.301371826089,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 2931.759166007396,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1324597248
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 32.55008300766349,
"durationMs": 32.55008300766349,
"charactersPerSecond": 1013.8222993849381,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 33,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 32.55008300766349,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1324597248
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 30.895625008270144,
"durationMs": 30.895625008270144,
"charactersPerSecond": 1844.9214082816657,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 57,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 30.895625008270144,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1324597248
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.86758400988765,
"durationMs": 31.86758400988765,
"charactersPerSecond": 910.0156444555722,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 31.86758400988765,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1324597248
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 32.04929099592846,
"durationMs": 32.04929099592846,
"charactersPerSecond": 904.8562105066275,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 32.04929099592846,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1324597248
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 32.06495901395101,
"durationMs": 32.06495901395101,
"charactersPerSecond": 904.4140673119997,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 32.06495901395101,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1324597248
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 32.10845899593551,
"durationMs": 32.10845899593551,
"charactersPerSecond": 903.1887828584674,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 32.10845899593551,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1324597248
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.509124994045123,
"durationMs": 31.509124994045123,
"charactersPerSecond": 920.3683061805327,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 31.509124994045123,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1324597248
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.76054199866485,
"durationMs": 31.76054199866485,
"charactersPerSecond": 913.0826546102111,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 31.76054199866485,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1324597248
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 2919.0209999942454,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 52.72004099970218,
"durationMs": 52.72004099970218,
"charactersPerSecond": 550.075444747166,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 2971.7410409939475,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1318518784
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 32.23274998890702,
"durationMs": 32.23274998890702,
"charactersPerSecond": 899.7060446279149,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 32.23274998890702,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1318518784
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.575332992360927,
"durationMs": 31.575332992360927,
"charactersPerSecond": 918.4384534286944,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 31.575332992360927,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1318518784
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.705500005045906,
"durationMs": 31.705500005045906,
"charactersPerSecond": 914.6678019707833,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 31.705500005045906,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1318518784
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.672915996750817,
"durationMs": 31.672915996750817,
"charactersPerSecond": 915.6087807947642,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 31.672915996750817,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1318518784
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.203457998344675,
"durationMs": 31.203457998344675,
"charactersPerSecond": 929.3841727906706,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 31.203457998344675,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1318518784
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 2872.408875002293,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 52.21108300611377,
"durationMs": 52.21108300611377,
"charactersPerSecond": 555.4376260803513,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 2924.6199580084067,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1322287104
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.780542005435564,
"durationMs": 31.780542005435564,
"charactersPerSecond": 912.5080369944604,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 31.780542005435564,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1322287104
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.63841599598527,
"durationMs": 31.63841599598527,
"charactersPerSecond": 916.6072032076426,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 31.63841599598527,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1322287104
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.91316599259153,
"durationMs": 31.91316599259153,
"charactersPerSecond": 908.7158574844061,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 31.91316599259153,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1322287104
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.291041988879442,
"durationMs": 31.291041988879442,
"charactersPerSecond": 926.7828156795272,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 31.291041988879442,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1322287104
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.316959008108824,
"durationMs": 31.316959008108824,
"charactersPerSecond": 926.0158367385256,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 31.316959008108824,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1322287104
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 3046.8984999897657,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 293.5419170098612,
"durationMs": 293.5419170098612,
"charactersPerSecond": 98.79338629183162,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1145454592,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 3340.440416999627,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1088618496
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 148.96320800471585,
"durationMs": 148.96320800471585,
"charactersPerSecond": 221.53121191479235,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 33,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1146044416,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 148.96320800471585,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1088618496
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 33.11216700240038,
"durationMs": 33.11216700240038,
"charactersPerSecond": 1721.4216150778634,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 57,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1146093568,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 33.11216700240038,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1088618496
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 123.07950000104029,
"durationMs": 123.07950000104029,
"charactersPerSecond": 235.62006670286186,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1146404864,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 123.07950000104029,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1088618496
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 27.838124995469116,
"durationMs": 27.838124995469116,
"charactersPerSecond": 1041.7368269134502,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1146404864,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 27.838124995469116,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1088618496
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.72254100232385,
"durationMs": 25.72254100232385,
"charactersPerSecond": 1127.4158333494368,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1146404864,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.72254100232385,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1088618496
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.359000006574206,
"durationMs": 25.359000006574206,
"charactersPerSecond": 1143.578216510189,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1146404864,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.359000006574206,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1088618496
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.61329200398177,
"durationMs": 25.61329200398177,
"charactersPerSecond": 1132.2246275680511,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1146404864,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.61329200398177,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1088618496
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.866083004279062,
"durationMs": 26.866083004279062,
"charactersPerSecond": 1079.42791643207,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1146404864,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 26.866083004279062,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1088618496
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.605832997825928,
"durationMs": 25.605832997825928,
"charactersPerSecond": 1132.554445796091,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1146404864,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.605832997825928,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1088618496
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.186124999891035,
"durationMs": 25.186124999891035,
"charactersPerSecond": 1151.427621363964,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1146404864,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.186124999891035,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1088618496
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.319125008536503,
"durationMs": 25.319125008536503,
"charactersPerSecond": 1145.3792336908352,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1146404864,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.319125008536503,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1088618496
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.728125008754432,
"durationMs": 25.728125008754432,
"charactersPerSecond": 1127.1711401484663,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1146404864,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.728125008754432,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1088618496
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.857999993604608,
"durationMs": 25.857999993604608,
"charactersPerSecond": 1121.5097844834286,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1146388480,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.857999993604608,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1088618496
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.732250000350177,
"durationMs": 26.732250000350177,
"charactersPerSecond": 1084.8319913071334,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1146388480,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 26.732250000350177,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1088618496
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.05774999735877,
"durationMs": 25.05774999735877,
"charactersPerSecond": 1157.326575732329,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1146388480,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.05774999735877,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1088618496
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 24.95249999628868,
"durationMs": 24.95249999628868,
"charactersPerSecond": 1162.2081957444475,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1146388480,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 24.95249999628868,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1088618496
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.46591700229328,
"durationMs": 25.46591700229328,
"charactersPerSecond": 1138.7769777694816,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1146388480,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.46591700229328,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1088618496
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 24.547875000280328,
"durationMs": 24.547875000280328,
"charactersPerSecond": 1181.3649857541163,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1146388480,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 24.547875000280328,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1088618496
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.378167007351294,
"durationMs": 26.378167007351294,
"charactersPerSecond": 1099.3940553912646,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1146388480,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 26.378167007351294,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1088618496
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.09754199127201,
"durationMs": 25.09754199127201,
"charactersPerSecond": 1155.491641774526,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1146388480,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.09754199127201,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1088618496
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.912832996458746,
"durationMs": 26.912832996458746,
"charactersPerSecond": 1077.552853830583,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1146388480,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 26.912832996458746,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1088618496
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.45741699577775,
"durationMs": 25.45741699577775,
"charactersPerSecond": 1139.1572053366533,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1146388480,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.45741699577775,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1088618496
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 24.527499990654178,
"durationMs": 24.527499990654178,
"charactersPerSecond": 1182.3463463887472,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1146388480,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 24.527499990654178,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1088618496
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 3002.3077920050127,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 286.5780420106603,
"durationMs": 286.5780420106603,
"charactersPerSecond": 101.19407543066835,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1145454592,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 3288.885834015673,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 989937664
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.764333990286104,
"durationMs": 26.764333990286104,
"charactersPerSecond": 1083.5315390446597,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1145454592,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 26.764333990286104,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 989937664
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.563999995938502,
"durationMs": 25.563999995938502,
"charactersPerSecond": 1134.4077610940149,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1145454592,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.563999995938502,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 989937664
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.26895800838247,
"durationMs": 25.26895800838247,
"charactersPerSecond": 1147.6531794615287,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1145454592,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.26895800838247,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 989937664
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 24.23433399235364,
"durationMs": 24.23433399235364,
"charactersPerSecond": 1196.649349189873,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1145454592,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 24.23433399235364,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 989937664
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.368667003931478,
"durationMs": 25.368667003931478,
"charactersPerSecond": 1143.1424440040844,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1145454592,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.368667003931478,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 989937664
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 3000.6198750052135,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 288.7225410086103,
"durationMs": 288.7225410086103,
"charactersPerSecond": 100.44245211576731,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1145454592,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 3289.342416013824,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 991838208
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 28.542166997794993,
"durationMs": 28.542166997794993,
"charactersPerSecond": 1016.0405831218203,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1145454592,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 28.542166997794993,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 991838208
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 27.26599999004975,
"durationMs": 27.26599999004975,
"charactersPerSecond": 1063.5956873242517,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1145454592,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 27.26599999004975,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 991838208
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.92650000588037,
"durationMs": 25.92650000588037,
"charactersPerSecond": 1118.546660498815,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1145454592,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.92650000588037,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 991838208
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.62166600546334,
"durationMs": 25.62166600546334,
"charactersPerSecond": 1131.8545793944975,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1145454592,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.62166600546334,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 991838208
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 24.837457996909507,
"durationMs": 24.837457996909507,
"charactersPerSecond": 1167.591305181409,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1145454592,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 24.837457996909507,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 991838208
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 2997.492832990247,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 302.7504170022439,
"durationMs": 302.7504170022439,
"charactersPerSecond": 95.78847252185638,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 3300.2432499924907,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1102643200
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 226.96966599323787,
"durationMs": 226.96966599323787,
"charactersPerSecond": 145.39387832109324,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 33,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1154465792,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 226.96966599323787,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1102643200
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 36.159124996629544,
"durationMs": 36.159124996629544,
"charactersPerSecond": 1576.365578683474,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 57,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1154514944,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 36.159124996629544,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1102643200
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 148.39066700369585,
"durationMs": 148.39066700369585,
"charactersPerSecond": 195.43008051360616,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1154842624,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 148.39066700369585,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1102643200
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 27.45800001139287,
"durationMs": 27.45800001139287,
"charactersPerSecond": 1056.1584961747878,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1154842624,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 27.45800001139287,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1102643200
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 27.334166996297427,
"durationMs": 27.334166996297427,
"charactersPerSecond": 1060.9432511306534,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1154842624,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 27.334166996297427,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1102643200
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.71062499191612,
"durationMs": 25.71062499191612,
"charactersPerSecond": 1127.938352689525,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1154842624,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 25.71062499191612,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1102643200
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.053333000163548,
"durationMs": 26.053333000163548,
"charactersPerSecond": 1113.1013448382191,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1154842624,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 26.053333000163548,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1102643200
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 27.228499995544553,
"durationMs": 27.228499995544553,
"charactersPerSecond": 1065.0605066289118,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1154826240,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 27.228499995544553,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1102643200
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 3020.4344170051627,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 296.023458999116,
"durationMs": 296.023458999116,
"charactersPerSecond": 97.96520889949673,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 3316.4578760042787,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1004765184
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.518249996821396,
"durationMs": 25.518249996821396,
"charactersPerSecond": 1136.441566471537,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 25.518249996821396,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1004765184
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 24.5728329900885,
"durationMs": 24.5728329900885,
"charactersPerSecond": 1180.1651039461835,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 24.5728329900885,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1004765184
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.421541999094188,
"durationMs": 25.421541999094188,
"charactersPerSecond": 1140.7647892103996,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 25.421541999094188,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1004765184
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.03154199803248,
"durationMs": 25.03154199803248,
"charactersPerSecond": 1158.5382954945183,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 25.03154199803248,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1004765184
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 24.650916995597072,
"durationMs": 24.650916995597072,
"charactersPerSecond": 1176.4268244130521,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 24.650916995597072,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1004765184
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 3021.8924999935552,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 352.2694999992382,
"durationMs": 352.2694999992382,
"charactersPerSecond": 82.32333483331006,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 3374.1619999927934,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1006272512
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.43958300643135,
"durationMs": 31.43958300643135,
"charactersPerSecond": 922.4040914940792,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 31.43958300643135,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1006272512
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 29.477082993253134,
"durationMs": 29.477082993253134,
"charactersPerSecond": 983.8151219589017,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 29.477082993253134,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1006272512
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 27.96495900838636,
"durationMs": 27.96495900838636,
"charactersPerSecond": 1037.0120689718603,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 27.96495900838636,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1006272512
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 30.7394999981625,
"durationMs": 30.7394999981625,
"charactersPerSecond": 943.4115714872889,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 30.7394999981625,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1006272512
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 27.381207997677848,
"durationMs": 27.381207997677848,
"charactersPerSecond": 1059.1205472913919,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 27.381207997677848,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1006272512
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 3013.8396249967627,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 292.6162499934435,
"durationMs": 292.6162499934435,
"charactersPerSecond": 99.10591090088056,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 3306.455874990206,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1103872000
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 205.68916699266993,
"durationMs": 205.68916699266993,
"charactersPerSecond": 160.43625671922726,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 33,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1154465792,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 205.68916699266993,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1103872000
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 33.27066700148862,
"durationMs": 33.27066700148862,
"charactersPerSecond": 1713.220837966659,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 57,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1154514944,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 33.27066700148862,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1103872000
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 123.51208399923053,
"durationMs": 123.51208399923053,
"charactersPerSecond": 234.79483999460868,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1154842624,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 123.51208399923053,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1103872000
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 27.57329199812375,
"durationMs": 27.57329199812375,
"charactersPerSecond": 1051.7423890471016,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1154842624,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 27.57329199812375,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1103872000
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 30.587667002691887,
"durationMs": 30.587667002691887,
"charactersPerSecond": 948.0945374960384,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1154842624,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 30.587667002691887,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1103872000
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 30.053458001930267,
"durationMs": 30.053458001930267,
"charactersPerSecond": 964.9471950328443,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1154842624,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 30.053458001930267,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1103872000
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.115541986655444,
"durationMs": 26.115541986655444,
"charactersPerSecond": 1110.4498621862208,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1154842624,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 26.115541986655444,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1103872000
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.390875001903623,
"durationMs": 25.390875001903623,
"charactersPerSecond": 1142.1426003564584,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1154842624,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 25.390875001903623,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1103872000
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 3040.014792000875,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 294.03541699866764,
"durationMs": 294.03541699866764,
"charactersPerSecond": 98.62757451471028,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 3334.0502089995425,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1003044864
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.715166997746564,
"durationMs": 26.715166997746564,
"charactersPerSecond": 1085.5256866800107,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 26.715166997746564,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1003044864
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.379499991890043,
"durationMs": 26.379499991890043,
"charactersPerSecond": 1099.3385018258718,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 26.379499991890043,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1003044864
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 24.91395799734164,
"durationMs": 24.91395799734164,
"charactersPerSecond": 1164.0061367645537,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 24.91395799734164,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1003044864
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 24.40670900978148,
"durationMs": 24.40670900978148,
"charactersPerSecond": 1188.197883966153,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 24.40670900978148,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1003044864
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.60575000825338,
"durationMs": 25.60575000825338,
"charactersPerSecond": 1132.5581164641758,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 25.60575000825338,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1003044864
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 3017.095374991186,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 291.036416994757,
"durationMs": 291.036416994757,
"charactersPerSecond": 99.6438875225791,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 3308.131791985943,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1003208704
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 24.86124999995809,
"durationMs": 24.86124999995809,
"charactersPerSecond": 1166.4739303152048,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 24.86124999995809,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1003208704
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.528124999254942,
"durationMs": 25.528124999254942,
"charactersPerSecond": 1136.0019586572216,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 25.528124999254942,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1003208704
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 24.9932079896098,
"durationMs": 24.9932079896098,
"charactersPerSecond": 1160.3152349252607,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 24.9932079896098,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1003208704
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.21283400710672,
"durationMs": 25.21283400710672,
"charactersPerSecond": 1150.207866034647,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 25.21283400710672,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1003208704
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 24.205666995840147,
"durationMs": 24.205666995840147,
"charactersPerSecond": 1198.066552141851,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1153859584,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 24.205666995840147,
"artifactRevision": "54785d51df8d86a0d8f2eb212fec15871aad2c4d",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1003208704
}
}
]GLiNER 2.5 Small English
120 configurations testedQuality criteria
{ "version": 1, "minimumEntityF1": 1, "classificationExactMatch": true, "requireExactOffsets": true, "minimumUsableCharactersPerSecond": 20, "goodCharactersPerSecond": 200, "scope": "Two short authored English entity cases, negative no-entity case and sentiment classification; not multilingual, broad domain, relations/records, long-context or safety validation." }
| Precision | Device | Result | Platform | Inference / load | |
|---|---|---|---|---|---|
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 22 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 22 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 22 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 23 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 23 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 23 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 23 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 23 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 23 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 23 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 23 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 23 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 24 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 24 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 24 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 24 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 24 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 24 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 24 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 24 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 24 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 24 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 24 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 24 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 24 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 24 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 24 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 28 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 28 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 28 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 28 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 28 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 29 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 30 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 31 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 32 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 128 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 130 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 135 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 151 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 158 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 160 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 265 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 266 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 283 ms / 1472 ms |
FP32 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 286 ms / 1492 ms |
FP32 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 308 ms / 0 ms |
BF16 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 313 ms / 1475 ms |
FP16 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 318 ms / 1541 ms |
FP16 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 320 ms / 1546 ms |
BF16 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 348 ms / 1515 ms |
FP16 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 730 ms / 1502 ms |
FP32 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 776 ms / 1489 ms |
BF16 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 778 ms / 1513 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 11 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 12 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 12 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 12 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 12 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 12 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 12 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 12 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 12 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 13 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 13 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 13 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 13 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 13 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 13 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 13 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 13 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 13 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 13 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 13 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 13 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 13 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 13 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 14 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 14 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 14 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 14 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 14 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 14 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 15 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 15 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 15 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 15 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 15 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 15 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 15 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 31 ms / 1377 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 32 ms / 1369 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 33 ms / 1348 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 35 ms / 1354 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 35 ms / 1371 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 36 ms / 1370 ms |
Test setup & sample details
- Quality gate
- { "version": 1, "minimumEntityF1": 1, "classificationExactMatch": true, "requireExactOffsets": true, "minimumUsableCharactersPerSecond": 20, "goodCharactersPerSecond": 200, "scope": "Two short authored English entity cases, negative no-entity case and sentiment classification; not multilingual, broad domain, relations/records, long-context or safety validation." }
- Tested
- 2026-11-02T18:40:45.942246+00:00
- Environment
- { "hardware": "Apple M3 Max", "os": "macOS-27.2-arm64-arm-64bit-Mach-O", "runtime": "GLiNER2 2.1.0/Transformers5.22.1/Torch2.10.0", "interpreterScope": "App-ownedCPython3.13.18 private probe venv; normal packaged provision separate" }
- Runtime
- gliner2 2.1.0
- Artifact revision
- df5910e44bc4ffdb0d95399a83b0ca4516349aa5
- Fixture
{ "file": "model-samples/gliner25-small-english.json", "url": "https://assets.localai.tools/samples/v1/files/c6e1685902f07fa1fcdac9ae2c5c0321666b177d44a4d57dc8ead34d1814856a/gliner25-small-english.json", "size": 220, "sha1": "d0c84a8c5df62d994efecc3a515c7af6e6d65d5a", "sha256": "c6e1685902f07fa1fcdac9ae2c5c0321666b177d44a4d57dc8ead34d1814856a" }- Rerun when
- Pinnedmodel/tokenizer/configrevision; PinnedGLiNER2/Transformers/Torch/OS/backendbehavior; Fixture/expectedoutput/qualitygate; Schema/preprocessing/threshold/decoding/limits
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 1376.7339589976473,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.426791989360936,
"durationMs": 31.426791989360936,
"charactersPerSecond": 922.7795191382407,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 1408.1607509870082,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 830455808
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 12.644500005990267,
"durationMs": 12.644500005990267,
"charactersPerSecond": 2609.8303597901395,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 33,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 12.644500005990267,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 830455808
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 11.195708008017391,
"durationMs": 11.195708008017391,
"charactersPerSecond": 5091.236745293962,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 57,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 11.195708008017391,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 830455808
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 12.423542008036748,
"durationMs": 12.423542008036748,
"charactersPerSecond": 2334.277936295462,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 12.423542008036748,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 830455808
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 13.179292000131682,
"durationMs": 13.179292000131682,
"charactersPerSecond": 2200.4216918261045,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 13.179292000131682,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 830455808
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 12.712249998003244,
"durationMs": 12.712249998003244,
"charactersPerSecond": 2281.2641353462313,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 12.712249998003244,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 830455808
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 12.398667007801123,
"durationMs": 12.398667007801123,
"charactersPerSecond": 2338.961114267645,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 12.398667007801123,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 830455808
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 12.236499998834915,
"durationMs": 12.236499998834915,
"charactersPerSecond": 2369.9587302546647,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 12.236499998834915,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 830455808
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 12.816375005058944,
"durationMs": 12.816375005058944,
"charactersPerSecond": 2262.7302953099434,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 12.816375005058944,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 830455808
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 1371.091916997102,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 35.04462499404326,
"durationMs": 35.04462499404326,
"charactersPerSecond": 827.5163453719165,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 1406.1365419911454,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 829210624
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 13.407374994130805,
"durationMs": 13.407374994130805,
"charactersPerSecond": 2162.9886545796626,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 13.407374994130805,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 829210624
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 12.781041994458064,
"durationMs": 12.781041994458064,
"charactersPerSecond": 2268.98558134576,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 12.781041994458064,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 829210624
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 13.287624999065883,
"durationMs": 13.287624999065883,
"charactersPerSecond": 2182.4818206442983,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 13.287624999065883,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 829210624
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 14.644916009274311,
"durationMs": 14.644916009274311,
"charactersPerSecond": 1980.2093765259508,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 14.644916009274311,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 829210624
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 14.16629200684838,
"durationMs": 14.16629200684838,
"charactersPerSecond": 2047.1129626567483,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 14.16629200684838,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 829210624
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 1369.4134580000537,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.866541001363657,
"durationMs": 31.866541001363657,
"charactersPerSecond": 910.0454297427201,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 1401.2799990014173,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 828112896
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 12.201166013255715,
"durationMs": 12.201166013255715,
"charactersPerSecond": 2376.822015903523,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 12.201166013255715,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 828112896
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 12.188334003440104,
"durationMs": 12.188334003440104,
"charactersPerSecond": 2379.3243598193876,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 12.188334003440104,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 828112896
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 12.073958991095424,
"durationMs": 12.073958991095424,
"charactersPerSecond": 2401.863383947848,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 12.073958991095424,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 828112896
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 12.69408399821259,
"durationMs": 12.69408399821259,
"charactersPerSecond": 2284.52876190857,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 12.69408399821259,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 828112896
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 12.025999996694736,
"durationMs": 12.025999996694736,
"charactersPerSecond": 2411.4418765982414,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 12.025999996694736,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 828112896
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 1348.4633750049397,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 33.16233400255442,
"durationMs": 33.16233400255442,
"charactersPerSecond": 874.4860961163408,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 1381.6257090074942,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 833667072
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 14.726083987625316,
"durationMs": 14.726083987625316,
"charactersPerSecond": 2240.92162096391,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 33,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 14.726083987625316,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 833667072
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 12.009167010546662,
"durationMs": 12.009167010546662,
"charactersPerSecond": 4746.37416150026,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 57,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 12.009167010546662,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 833667072
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 13.022541999816895,
"durationMs": 13.022541999816895,
"charactersPerSecond": 2226.907772722696,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 13.022541999816895,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 833667072
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 14.0769160061609,
"durationMs": 14.0769160061609,
"charactersPerSecond": 2060.110324399738,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 14.0769160061609,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 833667072
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 15.016666991868988,
"durationMs": 15.016666991868988,
"charactersPerSecond": 1931.187527545394,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 15.016666991868988,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 833667072
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 13.325707986950874,
"durationMs": 13.325707986950874,
"charactersPerSecond": 2176.2445964145463,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 13.325707986950874,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 833667072
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 14.081165994866751,
"durationMs": 14.081165994866751,
"charactersPerSecond": 2059.488540265193,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 14.081165994866751,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 833667072
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 13.325208012247458,
"durationMs": 13.325208012247458,
"charactersPerSecond": 2176.326251218408,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 13.325208012247458,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 833667072
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 1370.4027090134332,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 36.17300000041723,
"durationMs": 36.17300000041723,
"charactersPerSecond": 801.702927588685,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 1406.5757090138504,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 831979520
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 14.558666996890679,
"durationMs": 14.558666996890679,
"charactersPerSecond": 1991.9406087242453,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 14.558666996890679,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 831979520
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 15.07341698743403,
"durationMs": 15.07341698743403,
"charactersPerSecond": 1923.9167883550147,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 15.07341698743403,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 831979520
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 14.689791001728736,
"durationMs": 14.689791001728736,
"charactersPerSecond": 1974.160149493427,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 14.689791001728736,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 831979520
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 15.004707995103672,
"durationMs": 15.004707995103672,
"charactersPerSecond": 1932.7267154724545,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 15.004707995103672,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 831979520
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 13.877292003598996,
"durationMs": 13.877292003598996,
"charactersPerSecond": 2089.7448862846595,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 13.877292003598996,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 831979520
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 1354.1347499995027,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 34.91829099948518,
"durationMs": 34.91829099948518,
"charactersPerSecond": 830.5102904499984,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 1389.0530409989879,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 827228160
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 13.31637499970384,
"durationMs": 13.31637499970384,
"charactersPerSecond": 2177.7698510777122,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 13.31637499970384,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 827228160
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 13.591625000117347,
"durationMs": 13.591625000117347,
"charactersPerSecond": 2133.6668720443377,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 13.591625000117347,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 827228160
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 13.884875006624497,
"durationMs": 13.884875006624497,
"charactersPerSecond": 2088.6036054457854,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 13.884875006624497,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 827228160
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 13.443209012621082,
"durationMs": 13.443209012621082,
"charactersPerSecond": 2157.2230241137745,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 13.443209012621082,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 827228160
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"cpu/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 13.11912499659229,
"durationMs": 13.11912499659229,
"charactersPerSecond": 2210.5132779459595,
"activationPlacement": {
"encoderOutput": "cpu"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 13.11912499659229,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 827228160
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 1488.945374992909,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 775.9275830030674,
"durationMs": 775.9275830030674,
"charactersPerSecond": 37.374621852933096,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1178976256,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 2264.8729579959763,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1091321856
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 308.17945799208246,
"durationMs": 308.17945799208246,
"charactersPerSecond": 107.0804660862497,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 33,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1179516928,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 308.17945799208246,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1091321856
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 158.03837499697693,
"durationMs": 158.03837499697693,
"charactersPerSecond": 360.67189377953514,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 57,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1179549696,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 158.03837499697693,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1091321856
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 127.66000001283828,
"durationMs": 127.66000001283828,
"charactersPerSecond": 227.1659094241233,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1179844608,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 127.66000001283828,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1091321856
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.33170799992513,
"durationMs": 31.33170799992513,
"charactersPerSecond": 925.5799268928876,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1179844608,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 31.33170799992513,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1091321856
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 24.280083991470747,
"durationMs": 24.280083991470747,
"charactersPerSecond": 1194.3945502901593,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1179844608,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 24.280083991470747,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1091321856
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 24.79362499434501,
"durationMs": 24.79362499434501,
"charactersPerSecond": 1169.6555064704896,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1179844608,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 24.79362499434501,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1091321856
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.505749992793426,
"durationMs": 26.505749992793426,
"charactersPerSecond": 1094.1022234000068,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1179844608,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 26.505749992793426,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1091321856
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 23.560417001135647,
"durationMs": 23.560417001135647,
"charactersPerSecond": 1230.8780442469315,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1179844608,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 23.560417001135647,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1091321856
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 28.703082993160933,
"durationMs": 28.703082993160933,
"charactersPerSecond": 1010.3444290952931,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1179844608,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 28.703082993160933,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1091321856
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 27.184499995200895,
"durationMs": 27.184499995200895,
"charactersPerSecond": 1066.7843809935666,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1179844608,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 27.184499995200895,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1091321856
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 23.542499999166466,
"durationMs": 23.542499999166466,
"charactersPerSecond": 1231.8148030594355,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1179844608,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 23.542499999166466,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1091321856
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 23.574249993544072,
"durationMs": 23.574249993544072,
"charactersPerSecond": 1230.155784720269,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1179844608,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 23.574249993544072,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1091321856
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 24.912417007726617,
"durationMs": 24.912417007726617,
"charactersPerSecond": 1164.0781378621598,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1179844608,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 24.912417007726617,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1091321856
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 23.04795901000034,
"durationMs": 23.04795901000034,
"charactersPerSecond": 1258.2459031368944,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1179844608,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 23.04795901000034,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1091321856
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 23.134333998314105,
"durationMs": 23.134333998314105,
"charactersPerSecond": 1253.5480814841417,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1179844608,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 23.134333998314105,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1091321856
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 23.52316699398216,
"durationMs": 23.52316699398216,
"charactersPerSecond": 1232.827195735122,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1179844608,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 23.52316699398216,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1091321856
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 22.862874990096316,
"durationMs": 22.862874990096316,
"charactersPerSecond": 1268.431901611768,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1179844608,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 22.862874990096316,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1091321856
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 22.302041994407773,
"durationMs": 22.302041994407773,
"charactersPerSecond": 1300.3293603012557,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1179844608,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 22.302041994407773,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1091321856
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 23.47383400774561,
"durationMs": 23.47383400774561,
"charactersPerSecond": 1235.4181251529228,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1179844608,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 23.47383400774561,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1091321856
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 23.3316669909982,
"durationMs": 23.3316669909982,
"charactersPerSecond": 1242.9459074308213,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1179844608,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 23.3316669909982,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1091321856
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 28.302499995334074,
"durationMs": 28.302499995334074,
"charactersPerSecond": 1024.6444662054912,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1179844608,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 28.302499995334074,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1091321856
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 24.43587500602007,
"durationMs": 24.43587500602007,
"charactersPerSecond": 1186.7796832671434,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1179844608,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 24.43587500602007,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1091321856
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 23.002500005532056,
"durationMs": 23.002500005532056,
"charactersPerSecond": 1260.732528769723,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1179844608,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 23.002500005532056,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1091321856
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 1472.2061670036055,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 282.90445799939334,
"durationMs": 282.90445799939334,
"charactersPerSecond": 102.50810540448319,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1178976256,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 1755.1106250029989,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 987348992
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.805583005421795,
"durationMs": 25.805583005421795,
"charactersPerSecond": 1123.787825057355,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1178976256,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.805583005421795,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 987348992
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 29.921833993284963,
"durationMs": 29.921833993284963,
"charactersPerSecond": 969.1919287603881,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1178976256,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 29.921833993284963,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 987348992
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 23.437791009200737,
"durationMs": 23.437791009200737,
"charactersPerSecond": 1237.3179703076864,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1178976256,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 23.437791009200737,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 987348992
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 22.38908299477771,
"durationMs": 22.38908299477771,
"charactersPerSecond": 1295.274130109049,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1178976256,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 22.38908299477771,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 987348992
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 22.470582989626564,
"durationMs": 22.470582989626564,
"charactersPerSecond": 1290.5762175101424,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1178976256,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 22.470582989626564,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 987348992
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 1491.564500000095,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 285.76541699294467,
"durationMs": 285.76541699294467,
"charactersPerSecond": 101.48183886336389,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1178976256,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 1777.3299169930397,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 987414528
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.06149999680929,
"durationMs": 25.06149999680929,
"charactersPerSecond": 1157.1534027768546,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1178976256,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 25.06149999680929,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 987414528
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 23.694957999396138,
"durationMs": 23.694957999396138,
"charactersPerSecond": 1223.8890653758094,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1178976256,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 23.694957999396138,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 987414528
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 23.26254200306721,
"durationMs": 23.26254200306721,
"charactersPerSecond": 1246.6393395947998,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1178976256,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 23.26254200306721,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 987414528
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.41679099178873,
"durationMs": 26.41679099178873,
"charactersPerSecond": 1097.7866315789158,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1178976256,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 26.41679099178873,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 987414528
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float32": 334
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 24.98233300866559,
"durationMs": 24.98233300866559,
"charactersPerSecond": 1160.820328107099,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1178976256,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 24.98233300866559,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 987414528
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 1502.478999987943,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 730.0254169967957,
"durationMs": 730.0254169967957,
"charactersPerSecond": 39.724644272388794,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162215424,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 2232.504416984739,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1199669248
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 264.6890420001,
"durationMs": 264.6890420001,
"charactersPerSecond": 124.67459835374495,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 33,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162772480,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 264.6890420001,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1199669248
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 160.40479199727997,
"durationMs": 160.40479199727997,
"charactersPerSecond": 355.3509797947094,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 57,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162805248,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 160.40479199727997,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1199669248
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 135.0033750059083,
"durationMs": 135.0033750059083,
"charactersPerSecond": 214.8094445692994,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1163116544,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 135.0033750059083,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1199669248
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.20054199360311,
"durationMs": 26.20054199360311,
"charactersPerSecond": 1106.8473319017744,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1163116544,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 26.20054199360311,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1199669248
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 24.39395900000818,
"durationMs": 24.39395900000818,
"charactersPerSecond": 1188.8189202904816,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1163116544,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 24.39395900000818,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1199669248
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.385624991031364,
"durationMs": 25.385624991031364,
"charactersPerSecond": 1142.378807307111,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1163116544,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 25.385624991031364,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1199669248
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 23.588834010297433,
"durationMs": 23.588834010297433,
"charactersPerSecond": 1229.3952294267867,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1163116544,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 23.588834010297433,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1199669248
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.81400001165457,
"durationMs": 26.81400001165457,
"charactersPerSecond": 1081.5245762435777,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1163116544,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 26.81400001165457,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1199669248
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 1545.9377920051338,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 320.406291008112,
"durationMs": 320.406291008112,
"charactersPerSecond": 90.51008302226431,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162215424,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 1866.3440830132458,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1098465280
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 27.591875012149103,
"durationMs": 27.591875012149103,
"charactersPerSecond": 1051.0340448857094,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162215424,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 27.591875012149103,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1098465280
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 27.75483299046755,
"durationMs": 27.75483299046755,
"charactersPerSecond": 1044.8630697925694,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162215424,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 27.75483299046755,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1098465280
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 24.649124999996275,
"durationMs": 24.649124999996275,
"charactersPerSecond": 1176.5123508442748,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162215424,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 24.649124999996275,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1098465280
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.489584004390053,
"durationMs": 25.489584004390053,
"charactersPerSecond": 1137.7196267701092,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162215424,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 25.489584004390053,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1098465280
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 24.70141700177919,
"durationMs": 24.70141700177919,
"charactersPerSecond": 1174.0217169691598,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162215424,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 24.70141700177919,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1098465280
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 1541.1867500079097,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 318.0857920087874,
"durationMs": 318.0857920087874,
"charactersPerSecond": 91.17037204603861,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162215424,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 1859.2725420166971,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1098137600
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 27.94370800256729,
"durationMs": 27.94370800256729,
"charactersPerSecond": 1037.800709817597,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162215424,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 27.94370800256729,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1098137600
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.87958300136961,
"durationMs": 25.87958300136961,
"charactersPerSecond": 1120.5744697843566,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162215424,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 25.87958300136961,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1098137600
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 24.69112499966286,
"durationMs": 24.69112499966286,
"charactersPerSecond": 1174.5110844643966,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162215424,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 24.69112499966286,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1098137600
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 24.552583010517992,
"durationMs": 24.552583010517992,
"charactersPerSecond": 1181.1384564946504,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162215424,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 24.552583010517992,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1098137600
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.float16": 334
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.05537499766797,
"durationMs": 26.05537499766797,
"charactersPerSecond": 1113.014109472444,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162215424,
"device": "mps",
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 26.05537499766797,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1098137600
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 1512.6468329981435,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 777.7936249913182,
"durationMs": 777.7936249913182,
"charactersPerSecond": 37.28495460518039,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162215424,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 2290.4404579894617,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1197637632
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 266.1305840010755,
"durationMs": 266.1305840010755,
"charactersPerSecond": 123.99927698601766,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 33,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162772480,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 266.1305840010755,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1197637632
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 150.8566249976866,
"durationMs": 150.8566249976866,
"charactersPerSecond": 377.84220614026134,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 57,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162805248,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 150.8566249976866,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1197637632
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 129.7135829954641,
"durationMs": 129.7135829954641,
"charactersPerSecond": 223.56949311171283,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1163116544,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 129.7135829954641,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1197637632
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 24.42383300513029,
"durationMs": 24.42383300513029,
"charactersPerSecond": 1187.3648167307922,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1163116544,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 24.42383300513029,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1197637632
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.9074580098968,
"durationMs": 25.9074580098968,
"charactersPerSecond": 1119.3687929136788,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1163116544,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 25.9074580098968,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1197637632
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 23.970374997588806,
"durationMs": 23.970374997588806,
"charactersPerSecond": 1209.8267133041152,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1163116544,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 23.970374997588806,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1197637632
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 24.084917007712647,
"durationMs": 24.084917007712647,
"charactersPerSecond": 1204.0730715706186,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1163116544,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 24.084917007712647,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1197637632
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 22.823625011369586,
"durationMs": 22.823625011369586,
"charactersPerSecond": 1270.6132345564586,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1163116544,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 22.823625011369586,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1197637632
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 1515.0920000014594,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 347.52733299683314,
"durationMs": 347.52733299683314,
"charactersPerSecond": 83.44667381965108,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162215424,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 1862.6193329982925,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1097646080
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.2061670034891,
"durationMs": 25.2061670034891,
"charactersPerSecond": 1150.5120947578325,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162215424,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 25.2061670034891,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1097646080
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 24.32704200327862,
"durationMs": 24.32704200327862,
"charactersPerSecond": 1192.0890339274126,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162215424,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 24.32704200327862,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1097646080
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 23.734917005640455,
"durationMs": 23.734917005640455,
"charactersPerSecond": 1221.8285824681136,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162215424,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 23.734917005640455,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1097646080
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 24.850125002558343,
"durationMs": 24.850125002558343,
"charactersPerSecond": 1166.9961417503705,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162215424,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 24.850125002558343,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1097646080
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 24.320625001564622,
"durationMs": 24.320625001564622,
"charactersPerSecond": 1192.4035668546487,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162215424,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 24.320625001564622,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1097646080
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 1475.3739169973414,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 313.39566700626165,
"durationMs": 313.39566700626165,
"charactersPerSecond": 92.53478287375485,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162215424,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 1788.769584003603,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "acceptable",
"observedResidentBytesAtCaseEnd": 1097170944
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 31.557041991618462,
"durationMs": 31.557041991618462,
"charactersPerSecond": 918.9707960493379,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162215424,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 31.557041991618462,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "good",
"observedResidentBytesAtCaseEnd": 1097170944
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.680249997298233,
"durationMs": 26.680249997298233,
"charactersPerSecond": 1086.9463368198078,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162215424,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 26.680249997298233,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1097170944
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 28.421583003364503,
"durationMs": 28.421583003364503,
"charactersPerSecond": 1020.351329360051,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162215424,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 28.421583003364503,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1097170944
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 25.40483299526386,
"durationMs": 25.40483299526386,
"charactersPerSecond": 1141.515081221214,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162215424,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 25.40483299526386,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1097170944
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"entityF1": 1,
"exactOffsets": true,
"classificationExactMatch": true,
"passed": true
},
"runtime": {
"engine": "gliner2",
"version": "2.1.0",
"transformersVersion": "5.22.1",
"torchVersion": "2.10.0",
"loadMs": 0,
"placement": {
"mps:0/torch.bfloat16": 334
},
"parameterDtype": "torch.bfloat16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "Built-in DeBERTa encoder and boundary heads on selected device; tokenization/schema/decoding/JSON on CPU",
"inferenceMs": 26.77645800577011,
"durationMs": 26.77645800577011,
"charactersPerSecond": 1083.0409307217085,
"activationPlacement": {
"encoderOutput": "mps:0"
},
"inputCharacters": 29,
"threshold": 0.5,
"driverAllocatedMemoryBytes": 1162215424,
"device": "mps",
"precision": "bf16",
"cpuThreads": 4,
"totalMs": 26.77645800577011,
"artifactRevision": "df5910e44bc4ffdb0d95399a83b0ca4516349aa5",
"fallback": false,
"grade": "excellent",
"observedResidentBytesAtCaseEnd": 1097170944
}
}
]