LightOnOCR 2 Desktop
Read document images and locally rasterized PDF pages with this exact LightOnOCR-2 BBox checkpoint on the verified native CPU/Metal configurations. Includes independently tested embedded-image coordinates and optional overlays.
Desktop app
Run LightOnOCR 2 Desktop on your computer
Download the desktop app to load this model, provide input and view results locally.
Public desktop downloads are coming soon.Device requirements
If your device falls short
MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.
GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.
PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.
Benchmark evidence
Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.
LightOnOCR-2 1B BBox Desktop
36 configurations testedQuality criteria
Frozen four-fixture paragraphCER/token recall, caption/receipt phrases, ordered PDF pages, EOS/non-repetition/resource/speed and bboxIoU where applicable; narrow English/cropped-page scope.
| Precision | Device | Result | Platform | Inference / load | |
|---|---|---|---|---|---|
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4217 ms / 690 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4230 ms / 690 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4270 ms / 690 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4271 ms / 690 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4288 ms / 690 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4326 ms / 690 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4333 ms / 690 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4358 ms / 690 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4381 ms / 690 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4443 ms / 690 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4451 ms / 690 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4465 ms / 690 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4467 ms / 673 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4503 ms / 690 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4509 ms / 690 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4516 ms / 690 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4570 ms / 690 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4673 ms / 651 ms |
FP32 | mpsAccelerated | Passed | Not measured | macos · aarch64 | 26492 ms / 690 ms |
FP32 | mpsAccelerated | Passed | Not measured | macos · aarch64 | 18777 ms / 690 ms |
FP32 | mpsAccelerated | Passed | Not measured | macos · aarch64 | 36810 ms / 690 ms |
FP32 | mpsAccelerated | Passed | Not measured | macos · aarch64 | 41148 ms / 690 ms |
FP32 | mpsAccelerated | Passed | Not measured | macos · aarch64 | 29453 ms / 690 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 6977 ms / 340 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7040 ms / 340 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7041 ms / 340 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7101 ms / 340 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7104 ms / 340 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7187 ms / 337 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7192 ms / 340 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7258 ms / 334 ms |
FP32 | cpu | Passed | Not measured | macos · aarch64 | 36307 ms / 340 ms |
FP32 | cpu | Passed | Not measured | macos · aarch64 | 23968 ms / 340 ms |
FP32 | cpu | Passed | Not measured | macos · aarch64 | 45643 ms / 340 ms |
FP32 | cpu | Passed | Not measured | macos · aarch64 | 44338 ms / 340 ms |
FP32 | cpu | Passed | Not measured | macos · aarch64 | 34764 ms / 340 ms |
Test setup & sample details
- Quality gate
- Frozen four-fixture paragraphCER/token recall, caption/receipt phrases, ordered PDF pages, EOS/non-repetition/resource/speed and bboxIoU where applicable; narrow English/cropped-page scope.
- Tested
- 2026-11-08T09:45:23.312152+00:00
- Environment
- { "hardware": "Apple M3 Max", "os": "macOS27.2/aarch64", "python": "3.13.18 app-owned private development venv", "runtime": "Transformers5.22.1/Torch2.10.0/Pillow12.0.0/PDFium5.14.0", "scope": "Exact immutable local snapshots; model-process loads exclude interpreter imports/network setup. totalMs is model-load component plus full helper request wall time, not warm IPC session elapsed time. Concurrent tracked transfers/background host activity recorded separately." }
- Runtime
- transformers 5.22.1
- Artifact revision
- 714ffe765cc4cb6f2d92530236f45d1c9465cd96
- Fixture
{ "file": "model-samples/desktop/lightonocr2/fixtures/scientific-paragraph.png", "url": "https://assets.localai.tools/samples/v1/files/de0959e7c3fe59f4d706bb84d993cd1aae000a6b25bcef96f472d3a675871dfb/scientific-paragraph.png", "size": 26674, "sha1": "b4e9dd3ea6464bc8e1ff1f95134eccfc25622d52", "sha256": "de0959e7c3fe59f4d706bb84d993cd1aae000a6b25bcef96f472d3a675871dfb" }- Rerun when
- artifact revision/weight change; pinned runtime/prediction/preprocessing change; fixture/checksum or quality-gate change; relevant host/backend behavior change
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 340.03149999989546,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7221.278666000217,
"inferenceMs": 7191.577083000084,
"pagesPerSecond": 0.13905155829642218,
"tokensPerSecond": 8.34309349778533,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7191.577083000084
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 6484803584,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 7224.382749998767,
"totalMs": 7564.414249998663,
"postUseRssBytes": 4779786240,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 0.8333333333333334,
"textQuality": true,
"imageBoxIoU": 0.8561118241616472,
"bboxQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 340.03149999989546,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 36332.50091700029,
"inferenceMs": 36307.001666998985,
"pagesPerSecond": 0.027542896799130166,
"tokensPerSecond": 9.034070150114696,
"neuralInferencePerformed": true,
"outputTokens": 328,
"maxNewTokens": 1024,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
36307.001666998985
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 6592987136,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 36341.21541700006,
"totalMs": 36681.24691699995,
"postUseRssBytes": 5785894912,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 340.03149999989546,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 23995.175542000652,
"inferenceMs": 23967.513042000064,
"pagesPerSecond": 0.04172314408456252,
"tokensPerSecond": 2.086157204228126,
"neuralInferencePerformed": true,
"outputTokens": 50,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
23967.513042000064
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7159676928,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 23998.07249999867,
"totalMs": 24338.103999998566,
"postUseRssBytes": 5368889344,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"pageOrder": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 340.03149999989546,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 45707.04720800131,
"inferenceMs": 45643.22295799866,
"pagesPerSecond": 0.04381811516334899,
"tokensPerSecond": 1.5336340307172147,
"neuralInferencePerformed": true,
"outputTokens": 70,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "application/pdf",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
24058.199749999403,
21585.023207999257
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7159676928,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 45711.312749999706,
"totalMs": 46051.3442499996,
"postUseRssBytes": 5298585600,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 340.03149999989546,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7051.403874998869,
"inferenceMs": 7040.584833999674,
"pagesPerSecond": 0.14203365538199356,
"tokensPerSecond": 8.522019322919613,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7040.584833999674
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7159676928,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 7054.308333001245,
"totalMs": 7394.3398330011405,
"postUseRssBytes": 4799348736,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 340.03149999989546,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7049.8134999998,
"inferenceMs": 7040.390791000391,
"pagesPerSecond": 0.14203757002782894,
"tokensPerSecond": 8.522254201669737,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7040.390791000391
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7159676928,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 7052.556750000804,
"totalMs": 7392.588250000699,
"postUseRssBytes": 4799676416,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 340.03149999989546,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7110.94491699987,
"inferenceMs": 7101.422957999603,
"pagesPerSecond": 0.14081684838579023,
"tokensPerSecond": 8.449010903147414,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7101.422957999603
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7159676928,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 7113.6508750005305,
"totalMs": 7453.682375000426,
"postUseRssBytes": 4800184320,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 340.03149999989546,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 6986.722583000301,
"inferenceMs": 6977.087291999851,
"pagesPerSecond": 0.14332628475877485,
"tokensPerSecond": 8.59957708552649,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
6977.087291999851
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7159676928,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 6989.497999999003,
"totalMs": 7329.529499998898,
"postUseRssBytes": 4800200704,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 340.03149999989546,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7113.404082998386,
"inferenceMs": 7103.7651669994375,
"pagesPerSecond": 0.1407704191356864,
"tokensPerSecond": 8.446225148141183,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7103.7651669994375
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7159676928,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 7116.224916999272,
"totalMs": 7456.256416999167,
"postUseRssBytes": 4800200704,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"pageOrder": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 340.03149999989546,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 44394.15166699837,
"inferenceMs": 44337.535500999365,
"pagesPerSecond": 0.045108506311879244,
"tokensPerSecond": 1.5787977209157735,
"neuralInferencePerformed": true,
"outputTokens": 70,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "application/pdf",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
23546.818208998957,
20790.71729200041
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7159676928,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 44398.31262500047,
"totalMs": 44738.34412500037,
"postUseRssBytes": 5271453696,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 0.8333333333333334,
"textQuality": true,
"imageBoxIoU": 0.8561118241616472,
"bboxQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 340.03149999989546,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 34789.32429199995,
"inferenceMs": 34763.90058299876,
"pagesPerSecond": 0.02876547174597113,
"tokensPerSecond": 9.43507473267853,
"neuralInferencePerformed": true,
"outputTokens": 328,
"maxNewTokens": 1024,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
34763.90058299876
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"visualizationMs": 5.800082999485312,
"peakResidentMemoryBytes": 7159676928,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 34804.201500001,
"totalMs": 35144.233000000895,
"postUseRssBytes": 5246484480,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 334.23374999983935,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7287.888541999564,
"inferenceMs": 7258.394083999519,
"pagesPerSecond": 0.13777152196853165,
"tokensPerSecond": 8.2662913181119,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7258.394083999519
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 6485803008,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 7290.8463749990915,
"totalMs": 7625.080124998931,
"postUseRssBytes": 4781441024,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 336.55937500043365,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7216.885084000751,
"inferenceMs": 7187.38441700043,
"pagesPerSecond": 0.1391326721908299,
"tokensPerSecond": 8.347960331449794,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7187.38441700043
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 6491226112,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 7219.998333001058,
"totalMs": 7556.557708001492,
"postUseRssBytes": 4783538176,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 690.0489170002402,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 4318.7340419990505,
"inferenceMs": 4287.960415998896,
"pagesPerSecond": 0.23321110807573683,
"tokensPerSecond": 13.99266648454421,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
4287.960415998896
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 8775548928,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6487965696,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 4321.902207999301,
"totalMs": 5011.951124999541,
"postUseRssBytes": 1165426688,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 0.8333333333333334,
"textQuality": true,
"imageBoxIoU": 0.8561118241616472,
"bboxQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 690.0489170002402,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 26522.168916000737,
"inferenceMs": 26491.591124999104,
"pagesPerSecond": 0.037747827047516905,
"tokensPerSecond": 12.381287271585546,
"neuralInferencePerformed": true,
"outputTokens": 328,
"maxNewTokens": 1024,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
26491.591124999104
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 22920691712,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6487965696,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 26532.848374999958,
"totalMs": 27222.897292000198,
"postUseRssBytes": 1252802560,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 690.0489170002402,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 18809.909707999395,
"inferenceMs": 18777.010832998712,
"pagesPerSecond": 0.05325661304101718,
"tokensPerSecond": 2.6628306520508587,
"neuralInferencePerformed": true,
"outputTokens": 50,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
18777.010832998712
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44515115008,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6487965696,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 18813.114667000264,
"totalMs": 19503.163584000504,
"postUseRssBytes": 1328939008,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"pageOrder": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 690.0489170002402,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 36877.3287089989,
"inferenceMs": 36810.079083001256,
"pagesPerSecond": 0.054332944938539726,
"tokensPerSecond": 1.9016530728488903,
"neuralInferencePerformed": true,
"outputTokens": 70,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "application/pdf",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
18931.189625000115,
17878.88945800114
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44515115008,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6487965696,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 36881.57629200032,
"totalMs": 37571.62520900056,
"postUseRssBytes": 1338081280,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 690.0489170002402,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 4228.9909579994855,
"inferenceMs": 4216.710250000688,
"pagesPerSecond": 0.23715169900512773,
"tokensPerSecond": 14.229101940307665,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
4216.710250000688
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 45469319168,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6487965696,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 4231.8931669997255,
"totalMs": 4921.942083999966,
"postUseRssBytes": 1341145088,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 690.0489170002402,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 4455.005624999103,
"inferenceMs": 4442.946625000332,
"pagesPerSecond": 0.22507585267241995,
"tokensPerSecond": 13.504551160345196,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
4442.946625000332
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6487965696,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 4457.902750000358,
"totalMs": 5147.951667000598,
"postUseRssBytes": 1343864832,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 690.0489170002402,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 4242.177875001289,
"inferenceMs": 4229.877083000247,
"pagesPerSecond": 0.23641348918127456,
"tokensPerSecond": 14.184809350876472,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
4229.877083000247
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6487965696,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 4245.215832999747,
"totalMs": 4935.2647499999875,
"postUseRssBytes": 1346486272,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 690.0489170002402,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 4370.71562500023,
"inferenceMs": 4357.704292000562,
"pagesPerSecond": 0.229478627504785,
"tokensPerSecond": 13.768717650287101,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
4357.704292000562
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6487965696,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 4373.5235830008605,
"totalMs": 5063.572500001101,
"postUseRssBytes": 1349189632,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 690.0489170002402,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 4283.35854100078,
"inferenceMs": 4269.750333000047,
"pagesPerSecond": 0.23420573148532825,
"tokensPerSecond": 14.052343889119696,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
4269.750333000047
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6487965696,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 4286.295417001384,
"totalMs": 4976.344334001624,
"postUseRssBytes": 1351745536,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 690.0489170002402,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 4284.705499998381,
"inferenceMs": 4271.195375000389,
"pagesPerSecond": 0.2341264943891519,
"tokensPerSecond": 14.047589663349113,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
4271.195375000389
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6487965696,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 4287.651084001482,
"totalMs": 4977.700001001722,
"postUseRssBytes": 1354366976,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 690.0489170002402,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 4478.215249999266,
"inferenceMs": 4465.3553329990245,
"pagesPerSecond": 0.2239463436672081,
"tokensPerSecond": 13.436780620032486,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
4465.3553329990245
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6487965696,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 4481.207499999073,
"totalMs": 5171.256416999313,
"postUseRssBytes": 1356955648,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 690.0489170002402,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 4339.134166999429,
"inferenceMs": 4325.855082999624,
"pagesPerSecond": 0.23116816925512504,
"tokensPerSecond": 13.870090155307501,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
4325.855082999624
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6487965696,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 4342.416542000137,
"totalMs": 5032.465459000377,
"postUseRssBytes": 1359511552,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 690.0489170002402,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 4584.955000000264,
"inferenceMs": 4570.196750000832,
"pagesPerSecond": 0.21880896046758117,
"tokensPerSecond": 13.12853762805487,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
4570.196750000832
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6487965696,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 4588.136624999606,
"totalMs": 5278.1855419998465,
"postUseRssBytes": 1362034688,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 690.0489170002402,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 4345.674333000716,
"inferenceMs": 4332.881042000736,
"pagesPerSecond": 0.23079331980419282,
"tokensPerSecond": 13.84759918825157,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
4332.881042000736
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6487965696,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 4348.770165999667,
"totalMs": 5038.819082999908,
"postUseRssBytes": 1364606976,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 690.0489170002402,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 4522.420041999794,
"inferenceMs": 4508.502500000759,
"pagesPerSecond": 0.2218031375162444,
"tokensPerSecond": 13.308188250974665,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
4508.502500000759
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6487965696,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 4525.564125000528,
"totalMs": 5215.6130420007685,
"postUseRssBytes": 1367244800,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 690.0489170002402,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 4393.375041001491,
"inferenceMs": 4380.805875000078,
"pagesPerSecond": 0.22826850322373213,
"tokensPerSecond": 13.696110193423928,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
4380.805875000078
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6487965696,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 4396.35995900062,
"totalMs": 5086.40887600086,
"postUseRssBytes": 1369800704,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 690.0489170002402,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 4516.183292000278,
"inferenceMs": 4502.779708000162,
"pagesPerSecond": 0.222085037432163,
"tokensPerSecond": 13.32510224592978,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
4502.779708000162
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6487965696,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 4519.366958000319,
"totalMs": 5209.415875000559,
"postUseRssBytes": 1372356608,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 690.0489170002402,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 4529.125541001122,
"inferenceMs": 4516.327249999449,
"pagesPerSecond": 0.2214188531179006,
"tokensPerSecond": 13.285131187074036,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
4516.327249999449
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6487965696,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 4532.093208999868,
"totalMs": 5222.142126000108,
"postUseRssBytes": 1374896128,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 690.0489170002402,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 4463.356957998258,
"inferenceMs": 4450.736916998721,
"pagesPerSecond": 0.2246818939534923,
"tokensPerSecond": 13.480913637209538,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
4450.736916998721
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6487965696,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 4466.575791999276,
"totalMs": 5156.624708999516,
"postUseRssBytes": 1377550336,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"pageOrder": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 690.0489170002402,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 41218.01145800055,
"inferenceMs": 41147.997750002105,
"pagesPerSecond": 0.04860503813942922,
"tokensPerSecond": 1.7011763348800226,
"neuralInferencePerformed": true,
"outputTokens": 70,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "application/pdf",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
21536.910000000717,
19611.08775000139
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44515115008,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6487965696,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 41222.66112500074,
"totalMs": 41912.71004200098,
"postUseRssBytes": 1380548608,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 0.8333333333333334,
"textQuality": true,
"imageBoxIoU": 0.8561118241616472,
"bboxQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 690.0489170002402,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 29479.267082999286,
"inferenceMs": 29452.9117080001,
"pagesPerSecond": 0.03395250051723669,
"tokensPerSecond": 11.136420169653634,
"neuralInferencePerformed": true,
"outputTokens": 328,
"maxNewTokens": 1024,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
29452.9117080001
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44355731456,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"visualizationMs": 5.9521250004763715,
"peakResidentMemoryBytes": 6487965696,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 29494.7137500003,
"totalMs": 30184.76266700054,
"postUseRssBytes": 1396080640,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 672.5859170001058,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 4499.790584000948,
"inferenceMs": 4467.486207999173,
"pagesPerSecond": 0.22383952707217517,
"tokensPerSecond": 13.43037162433051,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
4467.486207999173
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 8775548928,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6489325568,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 4503.258875000029,
"totalMs": 5175.8447920001345,
"postUseRssBytes": 1166360576,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 651.0348330011766,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 4703.598625001177,
"inferenceMs": 4673.298333000275,
"pagesPerSecond": 0.2139816311187641,
"tokensPerSecond": 12.838897867125844,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
4673.298333000275
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 8775548928,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6487638016,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
"fallback": false,
"requestWallMs": 4706.964832999802,
"totalMs": 5357.999666000978,
"postUseRssBytes": 1164066816,
"grade": "fast"
}
}
]LightOnOCR-2 1B Base Desktop
34 configurations testedQuality criteria
Frozen four-fixture paragraphCER/token recall, caption/receipt phrases, ordered PDF pages, EOS/non-repetition/resource/speed and bboxIoU where applicable; narrow English/cropped-page scope.
| Precision | Device | Result | Platform | Inference / load | |
|---|---|---|---|---|---|
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3839 ms / 680 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3842 ms / 680 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3853 ms / 680 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3855 ms / 680 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3868 ms / 680 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3880 ms / 680 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3882 ms / 680 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3886 ms / 680 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3887 ms / 680 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3888 ms / 680 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3897 ms / 680 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3900 ms / 680 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3908 ms / 680 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3918 ms / 680 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3951 ms / 680 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3962 ms / 680 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4125 ms / 674 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4126 ms / 653 ms |
FP32 | mpsAccelerated | Passed | Not measured | macos · aarch64 | 22951 ms / 680 ms |
FP32 | mpsAccelerated | Passed | Not measured | macos · aarch64 | 16759 ms / 680 ms |
FP32 | mpsAccelerated | Passed | Not measured | macos · aarch64 | 31930 ms / 680 ms |
FP32 | mpsAccelerated | Passed | Not measured | macos · aarch64 | 33552 ms / 680 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7373 ms / 335 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7375 ms / 335 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7415 ms / 335 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7426 ms / 336 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7483 ms / 335 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7510 ms / 335 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7514 ms / 336 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7558 ms / 335 ms |
FP32 | cpu | Passed | Not measured | macos · aarch64 | 35560 ms / 335 ms |
FP32 | cpu | Passed | Not measured | macos · aarch64 | 23795 ms / 335 ms |
FP32 | cpu | Passed | Not measured | macos · aarch64 | 45755 ms / 335 ms |
FP32 | cpu | Passed | Not measured | macos · aarch64 | 45879 ms / 335 ms |
Test setup & sample details
- Quality gate
- Frozen four-fixture paragraphCER/token recall, caption/receipt phrases, ordered PDF pages, EOS/non-repetition/resource/speed and bboxIoU where applicable; narrow English/cropped-page scope.
- Tested
- 2026-11-08T09:54:32.664863+00:00
- Environment
- { "hardware": "Apple M3 Max", "os": "macOS27.2/aarch64", "python": "3.13.18 app-owned private development venv", "runtime": "Transformers5.22.1/Torch2.10.0/Pillow12.0.0/PDFium5.14.0", "scope": "Exact immutable local snapshots; model-process loads exclude interpreter imports/network setup. totalMs is model-load component plus full helper request wall time, not warm IPC session elapsed time. Concurrent tracked transfers/background host activity recorded separately." }
- Runtime
- transformers 5.22.1
- Artifact revision
- c1bc8eb6625be7b34178ff53481b242f7b8ffcb8
- Fixture
{ "file": "model-samples/desktop/lightonocr2/fixtures/scientific-paragraph.png", "url": "https://assets.localai.tools/samples/v1/files/de0959e7c3fe59f4d706bb84d993cd1aae000a6b25bcef96f472d3a675871dfb/scientific-paragraph.png", "size": 26674, "sha1": "b4e9dd3ea6464bc8e1ff1f95134eccfc25622d52", "sha256": "de0959e7c3fe59f4d706bb84d993cd1aae000a6b25bcef96f472d3a675871dfb" }- Rerun when
- artifact revision/weight change; pinned runtime/prediction/preprocessing change; fixture/checksum or quality-gate change; relevant host/backend behavior change
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 335.23629100091057,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7538.727166000172,
"inferenceMs": 7509.500500000286,
"pagesPerSecond": 0.13316464923332277,
"tokensPerSecond": 8.922031498632625,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7509.500500000286
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 6490161152,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 7541.668416000903,
"totalMs": 7876.904707001813,
"postUseRssBytes": 4784160768,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 0.8333333333333334,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 335.23629100091057,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 35585.01304099991,
"inferenceMs": 35559.96920899997,
"pagesPerSecond": 0.028121509164493515,
"tokensPerSecond": 8.914518405144445,
"neuralInferencePerformed": true,
"outputTokens": 317,
"maxNewTokens": 1024,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
35559.96920899997
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 6591905792,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 35593.521624999994,
"totalMs": 35928.757916000905,
"postUseRssBytes": 5784403968,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 335.23629100091057,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 23821.623707999606,
"inferenceMs": 23794.71341700082,
"pagesPerSecond": 0.04202614179355996,
"tokensPerSecond": 2.1013070896779977,
"neuralInferencePerformed": true,
"outputTokens": 50,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
23794.71341700082
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7251443712,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 23824.45162499971,
"totalMs": 24159.68791600062,
"postUseRssBytes": 5488541696,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"pageOrder": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 335.23629100091057,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 45818.383665999136,
"inferenceMs": 45755.1181660001,
"pagesPerSecond": 0.043710956941341,
"tokensPerSecond": 1.5954499283589467,
"neuralInferencePerformed": true,
"outputTokens": 73,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "application/pdf",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
24121.44708300002,
21633.67108300008
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7251443712,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 45822.62087500021,
"totalMs": 46157.85716600112,
"postUseRssBytes": 5288853504,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 335.23629100091057,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7568.725416000234,
"inferenceMs": 7557.6993329996185,
"pagesPerSecond": 0.13231539863376707,
"tokensPerSecond": 8.865131708462394,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7557.6993329996185
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7251443712,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 7571.682417001284,
"totalMs": 7906.918708002195,
"postUseRssBytes": 4800561152,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 335.23629100091057,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7385.118792000867,
"inferenceMs": 7375.171249999767,
"pagesPerSecond": 0.13559007189155528,
"tokensPerSecond": 9.084534816734203,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7375.171249999767
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7251443712,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 7387.789665999662,
"totalMs": 7723.025957000573,
"postUseRssBytes": 4800626688,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 335.23629100091057,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7424.209541999517,
"inferenceMs": 7414.713207999739,
"pagesPerSecond": 0.13486698297664423,
"tokensPerSecond": 9.036087859435163,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7414.713207999739
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7251443712,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 7426.916042000812,
"totalMs": 7762.152333001723,
"postUseRssBytes": 4800593920,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 335.23629100091057,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7492.621708001025,
"inferenceMs": 7483.190582999669,
"pagesPerSecond": 0.13363283868137776,
"tokensPerSecond": 8.95340019165231,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7483.190582999669
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7251443712,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 7495.4515419995005,
"totalMs": 7830.687833000411,
"postUseRssBytes": 4800593920,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 335.23629100091057,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7382.457959000021,
"inferenceMs": 7373.087166000914,
"pagesPerSecond": 0.13562839791332476,
"tokensPerSecond": 9.087102660192759,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7373.087166000914
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7251443712,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 7385.207125000306,
"totalMs": 7720.443416001217,
"postUseRssBytes": 4800561152,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"pageOrder": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 335.23629100091057,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 45935.30241600092,
"inferenceMs": 45879.293501000575,
"pagesPerSecond": 0.04359265035230724,
"tokensPerSecond": 1.5911317378592142,
"neuralInferencePerformed": true,
"outputTokens": 73,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "application/pdf",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
24190.030417001253,
21689.26308399932
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7251443712,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 45939.3943340001,
"totalMs": 46274.63062500101,
"postUseRssBytes": 5272305664,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 335.9951660004299,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7454.72320800036,
"inferenceMs": 7425.61383300017,
"pagesPerSecond": 0.13466900144414998,
"tokensPerSecond": 9.022823096758048,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7425.61383300017
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 6485327872,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 7457.628666001256,
"totalMs": 7793.6238320016855,
"postUseRssBytes": 4781228032,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 335.918082999342,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7543.54208299992,
"inferenceMs": 7514.023832998646,
"pagesPerSecond": 0.13308448605238543,
"tokensPerSecond": 8.916660565509824,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7514.023832998646
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 6486048768,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 7546.568916999604,
"totalMs": 7882.486999998946,
"postUseRssBytes": 4780195840,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 680.4342909999832,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3993.60466699909,
"inferenceMs": 3962.208249999094,
"pagesPerSecond": 0.2523845131058492,
"tokensPerSecond": 16.909762378091894,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3962.208249999094
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 8775548928,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485819392,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 3996.7364170006476,
"totalMs": 4677.170708000631,
"postUseRssBytes": 1163608064,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 0.8333333333333334,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 680.4342909999832,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 22982.439749999685,
"inferenceMs": 22951.171875,
"pagesPerSecond": 0.04357075993532465,
"tokensPerSecond": 13.811930899497915,
"neuralInferencePerformed": true,
"outputTokens": 317,
"maxNewTokens": 1024,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
22951.171875
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 22920691712,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485819392,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 22992.907583000488,
"totalMs": 23673.34187400047,
"postUseRssBytes": 1251622912,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 680.4342909999832,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 16796.400375000303,
"inferenceMs": 16758.672332998685,
"pagesPerSecond": 0.059670598012167626,
"tokensPerSecond": 2.9835299006083815,
"neuralInferencePerformed": true,
"outputTokens": 50,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
16758.672332998685
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44515115008,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485819392,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 16800.292665999223,
"totalMs": 17480.726956999206,
"postUseRssBytes": 1327841280,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"pageOrder": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 680.4342909999832,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 32006.705792000503,
"inferenceMs": 31930.1118759995,
"pagesPerSecond": 0.06263679901176025,
"tokensPerSecond": 2.2862431639292495,
"neuralInferencePerformed": true,
"outputTokens": 73,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "application/pdf",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
16499.233333999655,
15430.878541999846
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44515115008,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485819392,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 32011.260834000495,
"totalMs": 32691.69512500048,
"postUseRssBytes": 1333149696,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 680.4342909999832,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3857.3075830008747,
"inferenceMs": 3841.59662500133,
"pagesPerSecond": 0.2603084336059499,
"tokensPerSecond": 17.440665051598646,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3841.59662500133
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 45469319168,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485819392,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 3861.336834001122,
"totalMs": 4541.771125001105,
"postUseRssBytes": 1336410112,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 680.4342909999832,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3868.372000000818,
"inferenceMs": 3854.562000000442,
"pagesPerSecond": 0.2594328486608557,
"tokensPerSecond": 17.382000860277333,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3854.562000000442
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485819392,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 3871.809124999345,
"totalMs": 4552.243415999328,
"postUseRssBytes": 1339408384,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 680.4342909999832,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3914.415999999619,
"inferenceMs": 3899.8816660005104,
"pagesPerSecond": 0.2564180366594408,
"tokensPerSecond": 17.180008456182534,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3899.8816660005104
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485819392,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 3917.6856670001143,
"totalMs": 4598.1199580000975,
"postUseRssBytes": 1342357504,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 680.4342909999832,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3867.006374999619,
"inferenceMs": 3853.439709000668,
"pagesPerSecond": 0.2595084069083139,
"tokensPerSecond": 17.38706326285703,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3853.439709000668
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485819392,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 3870.405874999051,
"totalMs": 4550.840165999034,
"postUseRssBytes": 1345290240,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 680.4342909999832,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3853.5056249984336,
"inferenceMs": 3839.3794170006004,
"pagesPerSecond": 0.2604587594474369,
"tokensPerSecond": 17.450736882978273,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3839.3794170006004
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485819392,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 3856.523999998899,
"totalMs": 4536.958290998882,
"postUseRssBytes": 1348239360,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 680.4342909999832,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3920.5635840007744,
"inferenceMs": 3907.780792000267,
"pagesPerSecond": 0.25589971731452527,
"tokensPerSecond": 17.145281060073195,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3907.780792000267
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485819392,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 3923.6611659998744,
"totalMs": 4604.095456999858,
"postUseRssBytes": 1351122944,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 680.4342909999832,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3882.901208000476,
"inferenceMs": 3868.2095000003756,
"pagesPerSecond": 0.25851753892851537,
"tokensPerSecond": 17.32067510821053,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3868.2095000003756
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485819392,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 3886.1685000010766,
"totalMs": 4566.60279100106,
"postUseRssBytes": 1354006528,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 680.4342909999832,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3900.0280000000203,
"inferenceMs": 3886.460375000752,
"pagesPerSecond": 0.2573035367689312,
"tokensPerSecond": 17.23933696351839,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3886.460375000752
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485819392,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 3903.494333000708,
"totalMs": 4583.928624000691,
"postUseRssBytes": 1356873728,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 680.4342909999832,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3900.6265420011914,
"inferenceMs": 3886.876750000738,
"pagesPerSecond": 0.25727597356921855,
"tokensPerSecond": 17.237490229137645,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3886.876750000738
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485819392,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 3904.0540419991885,
"totalMs": 4584.488332999172,
"postUseRssBytes": 1359740928,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 680.4342909999832,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3901.877832999162,
"inferenceMs": 3888.204124999902,
"pagesPerSecond": 0.2571881433822678,
"tokensPerSecond": 17.231605606611943,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3888.204124999902
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485819392,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 3905.157416998918,
"totalMs": 4585.591707998901,
"postUseRssBytes": 1362608128,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 680.4342909999832,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3964.073124998322,
"inferenceMs": 3950.541500000327,
"pagesPerSecond": 0.25312985574253993,
"tokensPerSecond": 16.959700334750174,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3950.541500000327
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485819392,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 3967.3144579992368,
"totalMs": 4647.74874899922,
"postUseRssBytes": 1365508096,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 680.4342909999832,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3910.5376250008703,
"inferenceMs": 3897.0187499999156,
"pagesPerSecond": 0.25660641227349024,
"tokensPerSecond": 17.192629622323846,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3897.0187499999156
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485819392,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 3913.8245829999505,
"totalMs": 4594.258873999934,
"postUseRssBytes": 1368358912,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 680.4342909999832,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3895.3761249995296,
"inferenceMs": 3881.681208000373,
"pagesPerSecond": 0.2576203316075883,
"tokensPerSecond": 17.260562217708415,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3881.681208000373
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485819392,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 3898.746459000904,
"totalMs": 4579.180750000887,
"postUseRssBytes": 1371258880,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 680.4342909999832,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3893.3773749995453,
"inferenceMs": 3879.7373750003317,
"pagesPerSecond": 0.2577494050096405,
"tokensPerSecond": 17.269210135645913,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3879.7373750003317
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485819392,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 3896.704333001253,
"totalMs": 4577.138624001236,
"postUseRssBytes": 1374158848,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 680.4342909999832,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3932.5436250001076,
"inferenceMs": 3918.4858340013307,
"pagesPerSecond": 0.25520061635105057,
"tokensPerSecond": 17.098441295520388,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3918.4858340013307
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485819392,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 3935.7598749993485,
"totalMs": 4616.194165999332,
"postUseRssBytes": 1376976896,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"pageOrder": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 680.4342909999832,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 33629.99816699994,
"inferenceMs": 33551.6177089994,
"pagesPerSecond": 0.059609644379786456,
"tokensPerSecond": 2.175752019862206,
"neuralInferencePerformed": true,
"outputTokens": 73,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "application/pdf",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
17259.4937089998,
16292.123999999603
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44515115008,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485819392,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 33634.321791998445,
"totalMs": 34314.75608299843,
"postUseRssBytes": 1379926016,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 653.3955409995542,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 4156.651208000767,
"inferenceMs": 4126.197499999762,
"pagesPerSecond": 0.24235388635664137,
"tokensPerSecond": 16.23771038589497,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
4126.197499999762
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 8775548928,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6488473600,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 4159.851708000133,
"totalMs": 4813.247248999687,
"postUseRssBytes": 1168441344,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 673.9689580008417,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 4158.222750000277,
"inferenceMs": 4125.235666000663,
"pagesPerSecond": 0.24241039323929847,
"tokensPerSecond": 16.241496347033,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
4125.235666000663
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 8775548928,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485426176,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
"fallback": false,
"requestWallMs": 4161.559500000294,
"totalMs": 4835.528458001136,
"postUseRssBytes": 1162362880,
"grade": "fast"
}
}
]LightOnOCR-2 1B BBox Base Desktop
36 configurations testedQuality criteria
Frozen four-fixture paragraphCER/token recall, caption/receipt phrases, ordered PDF pages, EOS/non-repetition/resource/speed and bboxIoU where applicable; narrow English/cropped-page scope.
| Precision | Device | Result | Platform | Inference / load | |
|---|---|---|---|---|---|
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3807 ms / 681 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3812 ms / 681 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3816 ms / 681 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3817 ms / 681 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3819 ms / 681 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3820 ms / 681 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3823 ms / 681 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3824 ms / 681 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3828 ms / 681 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3828 ms / 681 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3830 ms / 681 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3830 ms / 681 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3834 ms / 681 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3834 ms / 681 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3837 ms / 681 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3976 ms / 678 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3987 ms / 681 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4002 ms / 652 ms |
FP32 | mpsAccelerated | Passed | Not measured | macos · aarch64 | 23171 ms / 681 ms |
FP32 | mpsAccelerated | Passed | Not measured | macos · aarch64 | 16703 ms / 681 ms |
FP32 | mpsAccelerated | Passed | Not measured | macos · aarch64 | 31495 ms / 681 ms |
FP32 | mpsAccelerated | Passed | Not measured | macos · aarch64 | 31706 ms / 681 ms |
FP32 | mpsAccelerated | Passed | Not measured | macos · aarch64 | 23289 ms / 681 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7389 ms / 337 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7439 ms / 337 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7447 ms / 337 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7448 ms / 337 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7463 ms / 337 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7475 ms / 337 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7568 ms / 343 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7588 ms / 335 ms |
FP32 | cpu | Passed | Not measured | macos · aarch64 | 36426 ms / 337 ms |
FP32 | cpu | Passed | Not measured | macos · aarch64 | 23674 ms / 337 ms |
FP32 | cpu | Passed | Not measured | macos · aarch64 | 45688 ms / 337 ms |
FP32 | cpu | Passed | Not measured | macos · aarch64 | 45691 ms / 337 ms |
FP32 | cpu | Passed | Not measured | macos · aarch64 | 35631 ms / 337 ms |
Test setup & sample details
- Quality gate
- Frozen four-fixture paragraphCER/token recall, caption/receipt phrases, ordered PDF pages, EOS/non-repetition/resource/speed and bboxIoU where applicable; narrow English/cropped-page scope.
- Tested
- 2026-11-08T10:04:04.991192+00:00
- Environment
- { "hardware": "Apple M3 Max", "os": "macOS27.2/aarch64", "python": "3.13.18 app-owned private development venv", "runtime": "Transformers5.22.1/Torch2.10.0/Pillow12.0.0/PDFium5.14.0", "scope": "Exact immutable local snapshots; model-process loads exclude interpreter imports/network setup. totalMs is model-load component plus full helper request wall time, not warm IPC session elapsed time. Concurrent tracked transfers/background host activity recorded separately." }
- Runtime
- transformers 5.22.1
- Artifact revision
- 82d708ea57f6867dbc5c183b7146287235b92fcf
- Fixture
{ "file": "model-samples/desktop/lightonocr2/fixtures/scientific-paragraph.png", "url": "https://assets.localai.tools/samples/v1/files/de0959e7c3fe59f4d706bb84d993cd1aae000a6b25bcef96f472d3a675871dfb/scientific-paragraph.png", "size": 26674, "sha1": "b4e9dd3ea6464bc8e1ff1f95134eccfc25622d52", "sha256": "de0959e7c3fe59f4d706bb84d993cd1aae000a6b25bcef96f472d3a675871dfb" }- Rerun when
- artifact revision/weight change; pinned runtime/prediction/preprocessing change; fixture/checksum or quality-gate change; relevant host/backend behavior change
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 337.2504580001987,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7469.0980420000415,
"inferenceMs": 7439.041999999972,
"pagesPerSecond": 0.13442591129341705,
"tokensPerSecond": 9.006536056658943,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7439.041999999972
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 6488948736,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 7471.974292000596,
"totalMs": 7809.224750000794,
"postUseRssBytes": 4781146112,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 0.8333333333333334,
"textQuality": true,
"imageBoxIoU": 0.862775855040837,
"bboxQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 337.2504580001987,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 36451.55125000019,
"inferenceMs": 36426.39208400033,
"pagesPerSecond": 0.027452622749295916,
"tokensPerSecond": 9.086818130016947,
"neuralInferencePerformed": true,
"outputTokens": 331,
"maxNewTokens": 1024,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
36426.39208400033
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 6622642176,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 36459.99591600048,
"totalMs": 36797.24637400068,
"postUseRssBytes": 5782978560,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 337.2504580001987,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 23701.2632090009,
"inferenceMs": 23673.991124998793,
"pagesPerSecond": 0.04224044837729283,
"tokensPerSecond": 2.1120224188646413,
"neuralInferencePerformed": true,
"outputTokens": 50,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
23673.991124998793
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7466205184,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 23704.05616700009,
"totalMs": 24041.30662500029,
"postUseRssBytes": 5630279680,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"pageOrder": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 337.2504580001987,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 45750.83170799917,
"inferenceMs": 45687.97408399951,
"pagesPerSecond": 0.04377519555414966,
"tokensPerSecond": 1.5977946377264625,
"neuralInferencePerformed": true,
"outputTokens": 73,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "application/pdf",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
23995.909125000253,
21692.064958999254
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7466205184,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 45755.11679199917,
"totalMs": 46092.36724999937,
"postUseRssBytes": 5284577280,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 337.2504580001987,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7474.389375000101,
"inferenceMs": 7463.420666999809,
"pagesPerSecond": 0.1339868197998795,
"tokensPerSecond": 8.977116926591927,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7463.420666999809
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7466205184,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 7477.303708999898,
"totalMs": 7814.554167000097,
"postUseRssBytes": 4797366272,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 337.2504580001987,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7484.404790999179,
"inferenceMs": 7475.0047080015065,
"pagesPerSecond": 0.1337791799555076,
"tokensPerSecond": 8.963205057019008,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7475.0047080015065
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7466205184,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 7487.184041001456,
"totalMs": 7824.434499001654,
"postUseRssBytes": 4797464576,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 337.2504580001987,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7398.757791999742,
"inferenceMs": 7389.293167001597,
"pagesPerSecond": 0.13533094132273774,
"tokensPerSecond": 9.067173068623429,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7389.293167001597
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7466205184,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 7401.579290999507,
"totalMs": 7738.829748999706,
"postUseRssBytes": 4797464576,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 337.2504580001987,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7456.427167000584,
"inferenceMs": 7446.9466249993275,
"pagesPerSecond": 0.13428322376355026,
"tokensPerSecond": 8.996975992157866,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7446.9466249993275
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7466205184,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 7459.16812500036,
"totalMs": 7796.418583000559,
"postUseRssBytes": 4797431808,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 337.2504580001987,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7457.046042000002,
"inferenceMs": 7447.6026669999555,
"pagesPerSecond": 0.13427139506662486,
"tokensPerSecond": 8.996183469463865,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7447.6026669999555
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7466205184,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 7459.872041999915,
"totalMs": 7797.122500000114,
"postUseRssBytes": 4797399040,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"pageOrder": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 337.2504580001987,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 45745.9888329995,
"inferenceMs": 45690.59800099967,
"pagesPerSecond": 0.04377268163476963,
"tokensPerSecond": 1.5977028796690913,
"neuralInferencePerformed": true,
"outputTokens": 73,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "application/pdf",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
23928.81191699962,
21761.78608400005
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7466205184,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 45750.23416699878,
"totalMs": 46087.48462499898,
"postUseRssBytes": 5268160512,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 0.8333333333333334,
"textQuality": true,
"imageBoxIoU": 0.862775855040837,
"bboxQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 337.2504580001987,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 35655.99575000124,
"inferenceMs": 35630.84533300025,
"pagesPerSecond": 0.028065570453189026,
"tokensPerSecond": 9.289703820005569,
"neuralInferencePerformed": true,
"outputTokens": 331,
"maxNewTokens": 1024,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
35630.84533300025
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"visualizationMs": 6.0794590008299565,
"peakResidentMemoryBytes": 7466205184,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 35671.738333001485,
"totalMs": 36008.988791001684,
"postUseRssBytes": 5244665856,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 334.81758299967623,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7617.470875000436,
"inferenceMs": 7588.012458998492,
"pagesPerSecond": 0.13178681577072499,
"tokensPerSecond": 8.829716656638572,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7588.012458998492
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 6484885504,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 7620.454833999247,
"totalMs": 7955.272416998923,
"postUseRssBytes": 4778754048,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 343.3123329996306,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7597.374916998888,
"inferenceMs": 7567.990333000125,
"pagesPerSecond": 0.13213547533742384,
"tokensPerSecond": 8.853076847607397,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7567.990333000125
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 6488555520,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 7600.343915999474,
"totalMs": 7943.656248999105,
"postUseRssBytes": 4781490176,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 681.429707999996,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 4017.2767499989277,
"inferenceMs": 3986.7967080008384,
"pagesPerSecond": 0.250827938628816,
"tokensPerSecond": 16.805471888130672,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3986.7967080008384
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 8775548928,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485245952,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 4020.4007500014995,
"totalMs": 4701.830458001496,
"postUseRssBytes": 1164902400,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 0.8333333333333334,
"textQuality": true,
"imageBoxIoU": 0.862775855040837,
"bboxQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 681.429707999996,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 23200.27837499947,
"inferenceMs": 23170.760917000734,
"pagesPerSecond": 0.04315784033084062,
"tokensPerSecond": 14.285245149508247,
"neuralInferencePerformed": true,
"outputTokens": 331,
"maxNewTokens": 1024,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
23170.760917000734
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 22920691712,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485245952,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 23210.67020800001,
"totalMs": 23892.099916000006,
"postUseRssBytes": 1254686720,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 681.429707999996,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 16737.137333000646,
"inferenceMs": 16702.840457999628,
"pagesPerSecond": 0.0598700563843955,
"tokensPerSecond": 2.993502819219775,
"neuralInferencePerformed": true,
"outputTokens": 50,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
16702.840457999628
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44515115008,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485245952,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 16741.09079200025,
"totalMs": 17422.520500000246,
"postUseRssBytes": 1335148544,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"pageOrder": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 681.429707999996,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 31567.510625000068,
"inferenceMs": 31495.167915998536,
"pagesPerSecond": 0.06350180463664282,
"tokensPerSecond": 2.317815869237463,
"neuralInferencePerformed": true,
"outputTokens": 73,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "application/pdf",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
16317.354582999542,
15177.813332998994
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44515115008,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485245952,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 31572.952042000907,
"totalMs": 32254.381750000903,
"postUseRssBytes": 1340686336,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 681.429707999996,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3823.8966669996444,
"inferenceMs": 3811.845041998822,
"pagesPerSecond": 0.2623401499751492,
"tokensPerSecond": 17.576790048335,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3811.845041998822
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 45469319168,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485245952,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 3826.53562500127,
"totalMs": 4507.965333001266,
"postUseRssBytes": 1343930368,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 681.429707999996,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3842.336332998457,
"inferenceMs": 3829.733999999007,
"pagesPerSecond": 0.2611147406060732,
"tokensPerSecond": 17.494687620606907,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3829.733999999007
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485245952,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 3845.3800000006595,
"totalMs": 4526.8097080006555,
"postUseRssBytes": 1346994176,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 681.429707999996,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3841.921833000015,
"inferenceMs": 3828.2483330003743,
"pagesPerSecond": 0.2612160740409058,
"tokensPerSecond": 17.50147696074069,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3828.2483330003743
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485245952,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 3845.2982079998037,
"totalMs": 4526.7279159998,
"postUseRssBytes": 1349894144,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 681.429707999996,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3820.1027079994674,
"inferenceMs": 3806.64383399926,
"pagesPerSecond": 0.2626985984526427,
"tokensPerSecond": 17.600806096327062,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3806.64383399926
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485245952,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 3823.480084000039,
"totalMs": 4504.909792000035,
"postUseRssBytes": 1352843264,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 681.429707999996,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3834.359166001377,
"inferenceMs": 3820.4327920011565,
"pagesPerSecond": 0.26175044934534664,
"tokensPerSecond": 17.537280106138226,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3820.4327920011565
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485245952,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 3837.7717089988437,
"totalMs": 4519.20141699884,
"postUseRssBytes": 1355776000,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 681.429707999996,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3833.9022079999268,
"inferenceMs": 3819.097374998819,
"pagesPerSecond": 0.26184197516050745,
"tokensPerSecond": 17.543412335754,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3819.097374998819
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485245952,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 3837.266416001512,
"totalMs": 4518.696124001508,
"postUseRssBytes": 1358561280,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 681.429707999996,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3850.858249999874,
"inferenceMs": 3837.276666999969,
"pagesPerSecond": 0.26060148557956664,
"tokensPerSecond": 17.460299533830966,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3837.276666999969
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485245952,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 3854.278083999816,
"totalMs": 4535.707791999812,
"postUseRssBytes": 1361412096,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 681.429707999996,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3837.3313330012024,
"inferenceMs": 3823.4200829992915,
"pagesPerSecond": 0.26154594009862175,
"tokensPerSecond": 17.523577986607656,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3823.4200829992915
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485245952,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 3840.773249999984,
"totalMs": 4522.20295799998,
"postUseRssBytes": 1364279296,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 681.429707999996,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3831.4674999983254,
"inferenceMs": 3817.419457998767,
"pagesPerSecond": 0.2619570657619682,
"tokensPerSecond": 17.551123406051868,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3817.419457998767
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485245952,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 3834.807875000479,
"totalMs": 4516.237583000475,
"postUseRssBytes": 1367228416,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 681.429707999996,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3847.500707999643,
"inferenceMs": 3834.1626669989637,
"pagesPerSecond": 0.2608131388391796,
"tokensPerSecond": 17.474480302225036,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3834.1626669989637
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485245952,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 3850.5714170005376,
"totalMs": 4532.001125000534,
"postUseRssBytes": 1370112000,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 681.429707999996,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3842.0324590006203,
"inferenceMs": 3828.149749999284,
"pagesPerSecond": 0.2612228009105932,
"tokensPerSecond": 17.501927661009745,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3828.149749999284
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485245952,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 3845.4883330014127,
"totalMs": 4526.918041001409,
"postUseRssBytes": 1372913664,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 681.429707999996,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3829.541417000655,
"inferenceMs": 3815.6653750011174,
"pagesPerSecond": 0.26207748890970484,
"tokensPerSecond": 17.559191756950224,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3815.6653750011174
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485245952,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 3832.979458000409,
"totalMs": 4514.409166000405,
"postUseRssBytes": 1375846400,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 681.429707999996,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3847.7438330010045,
"inferenceMs": 3833.9419160001853,
"pagesPerSecond": 0.26082815595789316,
"tokensPerSecond": 17.47548644917884,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3833.9419160001853
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485245952,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 3851.0885420000704,
"totalMs": 4532.5182500000665,
"postUseRssBytes": 1378746368,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 681.429707999996,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3843.9971249990776,
"inferenceMs": 3830.195874999845,
"pagesPerSecond": 0.2610832533466818,
"tokensPerSecond": 17.49257797422768,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3830.195874999845
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485245952,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 3847.3582499991608,
"totalMs": 4528.787957999157,
"postUseRssBytes": 1381548032,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 681.429707999996,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3838.1926249985554,
"inferenceMs": 3824.4019579997257,
"pagesPerSecond": 0.2614787909278839,
"tokensPerSecond": 17.519078992168218,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3824.4019579997257
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485245952,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 3841.6692080008943,
"totalMs": 4523.09891600089,
"postUseRssBytes": 1384415232,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"pageOrder": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 681.429707999996,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 31779.85979100049,
"inferenceMs": 31705.66583299842,
"pagesPerSecond": 0.06308020814117245,
"tokensPerSecond": 2.302427597152794,
"neuralInferencePerformed": true,
"outputTokens": 73,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "application/pdf",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
16386.49016599993,
15319.17566699849
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44515115008,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485245952,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 31785.02479099916,
"totalMs": 32466.454498999155,
"postUseRssBytes": 1387298816,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 0.8333333333333334,
"textQuality": true,
"imageBoxIoU": 0.862775855040837,
"bboxQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 681.429707999996,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 23321.36441700095,
"inferenceMs": 23288.620792000074,
"pagesPerSecond": 0.04293942560752727,
"tokensPerSecond": 14.212949876091526,
"neuralInferencePerformed": true,
"outputTokens": 331,
"maxNewTokens": 1024,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
23288.620792000074
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44355731456,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"visualizationMs": 10.161582998989616,
"peakResidentMemoryBytes": 6485245952,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 23345.697499999005,
"totalMs": 24027.127207999,
"postUseRssBytes": 1400782848,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 652.157750000697,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 4032.349458000681,
"inferenceMs": 4001.9262919995526,
"pagesPerSecond": 0.24987966470025924,
"tokensPerSecond": 16.74193753491737,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
4001.9262919995526
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 8775548928,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485426176,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 4035.5845840003894,
"totalMs": 4687.742334001086,
"postUseRssBytes": 1162117120,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 677.9445420015691,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 4006.4946660004352,
"inferenceMs": 3975.5600419994153,
"pagesPerSecond": 0.25153688774300925,
"tokensPerSecond": 16.85297147878162,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3975.5600419994153
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 8775548928,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6486081536,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
"fallback": false,
"requestWallMs": 4009.7222500007774,
"totalMs": 4687.6667920023465,
"postUseRssBytes": 1162887168,
"grade": "fast"
}
}
]LightOnOCR-2 1B BBox Soup Desktop
36 configurations testedQuality criteria
Frozen four-fixture paragraphCER/token recall, caption/receipt phrases, ordered PDF pages, EOS/non-repetition/resource/speed and bboxIoU where applicable; narrow English/cropped-page scope.
| Precision | Device | Result | Platform | Inference / load | |
|---|---|---|---|---|---|
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3595 ms / 736 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3606 ms / 719 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3618 ms / 719 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3620 ms / 719 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3620 ms / 719 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3622 ms / 778 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3625 ms / 719 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3626 ms / 719 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3629 ms / 719 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3635 ms / 719 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3645 ms / 719 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3645 ms / 719 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3647 ms / 719 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3652 ms / 719 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3653 ms / 719 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3653 ms / 719 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3653 ms / 719 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3794 ms / 719 ms |
FP32 | mpsAccelerated | Passed | Not measured | macos · aarch64 | 23304 ms / 719 ms |
FP32 | mpsAccelerated | Passed | Not measured | macos · aarch64 | 16602 ms / 719 ms |
FP32 | mpsAccelerated | Passed | Not measured | macos · aarch64 | 31545 ms / 719 ms |
FP32 | mpsAccelerated | Passed | Not measured | macos · aarch64 | 30497 ms / 719 ms |
FP32 | mpsAccelerated | Passed | Not measured | macos · aarch64 | 21477 ms / 719 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7051 ms / 353 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7083 ms / 353 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7088 ms / 353 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7088 ms / 353 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7110 ms / 353 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7152 ms / 353 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7206 ms / 333 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7211 ms / 334 ms |
FP32 | cpu | Passed | Not measured | macos · aarch64 | 36542 ms / 353 ms |
FP32 | cpu | Passed | Not measured | macos · aarch64 | 23801 ms / 353 ms |
FP32 | cpu | Passed | Not measured | macos · aarch64 | 45409 ms / 353 ms |
FP32 | cpu | Passed | Not measured | macos · aarch64 | 45659 ms / 353 ms |
FP32 | cpu | Passed | Not measured | macos · aarch64 | 34722 ms / 353 ms |
Test setup & sample details
- Quality gate
- Frozen four-fixture paragraphCER/token recall, caption/receipt phrases, ordered PDF pages, EOS/non-repetition/resource/speed and bboxIoU where applicable; narrow English/cropped-page scope.
- Tested
- 2026-11-08T10:21:59.397576+00:00
- Environment
- { "hardware": "Apple M3 Max", "os": "macOS27.2/aarch64", "python": "3.13.18 app-owned private development venv", "runtime": "Transformers5.22.1/Torch2.10.0/Pillow12.0.0/PDFium5.14.0", "scope": "Exact immutable local snapshots; model-process loads exclude interpreter imports/network setup. totalMs is model-load component plus full helper request wall time, not warm IPC session elapsed time. Concurrent tracked transfers/background host activity recorded separately." }
- Runtime
- transformers 5.22.1
- Artifact revision
- e16ab911c8eda8035fd6b96172316dfa09e4c491
- Fixture
{ "file": "model-samples/desktop/lightonocr2/fixtures/scientific-paragraph.png", "url": "https://assets.localai.tools/samples/v1/files/de0959e7c3fe59f4d706bb84d993cd1aae000a6b25bcef96f472d3a675871dfb/scientific-paragraph.png", "size": 26674, "sha1": "b4e9dd3ea6464bc8e1ff1f95134eccfc25622d52", "sha256": "de0959e7c3fe59f4d706bb84d993cd1aae000a6b25bcef96f472d3a675871dfb" }- Rerun when
- artifact revision/weight change; pinned runtime/prediction/preprocessing change; fixture/checksum or quality-gate change; relevant host/backend behavior change
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 353.34620800131233,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7142.251958000998,
"inferenceMs": 7110.412083999108,
"pagesPerSecond": 0.14063882489319382,
"tokensPerSecond": 8.43832949359163,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7110.412083999108
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 6487506944,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 7145.218042000124,
"totalMs": 7498.564250001436,
"postUseRssBytes": 4781293568,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 0.8333333333333334,
"textQuality": true,
"imageBoxIoU": 0.8287878429327068,
"bboxQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 353.34620800131233,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 36567.33633299882,
"inferenceMs": 36541.81499999868,
"pagesPerSecond": 0.027365909438270546,
"tokensPerSecond": 8.97601829575274,
"neuralInferencePerformed": true,
"outputTokens": 328,
"maxNewTokens": 1024,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
36541.81499999868
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 6592331776,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 36576.35541699892,
"totalMs": 36929.701625000234,
"postUseRssBytes": 5785042944,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 353.34620800131233,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 23827.878416999738,
"inferenceMs": 23800.57704200044,
"pagesPerSecond": 0.042015788030488437,
"tokensPerSecond": 2.100789401524422,
"neuralInferencePerformed": true,
"outputTokens": 50,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
23800.57704200044
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7156776960,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 23830.82900000045,
"totalMs": 24184.17520800176,
"postUseRssBytes": 5358649344,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"pageOrder": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 353.34620800131233,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 45473.13108400158,
"inferenceMs": 45409.39583399995,
"pagesPerSecond": 0.044043748287496805,
"tokensPerSecond": 1.5415311900623883,
"neuralInferencePerformed": true,
"outputTokens": 70,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "application/pdf",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
23859.246584001085,
21550.149249998867
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7156776960,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 45477.5051659999,
"totalMs": 45830.85137400121,
"postUseRssBytes": 5268881408,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 353.34620800131233,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7061.850374999267,
"inferenceMs": 7050.922500000524,
"pagesPerSecond": 0.1418254136249442,
"tokensPerSecond": 8.509524817496652,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7050.922500000524
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7156776960,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 7064.794166999491,
"totalMs": 7418.140375000803,
"postUseRssBytes": 4798169088,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 353.34620800131233,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7097.1252500003175,
"inferenceMs": 7087.634040999546,
"pagesPerSecond": 0.14109080607369695,
"tokensPerSecond": 8.465448364421816,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7087.634040999546
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7156776960,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 7099.921917000756,
"totalMs": 7453.268125002069,
"postUseRssBytes": 4798464000,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 353.34620800131233,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7161.406916999113,
"inferenceMs": 7151.901707999059,
"pagesPerSecond": 0.13982295070995565,
"tokensPerSecond": 8.389377042597339,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7151.901707999059
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7156776960,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 7164.235791000465,
"totalMs": 7517.581999001777,
"postUseRssBytes": 4798480384,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 353.34620800131233,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7097.078041000714,
"inferenceMs": 7087.571832998947,
"pagesPerSecond": 0.14109204443531861,
"tokensPerSecond": 8.465522666119117,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7087.571832998947
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7156776960,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 7099.894292001409,
"totalMs": 7453.240500002721,
"postUseRssBytes": 4798480384,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 353.34620800131233,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7092.363833000491,
"inferenceMs": 7082.899790999363,
"pagesPerSecond": 0.14118511196088868,
"tokensPerSecond": 8.47110671765332,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7082.899790999363
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7156776960,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 7095.20479099956,
"totalMs": 7448.550999000872,
"postUseRssBytes": 4798480384,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"pageOrder": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 353.34620800131233,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 45715.30187499957,
"inferenceMs": 45659.47383300045,
"pagesPerSecond": 0.04380251965484756,
"tokensPerSecond": 1.5330881879196647,
"neuralInferencePerformed": true,
"outputTokens": 70,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "application/pdf",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
24150.348083001518,
21509.12574999893
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7156776960,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 45719.78450000097,
"totalMs": 46073.13070800228,
"postUseRssBytes": 5269766144,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 0.8333333333333334,
"textQuality": true,
"imageBoxIoU": 0.8287878429327068,
"bboxQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 353.34620800131233,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 34748.50787499963,
"inferenceMs": 34722.367624999606,
"pagesPerSecond": 0.02879987939762536,
"tokensPerSecond": 9.446360442421119,
"neuralInferencePerformed": true,
"outputTokens": 328,
"maxNewTokens": 1024,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
34722.367624999606
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"visualizationMs": 5.778208000265295,
"peakResidentMemoryBytes": 7156776960,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 34764.15458300107,
"totalMs": 35117.500791002385,
"postUseRssBytes": 5244796928,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 333.449040999767,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7235.365250000541,
"inferenceMs": 7205.531749999864,
"pagesPerSecond": 0.13878226266923588,
"tokensPerSecond": 8.326935760154154,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7205.531749999864
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 6485557248,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 7238.22887499955,
"totalMs": 7571.677915999317,
"postUseRssBytes": 4778983424,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 334.0889580013027,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7241.183457999796,
"inferenceMs": 7211.431209001603,
"pagesPerSecond": 0.13866872899678487,
"tokensPerSecond": 8.320123739807093,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7211.431209001603
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 6485147648,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 7244.127083000421,
"totalMs": 7578.216041001724,
"postUseRssBytes": 4779884544,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 718.8838750007562,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3825.6256250006118,
"inferenceMs": 3794.4219580003846,
"pagesPerSecond": 0.2635447536064197,
"tokensPerSecond": 15.812685216385182,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3794.4219580003846
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 8775548928,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6484525056,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 3828.8401249992603,
"totalMs": 4547.7240000000165,
"postUseRssBytes": 1161101312,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 0.8333333333333334,
"textQuality": true,
"imageBoxIoU": 0.8287878429327068,
"bboxQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 718.8838750007562,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 23334.865791000993,
"inferenceMs": 23304.369999999835,
"pagesPerSecond": 0.04291040693226236,
"tokensPerSecond": 14.074613473782055,
"neuralInferencePerformed": true,
"outputTokens": 328,
"maxNewTokens": 1024,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
23304.369999999835
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 22920691712,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6484525056,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 23345.21237500121,
"totalMs": 24064.096250001967,
"postUseRssBytes": 1251082240,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 718.8838750007562,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 16639.73791599892,
"inferenceMs": 16602.01804100143,
"pagesPerSecond": 0.06023364132783946,
"tokensPerSecond": 3.0116820663919732,
"neuralInferencePerformed": true,
"outputTokens": 50,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
16602.01804100143
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44515115008,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6484525056,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 16643.608207999932,
"totalMs": 17362.49208300069,
"postUseRssBytes": 1327005696,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"pageOrder": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 718.8838750007562,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 31611.04841699853,
"inferenceMs": 31545.492748999095,
"pagesPerSecond": 0.06340049958685327,
"tokensPerSecond": 2.2190174855398643,
"neuralInferencePerformed": true,
"outputTokens": 70,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "application/pdf",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
16374.884916000155,
15170.60783299894
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44515115008,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6484525056,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 31614.970583001195,
"totalMs": 32333.85445800195,
"postUseRssBytes": 1338900480,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 718.8838750007562,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3632.0557079998252,
"inferenceMs": 3619.574415999523,
"pagesPerSecond": 0.2762755741613496,
"tokensPerSecond": 16.576534449680977,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3619.574415999523
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 45469319168,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6484525056,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 3635.121249999429,
"totalMs": 4354.005125000185,
"postUseRssBytes": 1341816832,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 718.8838750007562,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3665.6631250007194,
"inferenceMs": 3652.5201660006132,
"pagesPerSecond": 0.2737835671130507,
"tokensPerSecond": 16.42701402678304,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3652.5201660006132
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6484525056,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 3668.856958000106,
"totalMs": 4387.740833000862,
"postUseRssBytes": 1344651264,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 718.8838750007562,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3665.638542001034,
"inferenceMs": 3652.3159590014984,
"pagesPerSecond": 0.2737988748030958,
"tokensPerSecond": 16.427932488185746,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3652.3159590014984
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6484525056,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 3669.025707999026,
"totalMs": 4387.909582999782,
"postUseRssBytes": 1347256320,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 718.8838750007562,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3632.957833000546,
"inferenceMs": 3619.5533339996473,
"pagesPerSecond": 0.2762771833216749,
"tokensPerSecond": 16.57663099930049,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3619.5533339996473
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6484525056,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 3636.186458999873,
"totalMs": 4355.070334000629,
"postUseRssBytes": 1349926912,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 718.8838750007562,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3638.704040999073,
"inferenceMs": 3625.3255420015194,
"pagesPerSecond": 0.2758372974825059,
"tokensPerSecond": 16.550237848950353,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3625.3255420015194
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6484525056,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 3642.033457999787,
"totalMs": 4360.917333000543,
"postUseRssBytes": 1352515584,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 718.8838750007562,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3619.199333999859,
"inferenceMs": 3606.222500000513,
"pagesPerSecond": 0.27729847506632155,
"tokensPerSecond": 16.637908503979293,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3606.222500000513
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6484525056,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 3622.1651249998104,
"totalMs": 4341.049000000567,
"postUseRssBytes": 1355120640,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 718.8838750007562,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3631.477917000666,
"inferenceMs": 3618.1695830000535,
"pagesPerSecond": 0.2763828441592383,
"tokensPerSecond": 16.582970649554298,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3618.1695830000535
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6484525056,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 3634.5310420001624,
"totalMs": 4353.414917000919,
"postUseRssBytes": 1357791232,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 718.8838750007562,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3666.5827079996234,
"inferenceMs": 3652.6581660000375,
"pagesPerSecond": 0.27377322337695853,
"tokensPerSecond": 16.426393402617514,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3652.6581660000375
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6484525056,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 3670.0572919999104,
"totalMs": 4388.941167000667,
"postUseRssBytes": 1360396288,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 718.8838750007562,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3660.150917001374,
"inferenceMs": 3647.049707999031,
"pagesPerSecond": 0.27419423371354434,
"tokensPerSecond": 16.45165402281266,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3647.049707999031
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6484525056,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 3663.645540998914,
"totalMs": 4382.52941599967,
"postUseRssBytes": 1362968576,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 718.8838750007562,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3639.9710419991607,
"inferenceMs": 3626.0066670001834,
"pagesPerSecond": 0.2757854829945213,
"tokensPerSecond": 16.547128979671278,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3626.0066670001834
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6484525056,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 3643.065333000777,
"totalMs": 4361.949208001533,
"postUseRssBytes": 1365540864,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 718.8838750007562,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3657.508041998881,
"inferenceMs": 3644.7184169992397,
"pagesPerSecond": 0.2743696180577147,
"tokensPerSecond": 16.462177083462883,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3644.7184169992397
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6484525056,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 3660.5613339997944,
"totalMs": 4379.445209000551,
"postUseRssBytes": 1368096768,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 718.8838750007562,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3648.0417080001644,
"inferenceMs": 3634.7417090000818,
"pagesPerSecond": 0.2751227129905471,
"tokensPerSecond": 16.507362779432825,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3634.7417090000818
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6484525056,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 3651.560458998574,
"totalMs": 4370.44433399933,
"postUseRssBytes": 1370685440,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 718.8838750007562,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3642.684458000076,
"inferenceMs": 3629.317709001043,
"pagesPerSecond": 0.2755338827239918,
"tokensPerSecond": 16.53203296343951,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3629.317709001043
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6484525056,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 3646.150624999791,
"totalMs": 4365.034500000547,
"postUseRssBytes": 1373290496,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 718.8838750007562,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3667.198291999739,
"inferenceMs": 3653.1956250000803,
"pagesPerSecond": 0.2737329457959093,
"tokensPerSecond": 16.42397674775456,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3653.1956250000803
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6484525056,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 3670.396957999401,
"totalMs": 4389.280833000157,
"postUseRssBytes": 1375830016,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 718.8838750007562,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3659.6662500014645,
"inferenceMs": 3645.3424579995044,
"pagesPerSecond": 0.27432264911230897,
"tokensPerSecond": 16.45935894673854,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3645.3424579995044
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6484525056,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 3663.151500000822,
"totalMs": 4382.035375001578,
"postUseRssBytes": 1378402304,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"pageOrder": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 718.8838750007562,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 30564.35316600073,
"inferenceMs": 30496.98779100072,
"pagesPerSecond": 0.06558024725937606,
"tokensPerSecond": 2.2953086540781618,
"neuralInferencePerformed": true,
"outputTokens": 70,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "application/pdf",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
16414.448999999877,
14082.538791000843
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44515115008,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6484525056,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 30569.059416999153,
"totalMs": 31287.94329199991,
"postUseRssBytes": 1381138432,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 0.8333333333333334,
"textQuality": true,
"imageBoxIoU": 0.8287878429327068,
"bboxQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 718.8838750007562,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 21505.046833999586,
"inferenceMs": 21476.520166999762,
"pagesPerSecond": 0.04656247810278747,
"tokensPerSecond": 15.27249281771429,
"neuralInferencePerformed": true,
"outputTokens": 328,
"maxNewTokens": 1024,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
21476.520166999762
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44355731456,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"visualizationMs": 8.743958000195562,
"peakResidentMemoryBytes": 6484525056,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 21523.79470899905,
"totalMs": 22242.678583999805,
"postUseRssBytes": 1393623040,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 736.4051250006014,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3630.977124999845,
"inferenceMs": 3594.7811659989384,
"pagesPerSecond": 0.27818105020089984,
"tokensPerSecond": 16.690863012053992,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3594.7811659989384
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 8775548928,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6488735744,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 3634.2823750001116,
"totalMs": 4370.687500000713,
"postUseRssBytes": 1164918784,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 777.5213750010153,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3656.2467500007187,
"inferenceMs": 3622.082750000118,
"pagesPerSecond": 0.2760842501458498,
"tokensPerSecond": 16.56505500875099,
"neuralInferencePerformed": true,
"outputTokens": 60,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3622.082750000118
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 8775548928,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6486441984,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
"fallback": false,
"requestWallMs": 3659.1801250015124,
"totalMs": 4436.701500002528,
"postUseRssBytes": 1161904128,
"grade": "fast"
}
}
]LightOnOCR-2 1B OCR Soup Desktop
34 configurations testedQuality criteria
Frozen four-fixture paragraphCER/token recall, caption/receipt phrases, ordered PDF pages, EOS/non-repetition/resource/speed and bboxIoU where applicable; narrow English/cropped-page scope.
| Precision | Device | Result | Platform | Inference / load | |
|---|---|---|---|---|---|
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3787 ms / 688 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3794 ms / 688 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3806 ms / 688 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3808 ms / 688 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3812 ms / 688 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3812 ms / 688 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3815 ms / 688 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3824 ms / 688 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3825 ms / 688 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3827 ms / 688 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3827 ms / 688 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3828 ms / 688 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3839 ms / 688 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3845 ms / 688 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3846 ms / 688 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4006 ms / 688 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4008 ms / 653 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4012 ms / 647 ms |
FP32 | mpsAccelerated | Passed | Not measured | macos · aarch64 | 22831 ms / 688 ms |
FP32 | mpsAccelerated | Passed | Not measured | macos · aarch64 | 16810 ms / 688 ms |
FP32 | mpsAccelerated | Passed | Not measured | macos · aarch64 | 32006 ms / 688 ms |
FP32 | mpsAccelerated | Passed | Not measured | macos · aarch64 | 31930 ms / 688 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7322 ms / 337 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7346 ms / 337 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7380 ms / 337 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7433 ms / 337 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7450 ms / 337 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7505 ms / 337 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7551 ms / 334 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7574 ms / 338 ms |
FP32 | cpu | Passed | Not measured | macos · aarch64 | 35767 ms / 337 ms |
FP32 | cpu | Passed | Not measured | macos · aarch64 | 23556 ms / 337 ms |
FP32 | cpu | Passed | Not measured | macos · aarch64 | 46601 ms / 337 ms |
FP32 | cpu | Passed | Not measured | macos · aarch64 | 46766 ms / 337 ms |
Test setup & sample details
- Quality gate
- Frozen four-fixture paragraphCER/token recall, caption/receipt phrases, ordered PDF pages, EOS/non-repetition/resource/speed and bboxIoU where applicable; narrow English/cropped-page scope.
- Tested
- 2026-11-08T10:12:39.038755+00:00
- Environment
- { "hardware": "Apple M3 Max", "os": "macOS27.2/aarch64", "python": "3.13.18 app-owned private development venv", "runtime": "Transformers5.22.1/Torch2.10.0/Pillow12.0.0/PDFium5.14.0", "scope": "Exact immutable local snapshots; model-process loads exclude interpreter imports/network setup. totalMs is model-load component plus full helper request wall time, not warm IPC session elapsed time. Concurrent tracked transfers/background host activity recorded separately." }
- Runtime
- transformers 5.22.1
- Artifact revision
- 45be956cc2af90a5f53459989bcdd09357013e9f
- Fixture
{ "file": "model-samples/desktop/lightonocr2/fixtures/scientific-paragraph.png", "url": "https://assets.localai.tools/samples/v1/files/de0959e7c3fe59f4d706bb84d993cd1aae000a6b25bcef96f472d3a675871dfb/scientific-paragraph.png", "size": 26674, "sha1": "b4e9dd3ea6464bc8e1ff1f95134eccfc25622d52", "sha256": "de0959e7c3fe59f4d706bb84d993cd1aae000a6b25bcef96f472d3a675871dfb" }- Rerun when
- artifact revision/weight change; pinned runtime/prediction/preprocessing change; fixture/checksum or quality-gate change; relevant host/backend behavior change
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 337.1324170002481,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7534.840084001189,
"inferenceMs": 7505.392250001023,
"pagesPerSecond": 0.1332375399833185,
"tokensPerSecond": 8.92691517888234,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7505.392250001023
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 6489210880,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 7537.708624999141,
"totalMs": 7874.841041999389,
"postUseRssBytes": 4783144960,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 0.8333333333333334,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 337.1324170002481,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 35791.57875000055,
"inferenceMs": 35766.96749999974,
"pagesPerSecond": 0.027958758315197042,
"tokensPerSecond": 8.862926385917463,
"neuralInferencePerformed": true,
"outputTokens": 317,
"maxNewTokens": 1024,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
35766.96749999974
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 6591086592,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 35800.37670799902,
"totalMs": 36137.50912499927,
"postUseRssBytes": 5783519232,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 337.1324170002481,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 23583.909707998828,
"inferenceMs": 23556.174499999543,
"pagesPerSecond": 0.042451714729826756,
"tokensPerSecond": 2.1225857364913376,
"neuralInferencePerformed": true,
"outputTokens": 50,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
23556.174499999543
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7254753280,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 23586.859417000596,
"totalMs": 23923.991834000844,
"postUseRssBytes": 5498945536,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"pageOrder": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 337.1324170002481,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 46664.07458300091,
"inferenceMs": 46600.6580000012,
"pagesPerSecond": 0.04291784892822647,
"tokensPerSecond": 1.738172881593172,
"neuralInferencePerformed": true,
"outputTokens": 81,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "application/pdf",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
24700.152500001423,
21900.50549999978
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7254753280,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 46668.31770799945,
"totalMs": 47005.4501249997,
"postUseRssBytes": 5312790528,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 337.1324170002481,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7461.339416999181,
"inferenceMs": 7450.469625000551,
"pagesPerSecond": 0.134219727122225,
"tokensPerSecond": 8.992721717189076,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7450.469625000551
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7254753280,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 7464.27520799989,
"totalMs": 7801.407625000138,
"postUseRssBytes": 4800086016,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 337.1324170002481,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7355.7545420007955,
"inferenceMs": 7346.292124999309,
"pagesPerSecond": 0.13612309216468765,
"tokensPerSecond": 9.120247175034073,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7346.292124999309
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7254753280,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 7358.554582999204,
"totalMs": 7695.686999999452,
"postUseRssBytes": 4803084288,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 337.1324170002481,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7389.680416999909,
"inferenceMs": 7380.1732909996645,
"pagesPerSecond": 0.13549817335854825,
"tokensPerSecond": 9.078377615022731,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7380.1732909996645
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7254753280,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 7392.419083000277,
"totalMs": 7729.551500000525,
"postUseRssBytes": 4803051520,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 337.1324170002481,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7442.183125000156,
"inferenceMs": 7432.629167000414,
"pagesPerSecond": 0.13454189325626884,
"tokensPerSecond": 9.014306848170012,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7432.629167000414
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7254753280,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 7445.084040999063,
"totalMs": 7782.216457999311,
"postUseRssBytes": 4803461120,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 337.1324170002481,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7332.017749999068,
"inferenceMs": 7321.949791999941,
"pagesPerSecond": 0.13657564288307647,
"tokensPerSecond": 9.150568073166124,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7321.949791999941
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7254753280,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 7334.848459000568,
"totalMs": 7671.980876000816,
"postUseRssBytes": 4803428352,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"pageOrder": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 337.1324170002481,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 46821.83079199967,
"inferenceMs": 46766.03333299863,
"pagesPerSecond": 0.0427660816507347,
"tokensPerSecond": 1.7320263068547552,
"neuralInferencePerformed": true,
"outputTokens": 81,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "application/pdf",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
24939.15420799931,
21826.879124999323
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 7254753280,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 46826.022584000384,
"totalMs": 47163.15500100063,
"postUseRssBytes": 5275451392,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 333.58304200010025,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7580.5554170001415,
"inferenceMs": 7550.823874998969,
"pagesPerSecond": 0.1324358793894046,
"tokensPerSecond": 8.873203919090107,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7550.823874998969
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 6485442560,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 7583.463000000847,
"totalMs": 7917.046042000948,
"postUseRssBytes": 4781457408,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 337.687499999447,
"placement": {
"cpu/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 7603.810832999443,
"inferenceMs": 7573.609541999758,
"pagesPerSecond": 0.13203743795537115,
"tokensPerSecond": 8.846508343009868,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "cpu",
"languageOutput": "cpu"
},
"pageInferenceMs": [
7573.609541999758
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"peakResidentMemoryBytes": 6485917696,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 7606.688207999468,
"totalMs": 7944.3757079989155,
"postUseRssBytes": 4780097536,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 687.5410409993492,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 4035.9712919998856,
"inferenceMs": 4005.81025000065,
"pagesPerSecond": 0.24963738609432082,
"tokensPerSecond": 16.725704868319493,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
4005.81025000065
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 8775548928,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485753856,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 4039.0998749990104,
"totalMs": 4726.64091599836,
"postUseRssBytes": 1162166272,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 0.8333333333333334,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 687.5410409993492,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 22861.19916699863,
"inferenceMs": 22830.896125000436,
"pagesPerSecond": 0.04380029563994965,
"tokensPerSecond": 13.88469371786404,
"neuralInferencePerformed": true,
"outputTokens": 317,
"maxNewTokens": 1024,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
22830.896125000436
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 22920691712,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485753856,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 22871.020583001155,
"totalMs": 23558.561624000504,
"postUseRssBytes": 1250852864,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 687.5410409993492,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 16839.634208999996,
"inferenceMs": 16810.320749998937,
"pagesPerSecond": 0.05948726469125006,
"tokensPerSecond": 2.974363234562503,
"neuralInferencePerformed": true,
"outputTokens": 50,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
16810.320749998937
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44515115008,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485753856,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 16843.405708999853,
"totalMs": 17530.946749999202,
"postUseRssBytes": 1326792704,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"pageOrder": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 687.5410409993492,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 32077.086208000765,
"inferenceMs": 32006.021084000167,
"pagesPerSecond": 0.06248824228263104,
"tokensPerSecond": 2.5307738124465575,
"neuralInferencePerformed": true,
"outputTokens": 81,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "application/pdf",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
16701.6584590001,
15304.362625000067
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44515115008,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485753856,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 32083.17916699889,
"totalMs": 32770.72020799824,
"postUseRssBytes": 1332396032,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 687.5410409993492,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3840.986625000369,
"inferenceMs": 3828.1761669986736,
"pagesPerSecond": 0.2612209982969539,
"tokensPerSecond": 17.50180688589591,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3828.1761669986736
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 45469319168,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485753856,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 3844.1610419995413,
"totalMs": 4531.702082998891,
"postUseRssBytes": 1335803904,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 687.5410409993492,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3859.224792000532,
"inferenceMs": 3845.4144580009597,
"pagesPerSecond": 0.26004999224969116,
"tokensPerSecond": 17.42334948072931,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3845.4144580009597
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485753856,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 3862.6048330006597,
"totalMs": 4550.145874000009,
"postUseRssBytes": 1338851328,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 687.5410409993492,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3851.774374999877,
"inferenceMs": 3838.54699999938,
"pagesPerSecond": 0.2605152418350385,
"tokensPerSecond": 17.45452120294758,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3838.54699999938
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485753856,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 3855.152124999222,
"totalMs": 4542.693165998571,
"postUseRssBytes": 1341718528,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 687.5410409993492,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3859.5905839993065,
"inferenceMs": 3846.108292000281,
"pagesPerSecond": 0.2600030794972548,
"tokensPerSecond": 17.420206326316073,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3846.108292000281
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485753856,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 3863.013833999503,
"totalMs": 4550.554874998852,
"postUseRssBytes": 1344569344,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 687.5410409993492,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3840.5725410011655,
"inferenceMs": 3826.6454999993584,
"pagesPerSecond": 0.26132548729694655,
"tokensPerSecond": 17.50880764889542,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3826.6454999993584
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485753856,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 3844.0431670005637,
"totalMs": 4531.584207999913,
"postUseRssBytes": 1347452928,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 687.5410409993492,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3819.188082999972,
"inferenceMs": 3805.6824579998647,
"pagesPerSecond": 0.26276496030243296,
"tokensPerSecond": 17.60525234026301,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3805.6824579998647
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485753856,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 3822.3960000013903,
"totalMs": 4509.93704100074,
"postUseRssBytes": 1350402048,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 687.5410409993492,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3825.249250001434,
"inferenceMs": 3811.5957500012883,
"pagesPerSecond": 0.26235730795944506,
"tokensPerSecond": 17.57793963328282,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3811.5957500012883
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485753856,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 3828.2579589995294,
"totalMs": 4515.798999998879,
"postUseRssBytes": 1356152832,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 687.5410409993492,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3839.1770420003013,
"inferenceMs": 3825.3583339992474,
"pagesPerSecond": 0.2614134187409688,
"tokensPerSecond": 17.514699055644908,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3825.3583339992474
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485753856,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 3842.66687499985,
"totalMs": 4530.207915999199,
"postUseRssBytes": 1359036416,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 687.5410409993492,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3829.031125000256,
"inferenceMs": 3815.3409999995347,
"pagesPerSecond": 0.2620997703744231,
"tokensPerSecond": 17.560684615086352,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3815.3409999995347
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485753856,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 3832.433833998948,
"totalMs": 4519.974874998297,
"postUseRssBytes": 1361936384,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 687.5410409993492,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3837.5418329997046,
"inferenceMs": 3823.6586669991084,
"pagesPerSecond": 0.26152962047337297,
"tokensPerSecond": 17.52248457171599,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3823.6586669991084
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485753856,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 3840.8897909994266,
"totalMs": 4528.430831998776,
"postUseRssBytes": 1364738048,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 687.5410409993492,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3800.5776249992778,
"inferenceMs": 3787.202792000244,
"pagesPerSecond": 0.2640471226183907,
"tokensPerSecond": 17.691157215432177,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3787.202792000244
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485753856,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 3803.7424169997394,
"totalMs": 4491.283457999089,
"postUseRssBytes": 1367605248,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 687.5410409993492,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3824.968707998778,
"inferenceMs": 3812.434082999971,
"pagesPerSecond": 0.262299617050194,
"tokensPerSecond": 17.574074342362998,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3812.434082999971
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485753856,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 3827.882374998808,
"totalMs": 4515.423415998157,
"postUseRssBytes": 1370472448,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 687.5410409993492,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3806.5388329996495,
"inferenceMs": 3793.589124999926,
"pagesPerSecond": 0.2636026114188156,
"tokensPerSecond": 17.66137496506064,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3793.589124999926
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485753856,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 3809.5649999995658,
"totalMs": 4497.106040998915,
"postUseRssBytes": 1373323264,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 687.5410409993492,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3821.8630840001424,
"inferenceMs": 3808.1038750005973,
"pagesPerSecond": 0.2625978788458976,
"tokensPerSecond": 17.594057882675138,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3808.1038750005973
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485753856,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 3825.0633330007986,
"totalMs": 4512.604374000148,
"postUseRssBytes": 1376223232,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 687.5410409993492,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 3839.6251249996567,
"inferenceMs": 3827.2442079996836,
"pagesPerSecond": 0.2612846073187088,
"tokensPerSecond": 17.50606869035349,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
3827.2442079996836
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44976488448,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485753856,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 3842.689207998774,
"totalMs": 4530.230248998123,
"postUseRssBytes": 1379057664,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"phraseRecall": 1,
"textQuality": true,
"pageOrder": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 687.5410409993492,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 31996.180916999947,
"inferenceMs": 31930.438749999666,
"pagesPerSecond": 0.06263615779473186,
"tokensPerSecond": 2.5367643906866406,
"neuralInferencePerformed": true,
"outputTokens": 81,
"maxNewTokens": 512,
"pdfScale": 1.5,
"inputKind": "application/pdf",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
16708.269499999005,
15222.169250000661
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 44515115008,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485753856,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 32000.63083399982,
"totalMs": 32688.17187499917,
"postUseRssBytes": 1385594880,
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 652.7070840002125,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 4038.6603330007347,
"inferenceMs": 4008.0020829991554,
"pagesPerSecond": 0.2495008683358039,
"tokensPerSecond": 16.71655817849886,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
4008.0020829991554
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 8775548928,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6486130688,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 4041.9522499996674,
"totalMs": 4694.65933399988,
"postUseRssBytes": 1162526720,
"grade": "fast"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"pageCount": true,
"complete": true,
"actualNeuralPlacement": true,
"withinSpeedBudget": true,
"withinMemoryBudget": true,
"nonRepetitive": true,
"tokenRecall": 0.95,
"characterErrorRate": 0.006968641114982578,
"textQuality": true,
"passed": true
},
"runtime": {
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"pythonVersion": "3.13.18",
"resolvedModelClass": "LightOnOcrForConditionalGeneration",
"originalConfigModelType": "mistral3",
"checkpointLoading": {
"missing_keys": [],
"unexpected_keys": [],
"mismatched_keys": []
},
"pdfiumVersion": "5.14.0",
"loadMs": 647.3277079985564,
"placement": {
"mps:0/torch.float32": 532
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"attentionImplementation": "sdpa",
"accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
"durationMs": 4043.4326249996957,
"inferenceMs": 4011.8473330003326,
"pagesPerSecond": 0.2492617283250736,
"tokensPerSecond": 16.70053579777993,
"neuralInferencePerformed": true,
"outputTokens": 67,
"maxNewTokens": 256,
"pdfScale": 1.5,
"inputKind": "image",
"activationPlacement": {
"visionOutput": "mps:0",
"languageOutput": "mps:0"
},
"pageInferenceMs": [
4011.8473330003326
],
"decoding": "greedy",
"outputLimitReached": false,
"allPagesReachedEos": true,
"driverAllocatedMemoryBytes": 8775548928,
"memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
"peakResidentMemoryBytes": 6485868544,
"device": "mps",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
"fallback": false,
"requestWallMs": 4046.651833999931,
"totalMs": 4693.979541998488,
"postUseRssBytes": 1161297920,
"grade": "fast"
}
}
]