A model is still running

A model is still running or downloading. Leaving will stop the current operation. Stay on this page to let it finish.

Skip to content
LocalAI.toolsBeta

Join the waitlist

Get an email when the new apps and model runs launch.

No account needed.

LightOnOCR 2 Desktop

Read document images and locally rasterized PDF pages with this exact LightOnOCR-2 BBox checkpoint on the verified native CPU/Metal configurations. Includes independently tested embedded-image coordinates and optional overlays.

Desktop inferencePrivate · Runs on your computer
About this model

Read document images and locally rasterized PDF pages with this exact LightOnOCR-2 BBox checkpoint on the verified native CPU/Metal configurations. Includes independently tested embedded-image coordinates and optional overlays.

Created by
LightOn AI
License
Apache-2.0
Model released
Jan 19, 2026
Source repository created
Jan 16, 2026
Model weights · FP32
2.0 GB

Best for

  • Local document OCR with manual verification
  • Reading bounded scientific excerpts and simple scanned pages
  • Reproducible exact-checkpoint OCR experiments

Keep in mind

  • OCR can omit, duplicate, misread or hallucinate text. Verify names, numbers and punctuation against originals; not legal/medical/financial/identity or redaction ground truth.
  • Current quality evidence covers two real scientific-page crops plus authored English receipt/two-page documents. It does not establish broad multilingual, handwriting, full-page layout, table/formula or poor-scan quality.
  • Inputs are exactly one still PNG/JPEG image or PDF byte array, at most32MiB; PDFs allow1–8pages and at most16million rendered pixels perpage. Images have the same16million-pixel decode cap. No general chat/audio/video input is exposed.
  • PDFs are rasterized in order with PDFium. Every page is aspect-preservingly resampled to1540longest-edge pixels before the pinned processor; original oriented dimensions remain the output coordinate space. PDF render scale0.5–2 affects rasterization quality, not the final target longest edge.
  • Per-page generation is bounded to1–2048tokens and the combined native context16384 limit. Output may truncate; inspect outputLimitReached/eosReached and never treat partial text as complete extraction.
  • Exact uniform-color pages produce explicit empty preprocessing-only results with generationSkipped, without claiming model inference or EOS. Non-uniform blank/noisy page robustness remains unverified.
  • Only this checkpoint’s measured FP32 device pairs are advertised. Weights are stored in BF16 and cast to FP32; filenames or sibling results establish no FP16/BF16/quantized/other-platform support.
  • MPS performs neural work on Metal; rasterization, resizing, tokenization, decoding and SVG construction use CPU. Current driver allocation/reservation reached roughly42GiB after mixed-page calls; this is not a measured peak or validated memory minimum. Unload the model to release its process-owned context.
  • The synchronous native host supports between-request disposal; cancellation cannot promise immediate interruption of an active native step.
  • Embedded-image boxes are normalized0–1000 relative to each oriented page, not text-line/word boxes. Current localization evidence is one real chart; boxes can still be missing or inaccurate.

Processed on your deviceYour input is processed locally in the desktop app. Model and runtime files download from external hosts.

Target platforms · verification required

  • macos · aarch64, x86_64
  • windows · x86_64

Recommended configuration

FP32 · mps (verified platform only)

Sources & technical details
Original model
https://huggingface.co/lightonai/LightOnOCR-2-1B-bbox
Release verification
Verified
Release evidence
Official provider announcement published2026-01-19 explicitly lists and announces this exact checkpoint among six released models. Separate from repository creation, Jan26 paper update and later repository changes.
Source updated
Jun 29, 2026
Native model files
https://huggingface.co/lightonai/LightOnOCR-2-1B-bbox
Files updated
Jun 29, 2026
Artifact revision
714ffe765cc4cb6f2d92530236f45d1c9465cd96

Desktop app

Sample result

LightOnOCR-2 1B BBox Desktop

Run LightOnOCR 2 Desktop on your computer

Download the desktop app to load this model, provide input and view results locally.

Public desktop downloads are coming soon.

Device requirements

macOS Apple SiliconCPU / FP32Tested16.0 GiBRAM estimate
macOS Apple SiliconMPS / FP32Tested64.0 GiBRAM estimate
Windows Intel / AMDCPU / FP32Unverified16.0 GiBRAM estimate
macOS Intel / AMDCPU / FP32Unverified16.0 GiBRAM estimate
If your device falls short

MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.

GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.

PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.

Benchmark evidence

Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.

LightOnOCR-2 1B BBox Desktop

36 configurations tested
Passed36
Failed0
TestedNov 8, 2026
Runtimetransformers 5.22.1

Quality criteria

Frozen four-fixture paragraphCER/token recall, caption/receipt phrases, ordered PDF pages, EOS/non-repetition/resource/speed and bboxIoU where applicable; narrow English/cropped-page scope.

PrecisionDeviceResultPlatformInference / load
FP32mpsAcceleratedPassedFastmacos · aarch644217 ms / 690 ms
FP32mpsAcceleratedPassedFastmacos · aarch644230 ms / 690 ms
FP32mpsAcceleratedPassedFastmacos · aarch644270 ms / 690 ms
FP32mpsAcceleratedPassedFastmacos · aarch644271 ms / 690 ms
FP32mpsAcceleratedPassedFastmacos · aarch644288 ms / 690 ms
FP32mpsAcceleratedPassedFastmacos · aarch644326 ms / 690 ms
FP32mpsAcceleratedPassedFastmacos · aarch644333 ms / 690 ms
FP32mpsAcceleratedPassedFastmacos · aarch644358 ms / 690 ms
FP32mpsAcceleratedPassedFastmacos · aarch644381 ms / 690 ms
FP32mpsAcceleratedPassedFastmacos · aarch644443 ms / 690 ms
FP32mpsAcceleratedPassedFastmacos · aarch644451 ms / 690 ms
FP32mpsAcceleratedPassedFastmacos · aarch644465 ms / 690 ms
FP32mpsAcceleratedPassedFastmacos · aarch644467 ms / 673 ms
FP32mpsAcceleratedPassedFastmacos · aarch644503 ms / 690 ms
FP32mpsAcceleratedPassedFastmacos · aarch644509 ms / 690 ms
FP32mpsAcceleratedPassedFastmacos · aarch644516 ms / 690 ms
FP32mpsAcceleratedPassedFastmacos · aarch644570 ms / 690 ms
FP32mpsAcceleratedPassedFastmacos · aarch644673 ms / 651 ms
FP32mpsAcceleratedPassedNot measuredmacos · aarch6426492 ms / 690 ms
FP32mpsAcceleratedPassedNot measuredmacos · aarch6418777 ms / 690 ms
FP32mpsAcceleratedPassedNot measuredmacos · aarch6436810 ms / 690 ms
FP32mpsAcceleratedPassedNot measuredmacos · aarch6441148 ms / 690 ms
FP32mpsAcceleratedPassedNot measuredmacos · aarch6429453 ms / 690 ms
FP32cpuPassedFastmacos · aarch646977 ms / 340 ms
FP32cpuPassedFastmacos · aarch647040 ms / 340 ms
FP32cpuPassedFastmacos · aarch647041 ms / 340 ms
FP32cpuPassedFastmacos · aarch647101 ms / 340 ms
FP32cpuPassedFastmacos · aarch647104 ms / 340 ms
FP32cpuPassedFastmacos · aarch647187 ms / 337 ms
FP32cpuPassedFastmacos · aarch647192 ms / 340 ms
FP32cpuPassedFastmacos · aarch647258 ms / 334 ms
FP32cpuPassedNot measuredmacos · aarch6436307 ms / 340 ms
FP32cpuPassedNot measuredmacos · aarch6423968 ms / 340 ms
FP32cpuPassedNot measuredmacos · aarch6445643 ms / 340 ms
FP32cpuPassedNot measuredmacos · aarch6444338 ms / 340 ms
FP32cpuPassedNot measuredmacos · aarch6434764 ms / 340 ms
Test setup & sample details
Quality gate
Frozen four-fixture paragraphCER/token recall, caption/receipt phrases, ordered PDF pages, EOS/non-repetition/resource/speed and bboxIoU where applicable; narrow English/cropped-page scope.
Tested
2026-11-08T09:45:23.312152+00:00
Environment
{ "hardware": "Apple M3 Max", "os": "macOS27.2/aarch64", "python": "3.13.18 app-owned private development venv", "runtime": "Transformers5.22.1/Torch2.10.0/Pillow12.0.0/PDFium5.14.0", "scope": "Exact immutable local snapshots; model-process loads exclude interpreter imports/network setup. totalMs is model-load component plus full helper request wall time, not warm IPC session elapsed time. Concurrent tracked transfers/background host activity recorded separately." }
Runtime
transformers 5.22.1
Artifact revision
714ffe765cc4cb6f2d92530236f45d1c9465cd96
Fixture
{
  "file": "model-samples/desktop/lightonocr2/fixtures/scientific-paragraph.png",
  "url": "https://assets.localai.tools/samples/v1/files/de0959e7c3fe59f4d706bb84d993cd1aae000a6b25bcef96f472d3a675871dfb/scientific-paragraph.png",
  "size": 26674,
  "sha1": "b4e9dd3ea6464bc8e1ff1f95134eccfc25622d52",
  "sha256": "de0959e7c3fe59f4d706bb84d993cd1aae000a6b25bcef96f472d3a675871dfb"
}
Rerun when
artifact revision/weight change; pinned runtime/prediction/preprocessing change; fixture/checksum or quality-gate change; relevant host/backend behavior change
Per-case quality & failure details
[
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 340.03149999989546,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7221.278666000217,
      "inferenceMs": 7191.577083000084,
      "pagesPerSecond": 0.13905155829642218,
      "tokensPerSecond": 8.34309349778533,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7191.577083000084
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 6484803584,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 7224.382749998767,
      "totalMs": 7564.414249998663,
      "postUseRssBytes": 4779786240,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 0.8333333333333334,
      "textQuality": true,
      "imageBoxIoU": 0.8561118241616472,
      "bboxQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 340.03149999989546,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 36332.50091700029,
      "inferenceMs": 36307.001666998985,
      "pagesPerSecond": 0.027542896799130166,
      "tokensPerSecond": 9.034070150114696,
      "neuralInferencePerformed": true,
      "outputTokens": 328,
      "maxNewTokens": 1024,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        36307.001666998985
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 6592987136,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 36341.21541700006,
      "totalMs": 36681.24691699995,
      "postUseRssBytes": 5785894912,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 340.03149999989546,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 23995.175542000652,
      "inferenceMs": 23967.513042000064,
      "pagesPerSecond": 0.04172314408456252,
      "tokensPerSecond": 2.086157204228126,
      "neuralInferencePerformed": true,
      "outputTokens": 50,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        23967.513042000064
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7159676928,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 23998.07249999867,
      "totalMs": 24338.103999998566,
      "postUseRssBytes": 5368889344,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "pageOrder": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 340.03149999989546,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 45707.04720800131,
      "inferenceMs": 45643.22295799866,
      "pagesPerSecond": 0.04381811516334899,
      "tokensPerSecond": 1.5336340307172147,
      "neuralInferencePerformed": true,
      "outputTokens": 70,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "application/pdf",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        24058.199749999403,
        21585.023207999257
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7159676928,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 45711.312749999706,
      "totalMs": 46051.3442499996,
      "postUseRssBytes": 5298585600,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 340.03149999989546,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7051.403874998869,
      "inferenceMs": 7040.584833999674,
      "pagesPerSecond": 0.14203365538199356,
      "tokensPerSecond": 8.522019322919613,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7040.584833999674
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7159676928,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 7054.308333001245,
      "totalMs": 7394.3398330011405,
      "postUseRssBytes": 4799348736,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 340.03149999989546,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7049.8134999998,
      "inferenceMs": 7040.390791000391,
      "pagesPerSecond": 0.14203757002782894,
      "tokensPerSecond": 8.522254201669737,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7040.390791000391
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7159676928,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 7052.556750000804,
      "totalMs": 7392.588250000699,
      "postUseRssBytes": 4799676416,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 340.03149999989546,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7110.94491699987,
      "inferenceMs": 7101.422957999603,
      "pagesPerSecond": 0.14081684838579023,
      "tokensPerSecond": 8.449010903147414,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7101.422957999603
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7159676928,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 7113.6508750005305,
      "totalMs": 7453.682375000426,
      "postUseRssBytes": 4800184320,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 340.03149999989546,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 6986.722583000301,
      "inferenceMs": 6977.087291999851,
      "pagesPerSecond": 0.14332628475877485,
      "tokensPerSecond": 8.59957708552649,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        6977.087291999851
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7159676928,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 6989.497999999003,
      "totalMs": 7329.529499998898,
      "postUseRssBytes": 4800200704,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 340.03149999989546,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7113.404082998386,
      "inferenceMs": 7103.7651669994375,
      "pagesPerSecond": 0.1407704191356864,
      "tokensPerSecond": 8.446225148141183,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7103.7651669994375
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7159676928,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 7116.224916999272,
      "totalMs": 7456.256416999167,
      "postUseRssBytes": 4800200704,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "pageOrder": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 340.03149999989546,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 44394.15166699837,
      "inferenceMs": 44337.535500999365,
      "pagesPerSecond": 0.045108506311879244,
      "tokensPerSecond": 1.5787977209157735,
      "neuralInferencePerformed": true,
      "outputTokens": 70,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "application/pdf",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        23546.818208998957,
        20790.71729200041
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7159676928,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 44398.31262500047,
      "totalMs": 44738.34412500037,
      "postUseRssBytes": 5271453696,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 0.8333333333333334,
      "textQuality": true,
      "imageBoxIoU": 0.8561118241616472,
      "bboxQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 340.03149999989546,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 34789.32429199995,
      "inferenceMs": 34763.90058299876,
      "pagesPerSecond": 0.02876547174597113,
      "tokensPerSecond": 9.43507473267853,
      "neuralInferencePerformed": true,
      "outputTokens": 328,
      "maxNewTokens": 1024,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        34763.90058299876
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "visualizationMs": 5.800082999485312,
      "peakResidentMemoryBytes": 7159676928,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 34804.201500001,
      "totalMs": 35144.233000000895,
      "postUseRssBytes": 5246484480,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 334.23374999983935,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7287.888541999564,
      "inferenceMs": 7258.394083999519,
      "pagesPerSecond": 0.13777152196853165,
      "tokensPerSecond": 8.2662913181119,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7258.394083999519
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 6485803008,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 7290.8463749990915,
      "totalMs": 7625.080124998931,
      "postUseRssBytes": 4781441024,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 336.55937500043365,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7216.885084000751,
      "inferenceMs": 7187.38441700043,
      "pagesPerSecond": 0.1391326721908299,
      "tokensPerSecond": 8.347960331449794,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7187.38441700043
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 6491226112,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 7219.998333001058,
      "totalMs": 7556.557708001492,
      "postUseRssBytes": 4783538176,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 690.0489170002402,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 4318.7340419990505,
      "inferenceMs": 4287.960415998896,
      "pagesPerSecond": 0.23321110807573683,
      "tokensPerSecond": 13.99266648454421,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        4287.960415998896
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 8775548928,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6487965696,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 4321.902207999301,
      "totalMs": 5011.951124999541,
      "postUseRssBytes": 1165426688,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 0.8333333333333334,
      "textQuality": true,
      "imageBoxIoU": 0.8561118241616472,
      "bboxQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 690.0489170002402,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 26522.168916000737,
      "inferenceMs": 26491.591124999104,
      "pagesPerSecond": 0.037747827047516905,
      "tokensPerSecond": 12.381287271585546,
      "neuralInferencePerformed": true,
      "outputTokens": 328,
      "maxNewTokens": 1024,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        26491.591124999104
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 22920691712,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6487965696,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 26532.848374999958,
      "totalMs": 27222.897292000198,
      "postUseRssBytes": 1252802560,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 690.0489170002402,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 18809.909707999395,
      "inferenceMs": 18777.010832998712,
      "pagesPerSecond": 0.05325661304101718,
      "tokensPerSecond": 2.6628306520508587,
      "neuralInferencePerformed": true,
      "outputTokens": 50,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        18777.010832998712
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44515115008,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6487965696,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 18813.114667000264,
      "totalMs": 19503.163584000504,
      "postUseRssBytes": 1328939008,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "pageOrder": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 690.0489170002402,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 36877.3287089989,
      "inferenceMs": 36810.079083001256,
      "pagesPerSecond": 0.054332944938539726,
      "tokensPerSecond": 1.9016530728488903,
      "neuralInferencePerformed": true,
      "outputTokens": 70,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "application/pdf",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        18931.189625000115,
        17878.88945800114
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44515115008,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6487965696,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 36881.57629200032,
      "totalMs": 37571.62520900056,
      "postUseRssBytes": 1338081280,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 690.0489170002402,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 4228.9909579994855,
      "inferenceMs": 4216.710250000688,
      "pagesPerSecond": 0.23715169900512773,
      "tokensPerSecond": 14.229101940307665,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        4216.710250000688
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 45469319168,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6487965696,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 4231.8931669997255,
      "totalMs": 4921.942083999966,
      "postUseRssBytes": 1341145088,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 690.0489170002402,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 4455.005624999103,
      "inferenceMs": 4442.946625000332,
      "pagesPerSecond": 0.22507585267241995,
      "tokensPerSecond": 13.504551160345196,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        4442.946625000332
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6487965696,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 4457.902750000358,
      "totalMs": 5147.951667000598,
      "postUseRssBytes": 1343864832,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 690.0489170002402,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 4242.177875001289,
      "inferenceMs": 4229.877083000247,
      "pagesPerSecond": 0.23641348918127456,
      "tokensPerSecond": 14.184809350876472,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        4229.877083000247
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6487965696,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 4245.215832999747,
      "totalMs": 4935.2647499999875,
      "postUseRssBytes": 1346486272,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 690.0489170002402,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 4370.71562500023,
      "inferenceMs": 4357.704292000562,
      "pagesPerSecond": 0.229478627504785,
      "tokensPerSecond": 13.768717650287101,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        4357.704292000562
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6487965696,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 4373.5235830008605,
      "totalMs": 5063.572500001101,
      "postUseRssBytes": 1349189632,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 690.0489170002402,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 4283.35854100078,
      "inferenceMs": 4269.750333000047,
      "pagesPerSecond": 0.23420573148532825,
      "tokensPerSecond": 14.052343889119696,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        4269.750333000047
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6487965696,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 4286.295417001384,
      "totalMs": 4976.344334001624,
      "postUseRssBytes": 1351745536,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 690.0489170002402,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 4284.705499998381,
      "inferenceMs": 4271.195375000389,
      "pagesPerSecond": 0.2341264943891519,
      "tokensPerSecond": 14.047589663349113,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        4271.195375000389
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6487965696,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 4287.651084001482,
      "totalMs": 4977.700001001722,
      "postUseRssBytes": 1354366976,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 690.0489170002402,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 4478.215249999266,
      "inferenceMs": 4465.3553329990245,
      "pagesPerSecond": 0.2239463436672081,
      "tokensPerSecond": 13.436780620032486,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        4465.3553329990245
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6487965696,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 4481.207499999073,
      "totalMs": 5171.256416999313,
      "postUseRssBytes": 1356955648,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 690.0489170002402,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 4339.134166999429,
      "inferenceMs": 4325.855082999624,
      "pagesPerSecond": 0.23116816925512504,
      "tokensPerSecond": 13.870090155307501,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        4325.855082999624
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6487965696,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 4342.416542000137,
      "totalMs": 5032.465459000377,
      "postUseRssBytes": 1359511552,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 690.0489170002402,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 4584.955000000264,
      "inferenceMs": 4570.196750000832,
      "pagesPerSecond": 0.21880896046758117,
      "tokensPerSecond": 13.12853762805487,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        4570.196750000832
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6487965696,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 4588.136624999606,
      "totalMs": 5278.1855419998465,
      "postUseRssBytes": 1362034688,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 690.0489170002402,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 4345.674333000716,
      "inferenceMs": 4332.881042000736,
      "pagesPerSecond": 0.23079331980419282,
      "tokensPerSecond": 13.84759918825157,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        4332.881042000736
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6487965696,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 4348.770165999667,
      "totalMs": 5038.819082999908,
      "postUseRssBytes": 1364606976,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 690.0489170002402,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 4522.420041999794,
      "inferenceMs": 4508.502500000759,
      "pagesPerSecond": 0.2218031375162444,
      "tokensPerSecond": 13.308188250974665,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        4508.502500000759
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6487965696,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 4525.564125000528,
      "totalMs": 5215.6130420007685,
      "postUseRssBytes": 1367244800,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 690.0489170002402,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 4393.375041001491,
      "inferenceMs": 4380.805875000078,
      "pagesPerSecond": 0.22826850322373213,
      "tokensPerSecond": 13.696110193423928,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        4380.805875000078
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6487965696,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 4396.35995900062,
      "totalMs": 5086.40887600086,
      "postUseRssBytes": 1369800704,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 690.0489170002402,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 4516.183292000278,
      "inferenceMs": 4502.779708000162,
      "pagesPerSecond": 0.222085037432163,
      "tokensPerSecond": 13.32510224592978,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        4502.779708000162
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6487965696,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 4519.366958000319,
      "totalMs": 5209.415875000559,
      "postUseRssBytes": 1372356608,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 690.0489170002402,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 4529.125541001122,
      "inferenceMs": 4516.327249999449,
      "pagesPerSecond": 0.2214188531179006,
      "tokensPerSecond": 13.285131187074036,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        4516.327249999449
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6487965696,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 4532.093208999868,
      "totalMs": 5222.142126000108,
      "postUseRssBytes": 1374896128,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 690.0489170002402,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 4463.356957998258,
      "inferenceMs": 4450.736916998721,
      "pagesPerSecond": 0.2246818939534923,
      "tokensPerSecond": 13.480913637209538,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        4450.736916998721
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6487965696,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 4466.575791999276,
      "totalMs": 5156.624708999516,
      "postUseRssBytes": 1377550336,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "pageOrder": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 690.0489170002402,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 41218.01145800055,
      "inferenceMs": 41147.997750002105,
      "pagesPerSecond": 0.04860503813942922,
      "tokensPerSecond": 1.7011763348800226,
      "neuralInferencePerformed": true,
      "outputTokens": 70,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "application/pdf",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        21536.910000000717,
        19611.08775000139
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44515115008,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6487965696,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 41222.66112500074,
      "totalMs": 41912.71004200098,
      "postUseRssBytes": 1380548608,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 0.8333333333333334,
      "textQuality": true,
      "imageBoxIoU": 0.8561118241616472,
      "bboxQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 690.0489170002402,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 29479.267082999286,
      "inferenceMs": 29452.9117080001,
      "pagesPerSecond": 0.03395250051723669,
      "tokensPerSecond": 11.136420169653634,
      "neuralInferencePerformed": true,
      "outputTokens": 328,
      "maxNewTokens": 1024,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        29452.9117080001
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44355731456,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "visualizationMs": 5.9521250004763715,
      "peakResidentMemoryBytes": 6487965696,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 29494.7137500003,
      "totalMs": 30184.76266700054,
      "postUseRssBytes": 1396080640,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 672.5859170001058,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 4499.790584000948,
      "inferenceMs": 4467.486207999173,
      "pagesPerSecond": 0.22383952707217517,
      "tokensPerSecond": 13.43037162433051,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        4467.486207999173
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 8775548928,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6489325568,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 4503.258875000029,
      "totalMs": 5175.8447920001345,
      "postUseRssBytes": 1166360576,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 651.0348330011766,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 4703.598625001177,
      "inferenceMs": 4673.298333000275,
      "pagesPerSecond": 0.2139816311187641,
      "tokensPerSecond": 12.838897867125844,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        4673.298333000275
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 8775548928,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6487638016,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "714ffe765cc4cb6f2d92530236f45d1c9465cd96",
      "fallback": false,
      "requestWallMs": 4706.964832999802,
      "totalMs": 5357.999666000978,
      "postUseRssBytes": 1164066816,
      "grade": "fast"
    }
  }
]

LightOnOCR-2 1B Base Desktop

34 configurations tested
Passed34
Failed0
TestedNov 8, 2026
Runtimetransformers 5.22.1

Quality criteria

Frozen four-fixture paragraphCER/token recall, caption/receipt phrases, ordered PDF pages, EOS/non-repetition/resource/speed and bboxIoU where applicable; narrow English/cropped-page scope.

PrecisionDeviceResultPlatformInference / load
FP32mpsAcceleratedPassedFastmacos · aarch643839 ms / 680 ms
FP32mpsAcceleratedPassedFastmacos · aarch643842 ms / 680 ms
FP32mpsAcceleratedPassedFastmacos · aarch643853 ms / 680 ms
FP32mpsAcceleratedPassedFastmacos · aarch643855 ms / 680 ms
FP32mpsAcceleratedPassedFastmacos · aarch643868 ms / 680 ms
FP32mpsAcceleratedPassedFastmacos · aarch643880 ms / 680 ms
FP32mpsAcceleratedPassedFastmacos · aarch643882 ms / 680 ms
FP32mpsAcceleratedPassedFastmacos · aarch643886 ms / 680 ms
FP32mpsAcceleratedPassedFastmacos · aarch643887 ms / 680 ms
FP32mpsAcceleratedPassedFastmacos · aarch643888 ms / 680 ms
FP32mpsAcceleratedPassedFastmacos · aarch643897 ms / 680 ms
FP32mpsAcceleratedPassedFastmacos · aarch643900 ms / 680 ms
FP32mpsAcceleratedPassedFastmacos · aarch643908 ms / 680 ms
FP32mpsAcceleratedPassedFastmacos · aarch643918 ms / 680 ms
FP32mpsAcceleratedPassedFastmacos · aarch643951 ms / 680 ms
FP32mpsAcceleratedPassedFastmacos · aarch643962 ms / 680 ms
FP32mpsAcceleratedPassedFastmacos · aarch644125 ms / 674 ms
FP32mpsAcceleratedPassedFastmacos · aarch644126 ms / 653 ms
FP32mpsAcceleratedPassedNot measuredmacos · aarch6422951 ms / 680 ms
FP32mpsAcceleratedPassedNot measuredmacos · aarch6416759 ms / 680 ms
FP32mpsAcceleratedPassedNot measuredmacos · aarch6431930 ms / 680 ms
FP32mpsAcceleratedPassedNot measuredmacos · aarch6433552 ms / 680 ms
FP32cpuPassedFastmacos · aarch647373 ms / 335 ms
FP32cpuPassedFastmacos · aarch647375 ms / 335 ms
FP32cpuPassedFastmacos · aarch647415 ms / 335 ms
FP32cpuPassedFastmacos · aarch647426 ms / 336 ms
FP32cpuPassedFastmacos · aarch647483 ms / 335 ms
FP32cpuPassedFastmacos · aarch647510 ms / 335 ms
FP32cpuPassedFastmacos · aarch647514 ms / 336 ms
FP32cpuPassedFastmacos · aarch647558 ms / 335 ms
FP32cpuPassedNot measuredmacos · aarch6435560 ms / 335 ms
FP32cpuPassedNot measuredmacos · aarch6423795 ms / 335 ms
FP32cpuPassedNot measuredmacos · aarch6445755 ms / 335 ms
FP32cpuPassedNot measuredmacos · aarch6445879 ms / 335 ms
Test setup & sample details
Quality gate
Frozen four-fixture paragraphCER/token recall, caption/receipt phrases, ordered PDF pages, EOS/non-repetition/resource/speed and bboxIoU where applicable; narrow English/cropped-page scope.
Tested
2026-11-08T09:54:32.664863+00:00
Environment
{ "hardware": "Apple M3 Max", "os": "macOS27.2/aarch64", "python": "3.13.18 app-owned private development venv", "runtime": "Transformers5.22.1/Torch2.10.0/Pillow12.0.0/PDFium5.14.0", "scope": "Exact immutable local snapshots; model-process loads exclude interpreter imports/network setup. totalMs is model-load component plus full helper request wall time, not warm IPC session elapsed time. Concurrent tracked transfers/background host activity recorded separately." }
Runtime
transformers 5.22.1
Artifact revision
c1bc8eb6625be7b34178ff53481b242f7b8ffcb8
Fixture
{
  "file": "model-samples/desktop/lightonocr2/fixtures/scientific-paragraph.png",
  "url": "https://assets.localai.tools/samples/v1/files/de0959e7c3fe59f4d706bb84d993cd1aae000a6b25bcef96f472d3a675871dfb/scientific-paragraph.png",
  "size": 26674,
  "sha1": "b4e9dd3ea6464bc8e1ff1f95134eccfc25622d52",
  "sha256": "de0959e7c3fe59f4d706bb84d993cd1aae000a6b25bcef96f472d3a675871dfb"
}
Rerun when
artifact revision/weight change; pinned runtime/prediction/preprocessing change; fixture/checksum or quality-gate change; relevant host/backend behavior change
Per-case quality & failure details
[
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 335.23629100091057,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7538.727166000172,
      "inferenceMs": 7509.500500000286,
      "pagesPerSecond": 0.13316464923332277,
      "tokensPerSecond": 8.922031498632625,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7509.500500000286
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 6490161152,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 7541.668416000903,
      "totalMs": 7876.904707001813,
      "postUseRssBytes": 4784160768,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 0.8333333333333334,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 335.23629100091057,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 35585.01304099991,
      "inferenceMs": 35559.96920899997,
      "pagesPerSecond": 0.028121509164493515,
      "tokensPerSecond": 8.914518405144445,
      "neuralInferencePerformed": true,
      "outputTokens": 317,
      "maxNewTokens": 1024,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        35559.96920899997
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 6591905792,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 35593.521624999994,
      "totalMs": 35928.757916000905,
      "postUseRssBytes": 5784403968,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 335.23629100091057,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 23821.623707999606,
      "inferenceMs": 23794.71341700082,
      "pagesPerSecond": 0.04202614179355996,
      "tokensPerSecond": 2.1013070896779977,
      "neuralInferencePerformed": true,
      "outputTokens": 50,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        23794.71341700082
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7251443712,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 23824.45162499971,
      "totalMs": 24159.68791600062,
      "postUseRssBytes": 5488541696,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "pageOrder": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 335.23629100091057,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 45818.383665999136,
      "inferenceMs": 45755.1181660001,
      "pagesPerSecond": 0.043710956941341,
      "tokensPerSecond": 1.5954499283589467,
      "neuralInferencePerformed": true,
      "outputTokens": 73,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "application/pdf",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        24121.44708300002,
        21633.67108300008
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7251443712,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 45822.62087500021,
      "totalMs": 46157.85716600112,
      "postUseRssBytes": 5288853504,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 335.23629100091057,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7568.725416000234,
      "inferenceMs": 7557.6993329996185,
      "pagesPerSecond": 0.13231539863376707,
      "tokensPerSecond": 8.865131708462394,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7557.6993329996185
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7251443712,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 7571.682417001284,
      "totalMs": 7906.918708002195,
      "postUseRssBytes": 4800561152,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 335.23629100091057,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7385.118792000867,
      "inferenceMs": 7375.171249999767,
      "pagesPerSecond": 0.13559007189155528,
      "tokensPerSecond": 9.084534816734203,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7375.171249999767
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7251443712,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 7387.789665999662,
      "totalMs": 7723.025957000573,
      "postUseRssBytes": 4800626688,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 335.23629100091057,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7424.209541999517,
      "inferenceMs": 7414.713207999739,
      "pagesPerSecond": 0.13486698297664423,
      "tokensPerSecond": 9.036087859435163,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7414.713207999739
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7251443712,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 7426.916042000812,
      "totalMs": 7762.152333001723,
      "postUseRssBytes": 4800593920,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 335.23629100091057,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7492.621708001025,
      "inferenceMs": 7483.190582999669,
      "pagesPerSecond": 0.13363283868137776,
      "tokensPerSecond": 8.95340019165231,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7483.190582999669
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7251443712,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 7495.4515419995005,
      "totalMs": 7830.687833000411,
      "postUseRssBytes": 4800593920,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 335.23629100091057,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7382.457959000021,
      "inferenceMs": 7373.087166000914,
      "pagesPerSecond": 0.13562839791332476,
      "tokensPerSecond": 9.087102660192759,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7373.087166000914
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7251443712,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 7385.207125000306,
      "totalMs": 7720.443416001217,
      "postUseRssBytes": 4800561152,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "pageOrder": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 335.23629100091057,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 45935.30241600092,
      "inferenceMs": 45879.293501000575,
      "pagesPerSecond": 0.04359265035230724,
      "tokensPerSecond": 1.5911317378592142,
      "neuralInferencePerformed": true,
      "outputTokens": 73,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "application/pdf",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        24190.030417001253,
        21689.26308399932
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7251443712,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 45939.3943340001,
      "totalMs": 46274.63062500101,
      "postUseRssBytes": 5272305664,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 335.9951660004299,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7454.72320800036,
      "inferenceMs": 7425.61383300017,
      "pagesPerSecond": 0.13466900144414998,
      "tokensPerSecond": 9.022823096758048,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7425.61383300017
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 6485327872,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 7457.628666001256,
      "totalMs": 7793.6238320016855,
      "postUseRssBytes": 4781228032,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 335.918082999342,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7543.54208299992,
      "inferenceMs": 7514.023832998646,
      "pagesPerSecond": 0.13308448605238543,
      "tokensPerSecond": 8.916660565509824,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7514.023832998646
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 6486048768,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 7546.568916999604,
      "totalMs": 7882.486999998946,
      "postUseRssBytes": 4780195840,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 680.4342909999832,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3993.60466699909,
      "inferenceMs": 3962.208249999094,
      "pagesPerSecond": 0.2523845131058492,
      "tokensPerSecond": 16.909762378091894,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3962.208249999094
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 8775548928,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485819392,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 3996.7364170006476,
      "totalMs": 4677.170708000631,
      "postUseRssBytes": 1163608064,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 0.8333333333333334,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 680.4342909999832,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 22982.439749999685,
      "inferenceMs": 22951.171875,
      "pagesPerSecond": 0.04357075993532465,
      "tokensPerSecond": 13.811930899497915,
      "neuralInferencePerformed": true,
      "outputTokens": 317,
      "maxNewTokens": 1024,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        22951.171875
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 22920691712,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485819392,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 22992.907583000488,
      "totalMs": 23673.34187400047,
      "postUseRssBytes": 1251622912,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 680.4342909999832,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 16796.400375000303,
      "inferenceMs": 16758.672332998685,
      "pagesPerSecond": 0.059670598012167626,
      "tokensPerSecond": 2.9835299006083815,
      "neuralInferencePerformed": true,
      "outputTokens": 50,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        16758.672332998685
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44515115008,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485819392,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 16800.292665999223,
      "totalMs": 17480.726956999206,
      "postUseRssBytes": 1327841280,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "pageOrder": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 680.4342909999832,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 32006.705792000503,
      "inferenceMs": 31930.1118759995,
      "pagesPerSecond": 0.06263679901176025,
      "tokensPerSecond": 2.2862431639292495,
      "neuralInferencePerformed": true,
      "outputTokens": 73,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "application/pdf",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        16499.233333999655,
        15430.878541999846
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44515115008,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485819392,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 32011.260834000495,
      "totalMs": 32691.69512500048,
      "postUseRssBytes": 1333149696,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 680.4342909999832,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3857.3075830008747,
      "inferenceMs": 3841.59662500133,
      "pagesPerSecond": 0.2603084336059499,
      "tokensPerSecond": 17.440665051598646,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3841.59662500133
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 45469319168,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485819392,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 3861.336834001122,
      "totalMs": 4541.771125001105,
      "postUseRssBytes": 1336410112,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 680.4342909999832,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3868.372000000818,
      "inferenceMs": 3854.562000000442,
      "pagesPerSecond": 0.2594328486608557,
      "tokensPerSecond": 17.382000860277333,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3854.562000000442
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485819392,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 3871.809124999345,
      "totalMs": 4552.243415999328,
      "postUseRssBytes": 1339408384,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 680.4342909999832,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3914.415999999619,
      "inferenceMs": 3899.8816660005104,
      "pagesPerSecond": 0.2564180366594408,
      "tokensPerSecond": 17.180008456182534,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3899.8816660005104
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485819392,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 3917.6856670001143,
      "totalMs": 4598.1199580000975,
      "postUseRssBytes": 1342357504,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 680.4342909999832,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3867.006374999619,
      "inferenceMs": 3853.439709000668,
      "pagesPerSecond": 0.2595084069083139,
      "tokensPerSecond": 17.38706326285703,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3853.439709000668
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485819392,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 3870.405874999051,
      "totalMs": 4550.840165999034,
      "postUseRssBytes": 1345290240,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 680.4342909999832,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3853.5056249984336,
      "inferenceMs": 3839.3794170006004,
      "pagesPerSecond": 0.2604587594474369,
      "tokensPerSecond": 17.450736882978273,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3839.3794170006004
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485819392,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 3856.523999998899,
      "totalMs": 4536.958290998882,
      "postUseRssBytes": 1348239360,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 680.4342909999832,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3920.5635840007744,
      "inferenceMs": 3907.780792000267,
      "pagesPerSecond": 0.25589971731452527,
      "tokensPerSecond": 17.145281060073195,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3907.780792000267
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485819392,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 3923.6611659998744,
      "totalMs": 4604.095456999858,
      "postUseRssBytes": 1351122944,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 680.4342909999832,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3882.901208000476,
      "inferenceMs": 3868.2095000003756,
      "pagesPerSecond": 0.25851753892851537,
      "tokensPerSecond": 17.32067510821053,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3868.2095000003756
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485819392,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 3886.1685000010766,
      "totalMs": 4566.60279100106,
      "postUseRssBytes": 1354006528,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 680.4342909999832,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3900.0280000000203,
      "inferenceMs": 3886.460375000752,
      "pagesPerSecond": 0.2573035367689312,
      "tokensPerSecond": 17.23933696351839,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3886.460375000752
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485819392,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 3903.494333000708,
      "totalMs": 4583.928624000691,
      "postUseRssBytes": 1356873728,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 680.4342909999832,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3900.6265420011914,
      "inferenceMs": 3886.876750000738,
      "pagesPerSecond": 0.25727597356921855,
      "tokensPerSecond": 17.237490229137645,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3886.876750000738
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485819392,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 3904.0540419991885,
      "totalMs": 4584.488332999172,
      "postUseRssBytes": 1359740928,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 680.4342909999832,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3901.877832999162,
      "inferenceMs": 3888.204124999902,
      "pagesPerSecond": 0.2571881433822678,
      "tokensPerSecond": 17.231605606611943,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3888.204124999902
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485819392,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 3905.157416998918,
      "totalMs": 4585.591707998901,
      "postUseRssBytes": 1362608128,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 680.4342909999832,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3964.073124998322,
      "inferenceMs": 3950.541500000327,
      "pagesPerSecond": 0.25312985574253993,
      "tokensPerSecond": 16.959700334750174,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3950.541500000327
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485819392,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 3967.3144579992368,
      "totalMs": 4647.74874899922,
      "postUseRssBytes": 1365508096,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 680.4342909999832,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3910.5376250008703,
      "inferenceMs": 3897.0187499999156,
      "pagesPerSecond": 0.25660641227349024,
      "tokensPerSecond": 17.192629622323846,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3897.0187499999156
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485819392,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 3913.8245829999505,
      "totalMs": 4594.258873999934,
      "postUseRssBytes": 1368358912,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 680.4342909999832,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3895.3761249995296,
      "inferenceMs": 3881.681208000373,
      "pagesPerSecond": 0.2576203316075883,
      "tokensPerSecond": 17.260562217708415,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3881.681208000373
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485819392,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 3898.746459000904,
      "totalMs": 4579.180750000887,
      "postUseRssBytes": 1371258880,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 680.4342909999832,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3893.3773749995453,
      "inferenceMs": 3879.7373750003317,
      "pagesPerSecond": 0.2577494050096405,
      "tokensPerSecond": 17.269210135645913,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3879.7373750003317
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485819392,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 3896.704333001253,
      "totalMs": 4577.138624001236,
      "postUseRssBytes": 1374158848,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 680.4342909999832,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3932.5436250001076,
      "inferenceMs": 3918.4858340013307,
      "pagesPerSecond": 0.25520061635105057,
      "tokensPerSecond": 17.098441295520388,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3918.4858340013307
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485819392,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 3935.7598749993485,
      "totalMs": 4616.194165999332,
      "postUseRssBytes": 1376976896,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "pageOrder": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 680.4342909999832,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 33629.99816699994,
      "inferenceMs": 33551.6177089994,
      "pagesPerSecond": 0.059609644379786456,
      "tokensPerSecond": 2.175752019862206,
      "neuralInferencePerformed": true,
      "outputTokens": 73,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "application/pdf",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        17259.4937089998,
        16292.123999999603
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44515115008,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485819392,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 33634.321791998445,
      "totalMs": 34314.75608299843,
      "postUseRssBytes": 1379926016,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 653.3955409995542,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 4156.651208000767,
      "inferenceMs": 4126.197499999762,
      "pagesPerSecond": 0.24235388635664137,
      "tokensPerSecond": 16.23771038589497,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        4126.197499999762
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 8775548928,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6488473600,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 4159.851708000133,
      "totalMs": 4813.247248999687,
      "postUseRssBytes": 1168441344,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 673.9689580008417,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 4158.222750000277,
      "inferenceMs": 4125.235666000663,
      "pagesPerSecond": 0.24241039323929847,
      "tokensPerSecond": 16.241496347033,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        4125.235666000663
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 8775548928,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485426176,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "c1bc8eb6625be7b34178ff53481b242f7b8ffcb8",
      "fallback": false,
      "requestWallMs": 4161.559500000294,
      "totalMs": 4835.528458001136,
      "postUseRssBytes": 1162362880,
      "grade": "fast"
    }
  }
]

LightOnOCR-2 1B BBox Base Desktop

36 configurations tested
Passed36
Failed0
TestedNov 8, 2026
Runtimetransformers 5.22.1

Quality criteria

Frozen four-fixture paragraphCER/token recall, caption/receipt phrases, ordered PDF pages, EOS/non-repetition/resource/speed and bboxIoU where applicable; narrow English/cropped-page scope.

PrecisionDeviceResultPlatformInference / load
FP32mpsAcceleratedPassedFastmacos · aarch643807 ms / 681 ms
FP32mpsAcceleratedPassedFastmacos · aarch643812 ms / 681 ms
FP32mpsAcceleratedPassedFastmacos · aarch643816 ms / 681 ms
FP32mpsAcceleratedPassedFastmacos · aarch643817 ms / 681 ms
FP32mpsAcceleratedPassedFastmacos · aarch643819 ms / 681 ms
FP32mpsAcceleratedPassedFastmacos · aarch643820 ms / 681 ms
FP32mpsAcceleratedPassedFastmacos · aarch643823 ms / 681 ms
FP32mpsAcceleratedPassedFastmacos · aarch643824 ms / 681 ms
FP32mpsAcceleratedPassedFastmacos · aarch643828 ms / 681 ms
FP32mpsAcceleratedPassedFastmacos · aarch643828 ms / 681 ms
FP32mpsAcceleratedPassedFastmacos · aarch643830 ms / 681 ms
FP32mpsAcceleratedPassedFastmacos · aarch643830 ms / 681 ms
FP32mpsAcceleratedPassedFastmacos · aarch643834 ms / 681 ms
FP32mpsAcceleratedPassedFastmacos · aarch643834 ms / 681 ms
FP32mpsAcceleratedPassedFastmacos · aarch643837 ms / 681 ms
FP32mpsAcceleratedPassedFastmacos · aarch643976 ms / 678 ms
FP32mpsAcceleratedPassedFastmacos · aarch643987 ms / 681 ms
FP32mpsAcceleratedPassedFastmacos · aarch644002 ms / 652 ms
FP32mpsAcceleratedPassedNot measuredmacos · aarch6423171 ms / 681 ms
FP32mpsAcceleratedPassedNot measuredmacos · aarch6416703 ms / 681 ms
FP32mpsAcceleratedPassedNot measuredmacos · aarch6431495 ms / 681 ms
FP32mpsAcceleratedPassedNot measuredmacos · aarch6431706 ms / 681 ms
FP32mpsAcceleratedPassedNot measuredmacos · aarch6423289 ms / 681 ms
FP32cpuPassedFastmacos · aarch647389 ms / 337 ms
FP32cpuPassedFastmacos · aarch647439 ms / 337 ms
FP32cpuPassedFastmacos · aarch647447 ms / 337 ms
FP32cpuPassedFastmacos · aarch647448 ms / 337 ms
FP32cpuPassedFastmacos · aarch647463 ms / 337 ms
FP32cpuPassedFastmacos · aarch647475 ms / 337 ms
FP32cpuPassedFastmacos · aarch647568 ms / 343 ms
FP32cpuPassedFastmacos · aarch647588 ms / 335 ms
FP32cpuPassedNot measuredmacos · aarch6436426 ms / 337 ms
FP32cpuPassedNot measuredmacos · aarch6423674 ms / 337 ms
FP32cpuPassedNot measuredmacos · aarch6445688 ms / 337 ms
FP32cpuPassedNot measuredmacos · aarch6445691 ms / 337 ms
FP32cpuPassedNot measuredmacos · aarch6435631 ms / 337 ms
Test setup & sample details
Quality gate
Frozen four-fixture paragraphCER/token recall, caption/receipt phrases, ordered PDF pages, EOS/non-repetition/resource/speed and bboxIoU where applicable; narrow English/cropped-page scope.
Tested
2026-11-08T10:04:04.991192+00:00
Environment
{ "hardware": "Apple M3 Max", "os": "macOS27.2/aarch64", "python": "3.13.18 app-owned private development venv", "runtime": "Transformers5.22.1/Torch2.10.0/Pillow12.0.0/PDFium5.14.0", "scope": "Exact immutable local snapshots; model-process loads exclude interpreter imports/network setup. totalMs is model-load component plus full helper request wall time, not warm IPC session elapsed time. Concurrent tracked transfers/background host activity recorded separately." }
Runtime
transformers 5.22.1
Artifact revision
82d708ea57f6867dbc5c183b7146287235b92fcf
Fixture
{
  "file": "model-samples/desktop/lightonocr2/fixtures/scientific-paragraph.png",
  "url": "https://assets.localai.tools/samples/v1/files/de0959e7c3fe59f4d706bb84d993cd1aae000a6b25bcef96f472d3a675871dfb/scientific-paragraph.png",
  "size": 26674,
  "sha1": "b4e9dd3ea6464bc8e1ff1f95134eccfc25622d52",
  "sha256": "de0959e7c3fe59f4d706bb84d993cd1aae000a6b25bcef96f472d3a675871dfb"
}
Rerun when
artifact revision/weight change; pinned runtime/prediction/preprocessing change; fixture/checksum or quality-gate change; relevant host/backend behavior change
Per-case quality & failure details
[
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 337.2504580001987,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7469.0980420000415,
      "inferenceMs": 7439.041999999972,
      "pagesPerSecond": 0.13442591129341705,
      "tokensPerSecond": 9.006536056658943,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7439.041999999972
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 6488948736,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 7471.974292000596,
      "totalMs": 7809.224750000794,
      "postUseRssBytes": 4781146112,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 0.8333333333333334,
      "textQuality": true,
      "imageBoxIoU": 0.862775855040837,
      "bboxQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 337.2504580001987,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 36451.55125000019,
      "inferenceMs": 36426.39208400033,
      "pagesPerSecond": 0.027452622749295916,
      "tokensPerSecond": 9.086818130016947,
      "neuralInferencePerformed": true,
      "outputTokens": 331,
      "maxNewTokens": 1024,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        36426.39208400033
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 6622642176,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 36459.99591600048,
      "totalMs": 36797.24637400068,
      "postUseRssBytes": 5782978560,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 337.2504580001987,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 23701.2632090009,
      "inferenceMs": 23673.991124998793,
      "pagesPerSecond": 0.04224044837729283,
      "tokensPerSecond": 2.1120224188646413,
      "neuralInferencePerformed": true,
      "outputTokens": 50,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        23673.991124998793
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7466205184,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 23704.05616700009,
      "totalMs": 24041.30662500029,
      "postUseRssBytes": 5630279680,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "pageOrder": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 337.2504580001987,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 45750.83170799917,
      "inferenceMs": 45687.97408399951,
      "pagesPerSecond": 0.04377519555414966,
      "tokensPerSecond": 1.5977946377264625,
      "neuralInferencePerformed": true,
      "outputTokens": 73,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "application/pdf",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        23995.909125000253,
        21692.064958999254
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7466205184,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 45755.11679199917,
      "totalMs": 46092.36724999937,
      "postUseRssBytes": 5284577280,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 337.2504580001987,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7474.389375000101,
      "inferenceMs": 7463.420666999809,
      "pagesPerSecond": 0.1339868197998795,
      "tokensPerSecond": 8.977116926591927,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7463.420666999809
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7466205184,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 7477.303708999898,
      "totalMs": 7814.554167000097,
      "postUseRssBytes": 4797366272,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 337.2504580001987,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7484.404790999179,
      "inferenceMs": 7475.0047080015065,
      "pagesPerSecond": 0.1337791799555076,
      "tokensPerSecond": 8.963205057019008,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7475.0047080015065
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7466205184,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 7487.184041001456,
      "totalMs": 7824.434499001654,
      "postUseRssBytes": 4797464576,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 337.2504580001987,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7398.757791999742,
      "inferenceMs": 7389.293167001597,
      "pagesPerSecond": 0.13533094132273774,
      "tokensPerSecond": 9.067173068623429,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7389.293167001597
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7466205184,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 7401.579290999507,
      "totalMs": 7738.829748999706,
      "postUseRssBytes": 4797464576,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 337.2504580001987,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7456.427167000584,
      "inferenceMs": 7446.9466249993275,
      "pagesPerSecond": 0.13428322376355026,
      "tokensPerSecond": 8.996975992157866,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7446.9466249993275
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7466205184,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 7459.16812500036,
      "totalMs": 7796.418583000559,
      "postUseRssBytes": 4797431808,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 337.2504580001987,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7457.046042000002,
      "inferenceMs": 7447.6026669999555,
      "pagesPerSecond": 0.13427139506662486,
      "tokensPerSecond": 8.996183469463865,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7447.6026669999555
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7466205184,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 7459.872041999915,
      "totalMs": 7797.122500000114,
      "postUseRssBytes": 4797399040,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "pageOrder": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 337.2504580001987,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 45745.9888329995,
      "inferenceMs": 45690.59800099967,
      "pagesPerSecond": 0.04377268163476963,
      "tokensPerSecond": 1.5977028796690913,
      "neuralInferencePerformed": true,
      "outputTokens": 73,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "application/pdf",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        23928.81191699962,
        21761.78608400005
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7466205184,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 45750.23416699878,
      "totalMs": 46087.48462499898,
      "postUseRssBytes": 5268160512,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 0.8333333333333334,
      "textQuality": true,
      "imageBoxIoU": 0.862775855040837,
      "bboxQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 337.2504580001987,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 35655.99575000124,
      "inferenceMs": 35630.84533300025,
      "pagesPerSecond": 0.028065570453189026,
      "tokensPerSecond": 9.289703820005569,
      "neuralInferencePerformed": true,
      "outputTokens": 331,
      "maxNewTokens": 1024,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        35630.84533300025
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "visualizationMs": 6.0794590008299565,
      "peakResidentMemoryBytes": 7466205184,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 35671.738333001485,
      "totalMs": 36008.988791001684,
      "postUseRssBytes": 5244665856,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 334.81758299967623,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7617.470875000436,
      "inferenceMs": 7588.012458998492,
      "pagesPerSecond": 0.13178681577072499,
      "tokensPerSecond": 8.829716656638572,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7588.012458998492
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 6484885504,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 7620.454833999247,
      "totalMs": 7955.272416998923,
      "postUseRssBytes": 4778754048,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 343.3123329996306,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7597.374916998888,
      "inferenceMs": 7567.990333000125,
      "pagesPerSecond": 0.13213547533742384,
      "tokensPerSecond": 8.853076847607397,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7567.990333000125
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 6488555520,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 7600.343915999474,
      "totalMs": 7943.656248999105,
      "postUseRssBytes": 4781490176,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 681.429707999996,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 4017.2767499989277,
      "inferenceMs": 3986.7967080008384,
      "pagesPerSecond": 0.250827938628816,
      "tokensPerSecond": 16.805471888130672,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3986.7967080008384
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 8775548928,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485245952,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 4020.4007500014995,
      "totalMs": 4701.830458001496,
      "postUseRssBytes": 1164902400,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 0.8333333333333334,
      "textQuality": true,
      "imageBoxIoU": 0.862775855040837,
      "bboxQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 681.429707999996,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 23200.27837499947,
      "inferenceMs": 23170.760917000734,
      "pagesPerSecond": 0.04315784033084062,
      "tokensPerSecond": 14.285245149508247,
      "neuralInferencePerformed": true,
      "outputTokens": 331,
      "maxNewTokens": 1024,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        23170.760917000734
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 22920691712,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485245952,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 23210.67020800001,
      "totalMs": 23892.099916000006,
      "postUseRssBytes": 1254686720,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 681.429707999996,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 16737.137333000646,
      "inferenceMs": 16702.840457999628,
      "pagesPerSecond": 0.0598700563843955,
      "tokensPerSecond": 2.993502819219775,
      "neuralInferencePerformed": true,
      "outputTokens": 50,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        16702.840457999628
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44515115008,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485245952,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 16741.09079200025,
      "totalMs": 17422.520500000246,
      "postUseRssBytes": 1335148544,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "pageOrder": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 681.429707999996,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 31567.510625000068,
      "inferenceMs": 31495.167915998536,
      "pagesPerSecond": 0.06350180463664282,
      "tokensPerSecond": 2.317815869237463,
      "neuralInferencePerformed": true,
      "outputTokens": 73,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "application/pdf",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        16317.354582999542,
        15177.813332998994
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44515115008,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485245952,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 31572.952042000907,
      "totalMs": 32254.381750000903,
      "postUseRssBytes": 1340686336,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 681.429707999996,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3823.8966669996444,
      "inferenceMs": 3811.845041998822,
      "pagesPerSecond": 0.2623401499751492,
      "tokensPerSecond": 17.576790048335,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3811.845041998822
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 45469319168,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485245952,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 3826.53562500127,
      "totalMs": 4507.965333001266,
      "postUseRssBytes": 1343930368,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 681.429707999996,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3842.336332998457,
      "inferenceMs": 3829.733999999007,
      "pagesPerSecond": 0.2611147406060732,
      "tokensPerSecond": 17.494687620606907,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3829.733999999007
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485245952,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 3845.3800000006595,
      "totalMs": 4526.8097080006555,
      "postUseRssBytes": 1346994176,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 681.429707999996,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3841.921833000015,
      "inferenceMs": 3828.2483330003743,
      "pagesPerSecond": 0.2612160740409058,
      "tokensPerSecond": 17.50147696074069,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3828.2483330003743
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485245952,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 3845.2982079998037,
      "totalMs": 4526.7279159998,
      "postUseRssBytes": 1349894144,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 681.429707999996,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3820.1027079994674,
      "inferenceMs": 3806.64383399926,
      "pagesPerSecond": 0.2626985984526427,
      "tokensPerSecond": 17.600806096327062,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3806.64383399926
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485245952,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 3823.480084000039,
      "totalMs": 4504.909792000035,
      "postUseRssBytes": 1352843264,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 681.429707999996,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3834.359166001377,
      "inferenceMs": 3820.4327920011565,
      "pagesPerSecond": 0.26175044934534664,
      "tokensPerSecond": 17.537280106138226,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3820.4327920011565
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485245952,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 3837.7717089988437,
      "totalMs": 4519.20141699884,
      "postUseRssBytes": 1355776000,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 681.429707999996,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3833.9022079999268,
      "inferenceMs": 3819.097374998819,
      "pagesPerSecond": 0.26184197516050745,
      "tokensPerSecond": 17.543412335754,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3819.097374998819
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485245952,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 3837.266416001512,
      "totalMs": 4518.696124001508,
      "postUseRssBytes": 1358561280,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 681.429707999996,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3850.858249999874,
      "inferenceMs": 3837.276666999969,
      "pagesPerSecond": 0.26060148557956664,
      "tokensPerSecond": 17.460299533830966,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3837.276666999969
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485245952,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 3854.278083999816,
      "totalMs": 4535.707791999812,
      "postUseRssBytes": 1361412096,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 681.429707999996,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3837.3313330012024,
      "inferenceMs": 3823.4200829992915,
      "pagesPerSecond": 0.26154594009862175,
      "tokensPerSecond": 17.523577986607656,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3823.4200829992915
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485245952,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 3840.773249999984,
      "totalMs": 4522.20295799998,
      "postUseRssBytes": 1364279296,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 681.429707999996,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3831.4674999983254,
      "inferenceMs": 3817.419457998767,
      "pagesPerSecond": 0.2619570657619682,
      "tokensPerSecond": 17.551123406051868,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3817.419457998767
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485245952,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 3834.807875000479,
      "totalMs": 4516.237583000475,
      "postUseRssBytes": 1367228416,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 681.429707999996,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3847.500707999643,
      "inferenceMs": 3834.1626669989637,
      "pagesPerSecond": 0.2608131388391796,
      "tokensPerSecond": 17.474480302225036,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3834.1626669989637
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485245952,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 3850.5714170005376,
      "totalMs": 4532.001125000534,
      "postUseRssBytes": 1370112000,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 681.429707999996,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3842.0324590006203,
      "inferenceMs": 3828.149749999284,
      "pagesPerSecond": 0.2612228009105932,
      "tokensPerSecond": 17.501927661009745,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3828.149749999284
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485245952,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 3845.4883330014127,
      "totalMs": 4526.918041001409,
      "postUseRssBytes": 1372913664,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 681.429707999996,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3829.541417000655,
      "inferenceMs": 3815.6653750011174,
      "pagesPerSecond": 0.26207748890970484,
      "tokensPerSecond": 17.559191756950224,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3815.6653750011174
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485245952,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 3832.979458000409,
      "totalMs": 4514.409166000405,
      "postUseRssBytes": 1375846400,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 681.429707999996,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3847.7438330010045,
      "inferenceMs": 3833.9419160001853,
      "pagesPerSecond": 0.26082815595789316,
      "tokensPerSecond": 17.47548644917884,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3833.9419160001853
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485245952,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 3851.0885420000704,
      "totalMs": 4532.5182500000665,
      "postUseRssBytes": 1378746368,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 681.429707999996,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3843.9971249990776,
      "inferenceMs": 3830.195874999845,
      "pagesPerSecond": 0.2610832533466818,
      "tokensPerSecond": 17.49257797422768,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3830.195874999845
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485245952,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 3847.3582499991608,
      "totalMs": 4528.787957999157,
      "postUseRssBytes": 1381548032,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 681.429707999996,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3838.1926249985554,
      "inferenceMs": 3824.4019579997257,
      "pagesPerSecond": 0.2614787909278839,
      "tokensPerSecond": 17.519078992168218,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3824.4019579997257
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485245952,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 3841.6692080008943,
      "totalMs": 4523.09891600089,
      "postUseRssBytes": 1384415232,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "pageOrder": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 681.429707999996,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 31779.85979100049,
      "inferenceMs": 31705.66583299842,
      "pagesPerSecond": 0.06308020814117245,
      "tokensPerSecond": 2.302427597152794,
      "neuralInferencePerformed": true,
      "outputTokens": 73,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "application/pdf",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        16386.49016599993,
        15319.17566699849
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44515115008,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485245952,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 31785.02479099916,
      "totalMs": 32466.454498999155,
      "postUseRssBytes": 1387298816,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 0.8333333333333334,
      "textQuality": true,
      "imageBoxIoU": 0.862775855040837,
      "bboxQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 681.429707999996,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 23321.36441700095,
      "inferenceMs": 23288.620792000074,
      "pagesPerSecond": 0.04293942560752727,
      "tokensPerSecond": 14.212949876091526,
      "neuralInferencePerformed": true,
      "outputTokens": 331,
      "maxNewTokens": 1024,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        23288.620792000074
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44355731456,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "visualizationMs": 10.161582998989616,
      "peakResidentMemoryBytes": 6485245952,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 23345.697499999005,
      "totalMs": 24027.127207999,
      "postUseRssBytes": 1400782848,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 652.157750000697,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 4032.349458000681,
      "inferenceMs": 4001.9262919995526,
      "pagesPerSecond": 0.24987966470025924,
      "tokensPerSecond": 16.74193753491737,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        4001.9262919995526
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 8775548928,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485426176,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 4035.5845840003894,
      "totalMs": 4687.742334001086,
      "postUseRssBytes": 1162117120,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 677.9445420015691,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 4006.4946660004352,
      "inferenceMs": 3975.5600419994153,
      "pagesPerSecond": 0.25153688774300925,
      "tokensPerSecond": 16.85297147878162,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3975.5600419994153
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 8775548928,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6486081536,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "82d708ea57f6867dbc5c183b7146287235b92fcf",
      "fallback": false,
      "requestWallMs": 4009.7222500007774,
      "totalMs": 4687.6667920023465,
      "postUseRssBytes": 1162887168,
      "grade": "fast"
    }
  }
]

LightOnOCR-2 1B BBox Soup Desktop

36 configurations tested
Passed36
Failed0
TestedNov 8, 2026
Runtimetransformers 5.22.1

Quality criteria

Frozen four-fixture paragraphCER/token recall, caption/receipt phrases, ordered PDF pages, EOS/non-repetition/resource/speed and bboxIoU where applicable; narrow English/cropped-page scope.

PrecisionDeviceResultPlatformInference / load
FP32mpsAcceleratedPassedFastmacos · aarch643595 ms / 736 ms
FP32mpsAcceleratedPassedFastmacos · aarch643606 ms / 719 ms
FP32mpsAcceleratedPassedFastmacos · aarch643618 ms / 719 ms
FP32mpsAcceleratedPassedFastmacos · aarch643620 ms / 719 ms
FP32mpsAcceleratedPassedFastmacos · aarch643620 ms / 719 ms
FP32mpsAcceleratedPassedFastmacos · aarch643622 ms / 778 ms
FP32mpsAcceleratedPassedFastmacos · aarch643625 ms / 719 ms
FP32mpsAcceleratedPassedFastmacos · aarch643626 ms / 719 ms
FP32mpsAcceleratedPassedFastmacos · aarch643629 ms / 719 ms
FP32mpsAcceleratedPassedFastmacos · aarch643635 ms / 719 ms
FP32mpsAcceleratedPassedFastmacos · aarch643645 ms / 719 ms
FP32mpsAcceleratedPassedFastmacos · aarch643645 ms / 719 ms
FP32mpsAcceleratedPassedFastmacos · aarch643647 ms / 719 ms
FP32mpsAcceleratedPassedFastmacos · aarch643652 ms / 719 ms
FP32mpsAcceleratedPassedFastmacos · aarch643653 ms / 719 ms
FP32mpsAcceleratedPassedFastmacos · aarch643653 ms / 719 ms
FP32mpsAcceleratedPassedFastmacos · aarch643653 ms / 719 ms
FP32mpsAcceleratedPassedFastmacos · aarch643794 ms / 719 ms
FP32mpsAcceleratedPassedNot measuredmacos · aarch6423304 ms / 719 ms
FP32mpsAcceleratedPassedNot measuredmacos · aarch6416602 ms / 719 ms
FP32mpsAcceleratedPassedNot measuredmacos · aarch6431545 ms / 719 ms
FP32mpsAcceleratedPassedNot measuredmacos · aarch6430497 ms / 719 ms
FP32mpsAcceleratedPassedNot measuredmacos · aarch6421477 ms / 719 ms
FP32cpuPassedFastmacos · aarch647051 ms / 353 ms
FP32cpuPassedFastmacos · aarch647083 ms / 353 ms
FP32cpuPassedFastmacos · aarch647088 ms / 353 ms
FP32cpuPassedFastmacos · aarch647088 ms / 353 ms
FP32cpuPassedFastmacos · aarch647110 ms / 353 ms
FP32cpuPassedFastmacos · aarch647152 ms / 353 ms
FP32cpuPassedFastmacos · aarch647206 ms / 333 ms
FP32cpuPassedFastmacos · aarch647211 ms / 334 ms
FP32cpuPassedNot measuredmacos · aarch6436542 ms / 353 ms
FP32cpuPassedNot measuredmacos · aarch6423801 ms / 353 ms
FP32cpuPassedNot measuredmacos · aarch6445409 ms / 353 ms
FP32cpuPassedNot measuredmacos · aarch6445659 ms / 353 ms
FP32cpuPassedNot measuredmacos · aarch6434722 ms / 353 ms
Test setup & sample details
Quality gate
Frozen four-fixture paragraphCER/token recall, caption/receipt phrases, ordered PDF pages, EOS/non-repetition/resource/speed and bboxIoU where applicable; narrow English/cropped-page scope.
Tested
2026-11-08T10:21:59.397576+00:00
Environment
{ "hardware": "Apple M3 Max", "os": "macOS27.2/aarch64", "python": "3.13.18 app-owned private development venv", "runtime": "Transformers5.22.1/Torch2.10.0/Pillow12.0.0/PDFium5.14.0", "scope": "Exact immutable local snapshots; model-process loads exclude interpreter imports/network setup. totalMs is model-load component plus full helper request wall time, not warm IPC session elapsed time. Concurrent tracked transfers/background host activity recorded separately." }
Runtime
transformers 5.22.1
Artifact revision
e16ab911c8eda8035fd6b96172316dfa09e4c491
Fixture
{
  "file": "model-samples/desktop/lightonocr2/fixtures/scientific-paragraph.png",
  "url": "https://assets.localai.tools/samples/v1/files/de0959e7c3fe59f4d706bb84d993cd1aae000a6b25bcef96f472d3a675871dfb/scientific-paragraph.png",
  "size": 26674,
  "sha1": "b4e9dd3ea6464bc8e1ff1f95134eccfc25622d52",
  "sha256": "de0959e7c3fe59f4d706bb84d993cd1aae000a6b25bcef96f472d3a675871dfb"
}
Rerun when
artifact revision/weight change; pinned runtime/prediction/preprocessing change; fixture/checksum or quality-gate change; relevant host/backend behavior change
Per-case quality & failure details
[
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 353.34620800131233,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7142.251958000998,
      "inferenceMs": 7110.412083999108,
      "pagesPerSecond": 0.14063882489319382,
      "tokensPerSecond": 8.43832949359163,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7110.412083999108
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 6487506944,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 7145.218042000124,
      "totalMs": 7498.564250001436,
      "postUseRssBytes": 4781293568,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 0.8333333333333334,
      "textQuality": true,
      "imageBoxIoU": 0.8287878429327068,
      "bboxQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 353.34620800131233,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 36567.33633299882,
      "inferenceMs": 36541.81499999868,
      "pagesPerSecond": 0.027365909438270546,
      "tokensPerSecond": 8.97601829575274,
      "neuralInferencePerformed": true,
      "outputTokens": 328,
      "maxNewTokens": 1024,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        36541.81499999868
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 6592331776,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 36576.35541699892,
      "totalMs": 36929.701625000234,
      "postUseRssBytes": 5785042944,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 353.34620800131233,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 23827.878416999738,
      "inferenceMs": 23800.57704200044,
      "pagesPerSecond": 0.042015788030488437,
      "tokensPerSecond": 2.100789401524422,
      "neuralInferencePerformed": true,
      "outputTokens": 50,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        23800.57704200044
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7156776960,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 23830.82900000045,
      "totalMs": 24184.17520800176,
      "postUseRssBytes": 5358649344,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "pageOrder": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 353.34620800131233,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 45473.13108400158,
      "inferenceMs": 45409.39583399995,
      "pagesPerSecond": 0.044043748287496805,
      "tokensPerSecond": 1.5415311900623883,
      "neuralInferencePerformed": true,
      "outputTokens": 70,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "application/pdf",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        23859.246584001085,
        21550.149249998867
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7156776960,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 45477.5051659999,
      "totalMs": 45830.85137400121,
      "postUseRssBytes": 5268881408,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 353.34620800131233,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7061.850374999267,
      "inferenceMs": 7050.922500000524,
      "pagesPerSecond": 0.1418254136249442,
      "tokensPerSecond": 8.509524817496652,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7050.922500000524
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7156776960,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 7064.794166999491,
      "totalMs": 7418.140375000803,
      "postUseRssBytes": 4798169088,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 353.34620800131233,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7097.1252500003175,
      "inferenceMs": 7087.634040999546,
      "pagesPerSecond": 0.14109080607369695,
      "tokensPerSecond": 8.465448364421816,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7087.634040999546
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7156776960,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 7099.921917000756,
      "totalMs": 7453.268125002069,
      "postUseRssBytes": 4798464000,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 353.34620800131233,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7161.406916999113,
      "inferenceMs": 7151.901707999059,
      "pagesPerSecond": 0.13982295070995565,
      "tokensPerSecond": 8.389377042597339,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7151.901707999059
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7156776960,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 7164.235791000465,
      "totalMs": 7517.581999001777,
      "postUseRssBytes": 4798480384,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 353.34620800131233,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7097.078041000714,
      "inferenceMs": 7087.571832998947,
      "pagesPerSecond": 0.14109204443531861,
      "tokensPerSecond": 8.465522666119117,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7087.571832998947
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7156776960,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 7099.894292001409,
      "totalMs": 7453.240500002721,
      "postUseRssBytes": 4798480384,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 353.34620800131233,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7092.363833000491,
      "inferenceMs": 7082.899790999363,
      "pagesPerSecond": 0.14118511196088868,
      "tokensPerSecond": 8.47110671765332,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7082.899790999363
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7156776960,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 7095.20479099956,
      "totalMs": 7448.550999000872,
      "postUseRssBytes": 4798480384,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "pageOrder": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 353.34620800131233,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 45715.30187499957,
      "inferenceMs": 45659.47383300045,
      "pagesPerSecond": 0.04380251965484756,
      "tokensPerSecond": 1.5330881879196647,
      "neuralInferencePerformed": true,
      "outputTokens": 70,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "application/pdf",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        24150.348083001518,
        21509.12574999893
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7156776960,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 45719.78450000097,
      "totalMs": 46073.13070800228,
      "postUseRssBytes": 5269766144,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 0.8333333333333334,
      "textQuality": true,
      "imageBoxIoU": 0.8287878429327068,
      "bboxQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 353.34620800131233,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 34748.50787499963,
      "inferenceMs": 34722.367624999606,
      "pagesPerSecond": 0.02879987939762536,
      "tokensPerSecond": 9.446360442421119,
      "neuralInferencePerformed": true,
      "outputTokens": 328,
      "maxNewTokens": 1024,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        34722.367624999606
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "visualizationMs": 5.778208000265295,
      "peakResidentMemoryBytes": 7156776960,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 34764.15458300107,
      "totalMs": 35117.500791002385,
      "postUseRssBytes": 5244796928,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 333.449040999767,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7235.365250000541,
      "inferenceMs": 7205.531749999864,
      "pagesPerSecond": 0.13878226266923588,
      "tokensPerSecond": 8.326935760154154,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7205.531749999864
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 6485557248,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 7238.22887499955,
      "totalMs": 7571.677915999317,
      "postUseRssBytes": 4778983424,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 334.0889580013027,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7241.183457999796,
      "inferenceMs": 7211.431209001603,
      "pagesPerSecond": 0.13866872899678487,
      "tokensPerSecond": 8.320123739807093,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7211.431209001603
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 6485147648,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 7244.127083000421,
      "totalMs": 7578.216041001724,
      "postUseRssBytes": 4779884544,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 718.8838750007562,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3825.6256250006118,
      "inferenceMs": 3794.4219580003846,
      "pagesPerSecond": 0.2635447536064197,
      "tokensPerSecond": 15.812685216385182,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3794.4219580003846
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 8775548928,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6484525056,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 3828.8401249992603,
      "totalMs": 4547.7240000000165,
      "postUseRssBytes": 1161101312,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 0.8333333333333334,
      "textQuality": true,
      "imageBoxIoU": 0.8287878429327068,
      "bboxQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 718.8838750007562,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 23334.865791000993,
      "inferenceMs": 23304.369999999835,
      "pagesPerSecond": 0.04291040693226236,
      "tokensPerSecond": 14.074613473782055,
      "neuralInferencePerformed": true,
      "outputTokens": 328,
      "maxNewTokens": 1024,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        23304.369999999835
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 22920691712,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6484525056,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 23345.21237500121,
      "totalMs": 24064.096250001967,
      "postUseRssBytes": 1251082240,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 718.8838750007562,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 16639.73791599892,
      "inferenceMs": 16602.01804100143,
      "pagesPerSecond": 0.06023364132783946,
      "tokensPerSecond": 3.0116820663919732,
      "neuralInferencePerformed": true,
      "outputTokens": 50,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        16602.01804100143
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44515115008,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6484525056,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 16643.608207999932,
      "totalMs": 17362.49208300069,
      "postUseRssBytes": 1327005696,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "pageOrder": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 718.8838750007562,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 31611.04841699853,
      "inferenceMs": 31545.492748999095,
      "pagesPerSecond": 0.06340049958685327,
      "tokensPerSecond": 2.2190174855398643,
      "neuralInferencePerformed": true,
      "outputTokens": 70,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "application/pdf",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        16374.884916000155,
        15170.60783299894
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44515115008,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6484525056,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 31614.970583001195,
      "totalMs": 32333.85445800195,
      "postUseRssBytes": 1338900480,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 718.8838750007562,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3632.0557079998252,
      "inferenceMs": 3619.574415999523,
      "pagesPerSecond": 0.2762755741613496,
      "tokensPerSecond": 16.576534449680977,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3619.574415999523
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 45469319168,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6484525056,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 3635.121249999429,
      "totalMs": 4354.005125000185,
      "postUseRssBytes": 1341816832,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 718.8838750007562,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3665.6631250007194,
      "inferenceMs": 3652.5201660006132,
      "pagesPerSecond": 0.2737835671130507,
      "tokensPerSecond": 16.42701402678304,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3652.5201660006132
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6484525056,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 3668.856958000106,
      "totalMs": 4387.740833000862,
      "postUseRssBytes": 1344651264,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 718.8838750007562,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3665.638542001034,
      "inferenceMs": 3652.3159590014984,
      "pagesPerSecond": 0.2737988748030958,
      "tokensPerSecond": 16.427932488185746,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3652.3159590014984
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6484525056,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 3669.025707999026,
      "totalMs": 4387.909582999782,
      "postUseRssBytes": 1347256320,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 718.8838750007562,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3632.957833000546,
      "inferenceMs": 3619.5533339996473,
      "pagesPerSecond": 0.2762771833216749,
      "tokensPerSecond": 16.57663099930049,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3619.5533339996473
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6484525056,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 3636.186458999873,
      "totalMs": 4355.070334000629,
      "postUseRssBytes": 1349926912,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 718.8838750007562,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3638.704040999073,
      "inferenceMs": 3625.3255420015194,
      "pagesPerSecond": 0.2758372974825059,
      "tokensPerSecond": 16.550237848950353,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3625.3255420015194
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6484525056,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 3642.033457999787,
      "totalMs": 4360.917333000543,
      "postUseRssBytes": 1352515584,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 718.8838750007562,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3619.199333999859,
      "inferenceMs": 3606.222500000513,
      "pagesPerSecond": 0.27729847506632155,
      "tokensPerSecond": 16.637908503979293,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3606.222500000513
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6484525056,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 3622.1651249998104,
      "totalMs": 4341.049000000567,
      "postUseRssBytes": 1355120640,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 718.8838750007562,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3631.477917000666,
      "inferenceMs": 3618.1695830000535,
      "pagesPerSecond": 0.2763828441592383,
      "tokensPerSecond": 16.582970649554298,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3618.1695830000535
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6484525056,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 3634.5310420001624,
      "totalMs": 4353.414917000919,
      "postUseRssBytes": 1357791232,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 718.8838750007562,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3666.5827079996234,
      "inferenceMs": 3652.6581660000375,
      "pagesPerSecond": 0.27377322337695853,
      "tokensPerSecond": 16.426393402617514,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3652.6581660000375
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6484525056,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 3670.0572919999104,
      "totalMs": 4388.941167000667,
      "postUseRssBytes": 1360396288,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 718.8838750007562,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3660.150917001374,
      "inferenceMs": 3647.049707999031,
      "pagesPerSecond": 0.27419423371354434,
      "tokensPerSecond": 16.45165402281266,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3647.049707999031
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6484525056,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 3663.645540998914,
      "totalMs": 4382.52941599967,
      "postUseRssBytes": 1362968576,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 718.8838750007562,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3639.9710419991607,
      "inferenceMs": 3626.0066670001834,
      "pagesPerSecond": 0.2757854829945213,
      "tokensPerSecond": 16.547128979671278,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3626.0066670001834
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6484525056,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 3643.065333000777,
      "totalMs": 4361.949208001533,
      "postUseRssBytes": 1365540864,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 718.8838750007562,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3657.508041998881,
      "inferenceMs": 3644.7184169992397,
      "pagesPerSecond": 0.2743696180577147,
      "tokensPerSecond": 16.462177083462883,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3644.7184169992397
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6484525056,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 3660.5613339997944,
      "totalMs": 4379.445209000551,
      "postUseRssBytes": 1368096768,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 718.8838750007562,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3648.0417080001644,
      "inferenceMs": 3634.7417090000818,
      "pagesPerSecond": 0.2751227129905471,
      "tokensPerSecond": 16.507362779432825,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3634.7417090000818
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6484525056,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 3651.560458998574,
      "totalMs": 4370.44433399933,
      "postUseRssBytes": 1370685440,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 718.8838750007562,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3642.684458000076,
      "inferenceMs": 3629.317709001043,
      "pagesPerSecond": 0.2755338827239918,
      "tokensPerSecond": 16.53203296343951,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3629.317709001043
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6484525056,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 3646.150624999791,
      "totalMs": 4365.034500000547,
      "postUseRssBytes": 1373290496,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 718.8838750007562,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3667.198291999739,
      "inferenceMs": 3653.1956250000803,
      "pagesPerSecond": 0.2737329457959093,
      "tokensPerSecond": 16.42397674775456,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3653.1956250000803
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6484525056,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 3670.396957999401,
      "totalMs": 4389.280833000157,
      "postUseRssBytes": 1375830016,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 718.8838750007562,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3659.6662500014645,
      "inferenceMs": 3645.3424579995044,
      "pagesPerSecond": 0.27432264911230897,
      "tokensPerSecond": 16.45935894673854,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3645.3424579995044
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6484525056,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 3663.151500000822,
      "totalMs": 4382.035375001578,
      "postUseRssBytes": 1378402304,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "pageOrder": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 718.8838750007562,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 30564.35316600073,
      "inferenceMs": 30496.98779100072,
      "pagesPerSecond": 0.06558024725937606,
      "tokensPerSecond": 2.2953086540781618,
      "neuralInferencePerformed": true,
      "outputTokens": 70,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "application/pdf",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        16414.448999999877,
        14082.538791000843
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44515115008,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6484525056,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 30569.059416999153,
      "totalMs": 31287.94329199991,
      "postUseRssBytes": 1381138432,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 0.8333333333333334,
      "textQuality": true,
      "imageBoxIoU": 0.8287878429327068,
      "bboxQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 718.8838750007562,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 21505.046833999586,
      "inferenceMs": 21476.520166999762,
      "pagesPerSecond": 0.04656247810278747,
      "tokensPerSecond": 15.27249281771429,
      "neuralInferencePerformed": true,
      "outputTokens": 328,
      "maxNewTokens": 1024,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        21476.520166999762
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44355731456,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "visualizationMs": 8.743958000195562,
      "peakResidentMemoryBytes": 6484525056,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 21523.79470899905,
      "totalMs": 22242.678583999805,
      "postUseRssBytes": 1393623040,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 736.4051250006014,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3630.977124999845,
      "inferenceMs": 3594.7811659989384,
      "pagesPerSecond": 0.27818105020089984,
      "tokensPerSecond": 16.690863012053992,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3594.7811659989384
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 8775548928,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6488735744,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 3634.2823750001116,
      "totalMs": 4370.687500000713,
      "postUseRssBytes": 1164918784,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 777.5213750010153,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3656.2467500007187,
      "inferenceMs": 3622.082750000118,
      "pagesPerSecond": 0.2760842501458498,
      "tokensPerSecond": 16.56505500875099,
      "neuralInferencePerformed": true,
      "outputTokens": 60,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3622.082750000118
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 8775548928,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6486441984,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "e16ab911c8eda8035fd6b96172316dfa09e4c491",
      "fallback": false,
      "requestWallMs": 3659.1801250015124,
      "totalMs": 4436.701500002528,
      "postUseRssBytes": 1161904128,
      "grade": "fast"
    }
  }
]

LightOnOCR-2 1B OCR Soup Desktop

34 configurations tested
Passed34
Failed0
TestedNov 8, 2026
Runtimetransformers 5.22.1

Quality criteria

Frozen four-fixture paragraphCER/token recall, caption/receipt phrases, ordered PDF pages, EOS/non-repetition/resource/speed and bboxIoU where applicable; narrow English/cropped-page scope.

PrecisionDeviceResultPlatformInference / load
FP32mpsAcceleratedPassedFastmacos · aarch643787 ms / 688 ms
FP32mpsAcceleratedPassedFastmacos · aarch643794 ms / 688 ms
FP32mpsAcceleratedPassedFastmacos · aarch643806 ms / 688 ms
FP32mpsAcceleratedPassedFastmacos · aarch643808 ms / 688 ms
FP32mpsAcceleratedPassedFastmacos · aarch643812 ms / 688 ms
FP32mpsAcceleratedPassedFastmacos · aarch643812 ms / 688 ms
FP32mpsAcceleratedPassedFastmacos · aarch643815 ms / 688 ms
FP32mpsAcceleratedPassedFastmacos · aarch643824 ms / 688 ms
FP32mpsAcceleratedPassedFastmacos · aarch643825 ms / 688 ms
FP32mpsAcceleratedPassedFastmacos · aarch643827 ms / 688 ms
FP32mpsAcceleratedPassedFastmacos · aarch643827 ms / 688 ms
FP32mpsAcceleratedPassedFastmacos · aarch643828 ms / 688 ms
FP32mpsAcceleratedPassedFastmacos · aarch643839 ms / 688 ms
FP32mpsAcceleratedPassedFastmacos · aarch643845 ms / 688 ms
FP32mpsAcceleratedPassedFastmacos · aarch643846 ms / 688 ms
FP32mpsAcceleratedPassedFastmacos · aarch644006 ms / 688 ms
FP32mpsAcceleratedPassedFastmacos · aarch644008 ms / 653 ms
FP32mpsAcceleratedPassedFastmacos · aarch644012 ms / 647 ms
FP32mpsAcceleratedPassedNot measuredmacos · aarch6422831 ms / 688 ms
FP32mpsAcceleratedPassedNot measuredmacos · aarch6416810 ms / 688 ms
FP32mpsAcceleratedPassedNot measuredmacos · aarch6432006 ms / 688 ms
FP32mpsAcceleratedPassedNot measuredmacos · aarch6431930 ms / 688 ms
FP32cpuPassedFastmacos · aarch647322 ms / 337 ms
FP32cpuPassedFastmacos · aarch647346 ms / 337 ms
FP32cpuPassedFastmacos · aarch647380 ms / 337 ms
FP32cpuPassedFastmacos · aarch647433 ms / 337 ms
FP32cpuPassedFastmacos · aarch647450 ms / 337 ms
FP32cpuPassedFastmacos · aarch647505 ms / 337 ms
FP32cpuPassedFastmacos · aarch647551 ms / 334 ms
FP32cpuPassedFastmacos · aarch647574 ms / 338 ms
FP32cpuPassedNot measuredmacos · aarch6435767 ms / 337 ms
FP32cpuPassedNot measuredmacos · aarch6423556 ms / 337 ms
FP32cpuPassedNot measuredmacos · aarch6446601 ms / 337 ms
FP32cpuPassedNot measuredmacos · aarch6446766 ms / 337 ms
Test setup & sample details
Quality gate
Frozen four-fixture paragraphCER/token recall, caption/receipt phrases, ordered PDF pages, EOS/non-repetition/resource/speed and bboxIoU where applicable; narrow English/cropped-page scope.
Tested
2026-11-08T10:12:39.038755+00:00
Environment
{ "hardware": "Apple M3 Max", "os": "macOS27.2/aarch64", "python": "3.13.18 app-owned private development venv", "runtime": "Transformers5.22.1/Torch2.10.0/Pillow12.0.0/PDFium5.14.0", "scope": "Exact immutable local snapshots; model-process loads exclude interpreter imports/network setup. totalMs is model-load component plus full helper request wall time, not warm IPC session elapsed time. Concurrent tracked transfers/background host activity recorded separately." }
Runtime
transformers 5.22.1
Artifact revision
45be956cc2af90a5f53459989bcdd09357013e9f
Fixture
{
  "file": "model-samples/desktop/lightonocr2/fixtures/scientific-paragraph.png",
  "url": "https://assets.localai.tools/samples/v1/files/de0959e7c3fe59f4d706bb84d993cd1aae000a6b25bcef96f472d3a675871dfb/scientific-paragraph.png",
  "size": 26674,
  "sha1": "b4e9dd3ea6464bc8e1ff1f95134eccfc25622d52",
  "sha256": "de0959e7c3fe59f4d706bb84d993cd1aae000a6b25bcef96f472d3a675871dfb"
}
Rerun when
artifact revision/weight change; pinned runtime/prediction/preprocessing change; fixture/checksum or quality-gate change; relevant host/backend behavior change
Per-case quality & failure details
[
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 337.1324170002481,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7534.840084001189,
      "inferenceMs": 7505.392250001023,
      "pagesPerSecond": 0.1332375399833185,
      "tokensPerSecond": 8.92691517888234,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7505.392250001023
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 6489210880,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 7537.708624999141,
      "totalMs": 7874.841041999389,
      "postUseRssBytes": 4783144960,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 0.8333333333333334,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 337.1324170002481,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 35791.57875000055,
      "inferenceMs": 35766.96749999974,
      "pagesPerSecond": 0.027958758315197042,
      "tokensPerSecond": 8.862926385917463,
      "neuralInferencePerformed": true,
      "outputTokens": 317,
      "maxNewTokens": 1024,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        35766.96749999974
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 6591086592,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 35800.37670799902,
      "totalMs": 36137.50912499927,
      "postUseRssBytes": 5783519232,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 337.1324170002481,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 23583.909707998828,
      "inferenceMs": 23556.174499999543,
      "pagesPerSecond": 0.042451714729826756,
      "tokensPerSecond": 2.1225857364913376,
      "neuralInferencePerformed": true,
      "outputTokens": 50,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        23556.174499999543
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7254753280,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 23586.859417000596,
      "totalMs": 23923.991834000844,
      "postUseRssBytes": 5498945536,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "pageOrder": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 337.1324170002481,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 46664.07458300091,
      "inferenceMs": 46600.6580000012,
      "pagesPerSecond": 0.04291784892822647,
      "tokensPerSecond": 1.738172881593172,
      "neuralInferencePerformed": true,
      "outputTokens": 81,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "application/pdf",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        24700.152500001423,
        21900.50549999978
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7254753280,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 46668.31770799945,
      "totalMs": 47005.4501249997,
      "postUseRssBytes": 5312790528,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 337.1324170002481,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7461.339416999181,
      "inferenceMs": 7450.469625000551,
      "pagesPerSecond": 0.134219727122225,
      "tokensPerSecond": 8.992721717189076,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7450.469625000551
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7254753280,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 7464.27520799989,
      "totalMs": 7801.407625000138,
      "postUseRssBytes": 4800086016,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 337.1324170002481,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7355.7545420007955,
      "inferenceMs": 7346.292124999309,
      "pagesPerSecond": 0.13612309216468765,
      "tokensPerSecond": 9.120247175034073,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7346.292124999309
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7254753280,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 7358.554582999204,
      "totalMs": 7695.686999999452,
      "postUseRssBytes": 4803084288,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 337.1324170002481,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7389.680416999909,
      "inferenceMs": 7380.1732909996645,
      "pagesPerSecond": 0.13549817335854825,
      "tokensPerSecond": 9.078377615022731,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7380.1732909996645
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7254753280,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 7392.419083000277,
      "totalMs": 7729.551500000525,
      "postUseRssBytes": 4803051520,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 337.1324170002481,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7442.183125000156,
      "inferenceMs": 7432.629167000414,
      "pagesPerSecond": 0.13454189325626884,
      "tokensPerSecond": 9.014306848170012,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7432.629167000414
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7254753280,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 7445.084040999063,
      "totalMs": 7782.216457999311,
      "postUseRssBytes": 4803461120,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 337.1324170002481,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7332.017749999068,
      "inferenceMs": 7321.949791999941,
      "pagesPerSecond": 0.13657564288307647,
      "tokensPerSecond": 9.150568073166124,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7321.949791999941
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7254753280,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 7334.848459000568,
      "totalMs": 7671.980876000816,
      "postUseRssBytes": 4803428352,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "pageOrder": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 337.1324170002481,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 46821.83079199967,
      "inferenceMs": 46766.03333299863,
      "pagesPerSecond": 0.0427660816507347,
      "tokensPerSecond": 1.7320263068547552,
      "neuralInferencePerformed": true,
      "outputTokens": 81,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "application/pdf",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        24939.15420799931,
        21826.879124999323
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 7254753280,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 46826.022584000384,
      "totalMs": 47163.15500100063,
      "postUseRssBytes": 5275451392,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 333.58304200010025,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7580.5554170001415,
      "inferenceMs": 7550.823874998969,
      "pagesPerSecond": 0.1324358793894046,
      "tokensPerSecond": 8.873203919090107,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7550.823874998969
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 6485442560,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 7583.463000000847,
      "totalMs": 7917.046042000948,
      "postUseRssBytes": 4781457408,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 337.687499999447,
      "placement": {
        "cpu/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 7603.810832999443,
      "inferenceMs": 7573.609541999758,
      "pagesPerSecond": 0.13203743795537115,
      "tokensPerSecond": 8.846508343009868,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "cpu",
        "languageOutput": "cpu"
      },
      "pageInferenceMs": [
        7573.609541999758
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "peakResidentMemoryBytes": 6485917696,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 7606.688207999468,
      "totalMs": 7944.3757079989155,
      "postUseRssBytes": 4780097536,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 687.5410409993492,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 4035.9712919998856,
      "inferenceMs": 4005.81025000065,
      "pagesPerSecond": 0.24963738609432082,
      "tokensPerSecond": 16.725704868319493,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        4005.81025000065
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 8775548928,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485753856,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 4039.0998749990104,
      "totalMs": 4726.64091599836,
      "postUseRssBytes": 1162166272,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 0.8333333333333334,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 687.5410409993492,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 22861.19916699863,
      "inferenceMs": 22830.896125000436,
      "pagesPerSecond": 0.04380029563994965,
      "tokensPerSecond": 13.88469371786404,
      "neuralInferencePerformed": true,
      "outputTokens": 317,
      "maxNewTokens": 1024,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        22830.896125000436
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 22920691712,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485753856,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 22871.020583001155,
      "totalMs": 23558.561624000504,
      "postUseRssBytes": 1250852864,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 687.5410409993492,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 16839.634208999996,
      "inferenceMs": 16810.320749998937,
      "pagesPerSecond": 0.05948726469125006,
      "tokensPerSecond": 2.974363234562503,
      "neuralInferencePerformed": true,
      "outputTokens": 50,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        16810.320749998937
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44515115008,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485753856,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 16843.405708999853,
      "totalMs": 17530.946749999202,
      "postUseRssBytes": 1326792704,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "pageOrder": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 687.5410409993492,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 32077.086208000765,
      "inferenceMs": 32006.021084000167,
      "pagesPerSecond": 0.06248824228263104,
      "tokensPerSecond": 2.5307738124465575,
      "neuralInferencePerformed": true,
      "outputTokens": 81,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "application/pdf",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        16701.6584590001,
        15304.362625000067
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44515115008,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485753856,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 32083.17916699889,
      "totalMs": 32770.72020799824,
      "postUseRssBytes": 1332396032,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 687.5410409993492,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3840.986625000369,
      "inferenceMs": 3828.1761669986736,
      "pagesPerSecond": 0.2612209982969539,
      "tokensPerSecond": 17.50180688589591,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3828.1761669986736
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 45469319168,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485753856,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 3844.1610419995413,
      "totalMs": 4531.702082998891,
      "postUseRssBytes": 1335803904,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 687.5410409993492,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3859.224792000532,
      "inferenceMs": 3845.4144580009597,
      "pagesPerSecond": 0.26004999224969116,
      "tokensPerSecond": 17.42334948072931,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3845.4144580009597
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485753856,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 3862.6048330006597,
      "totalMs": 4550.145874000009,
      "postUseRssBytes": 1338851328,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 687.5410409993492,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3851.774374999877,
      "inferenceMs": 3838.54699999938,
      "pagesPerSecond": 0.2605152418350385,
      "tokensPerSecond": 17.45452120294758,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3838.54699999938
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485753856,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 3855.152124999222,
      "totalMs": 4542.693165998571,
      "postUseRssBytes": 1341718528,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 687.5410409993492,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3859.5905839993065,
      "inferenceMs": 3846.108292000281,
      "pagesPerSecond": 0.2600030794972548,
      "tokensPerSecond": 17.420206326316073,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3846.108292000281
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485753856,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 3863.013833999503,
      "totalMs": 4550.554874998852,
      "postUseRssBytes": 1344569344,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 687.5410409993492,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3840.5725410011655,
      "inferenceMs": 3826.6454999993584,
      "pagesPerSecond": 0.26132548729694655,
      "tokensPerSecond": 17.50880764889542,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3826.6454999993584
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485753856,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 3844.0431670005637,
      "totalMs": 4531.584207999913,
      "postUseRssBytes": 1347452928,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 687.5410409993492,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3819.188082999972,
      "inferenceMs": 3805.6824579998647,
      "pagesPerSecond": 0.26276496030243296,
      "tokensPerSecond": 17.60525234026301,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3805.6824579998647
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485753856,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 3822.3960000013903,
      "totalMs": 4509.93704100074,
      "postUseRssBytes": 1350402048,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 687.5410409993492,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3825.249250001434,
      "inferenceMs": 3811.5957500012883,
      "pagesPerSecond": 0.26235730795944506,
      "tokensPerSecond": 17.57793963328282,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3811.5957500012883
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485753856,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 3828.2579589995294,
      "totalMs": 4515.798999998879,
      "postUseRssBytes": 1356152832,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 687.5410409993492,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3839.1770420003013,
      "inferenceMs": 3825.3583339992474,
      "pagesPerSecond": 0.2614134187409688,
      "tokensPerSecond": 17.514699055644908,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3825.3583339992474
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485753856,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 3842.66687499985,
      "totalMs": 4530.207915999199,
      "postUseRssBytes": 1359036416,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 687.5410409993492,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3829.031125000256,
      "inferenceMs": 3815.3409999995347,
      "pagesPerSecond": 0.2620997703744231,
      "tokensPerSecond": 17.560684615086352,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3815.3409999995347
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485753856,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 3832.433833998948,
      "totalMs": 4519.974874998297,
      "postUseRssBytes": 1361936384,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 687.5410409993492,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3837.5418329997046,
      "inferenceMs": 3823.6586669991084,
      "pagesPerSecond": 0.26152962047337297,
      "tokensPerSecond": 17.52248457171599,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3823.6586669991084
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485753856,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 3840.8897909994266,
      "totalMs": 4528.430831998776,
      "postUseRssBytes": 1364738048,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 687.5410409993492,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3800.5776249992778,
      "inferenceMs": 3787.202792000244,
      "pagesPerSecond": 0.2640471226183907,
      "tokensPerSecond": 17.691157215432177,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3787.202792000244
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485753856,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 3803.7424169997394,
      "totalMs": 4491.283457999089,
      "postUseRssBytes": 1367605248,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 687.5410409993492,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3824.968707998778,
      "inferenceMs": 3812.434082999971,
      "pagesPerSecond": 0.262299617050194,
      "tokensPerSecond": 17.574074342362998,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3812.434082999971
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485753856,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 3827.882374998808,
      "totalMs": 4515.423415998157,
      "postUseRssBytes": 1370472448,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 687.5410409993492,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3806.5388329996495,
      "inferenceMs": 3793.589124999926,
      "pagesPerSecond": 0.2636026114188156,
      "tokensPerSecond": 17.66137496506064,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3793.589124999926
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485753856,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 3809.5649999995658,
      "totalMs": 4497.106040998915,
      "postUseRssBytes": 1373323264,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 687.5410409993492,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3821.8630840001424,
      "inferenceMs": 3808.1038750005973,
      "pagesPerSecond": 0.2625978788458976,
      "tokensPerSecond": 17.594057882675138,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3808.1038750005973
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485753856,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 3825.0633330007986,
      "totalMs": 4512.604374000148,
      "postUseRssBytes": 1376223232,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 687.5410409993492,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 3839.6251249996567,
      "inferenceMs": 3827.2442079996836,
      "pagesPerSecond": 0.2612846073187088,
      "tokensPerSecond": 17.50606869035349,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        3827.2442079996836
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44976488448,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485753856,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 3842.689207998774,
      "totalMs": 4530.230248998123,
      "postUseRssBytes": 1379057664,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "phraseRecall": 1,
      "textQuality": true,
      "pageOrder": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 687.5410409993492,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 31996.180916999947,
      "inferenceMs": 31930.438749999666,
      "pagesPerSecond": 0.06263615779473186,
      "tokensPerSecond": 2.5367643906866406,
      "neuralInferencePerformed": true,
      "outputTokens": 81,
      "maxNewTokens": 512,
      "pdfScale": 1.5,
      "inputKind": "application/pdf",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        16708.269499999005,
        15222.169250000661
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 44515115008,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485753856,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 32000.63083399982,
      "totalMs": 32688.17187499917,
      "postUseRssBytes": 1385594880,
      "grade": "interactive"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 652.7070840002125,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 4038.6603330007347,
      "inferenceMs": 4008.0020829991554,
      "pagesPerSecond": 0.2495008683358039,
      "tokensPerSecond": 16.71655817849886,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        4008.0020829991554
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 8775548928,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6486130688,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 4041.9522499996674,
      "totalMs": 4694.65933399988,
      "postUseRssBytes": 1162526720,
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "pageCount": true,
      "complete": true,
      "actualNeuralPlacement": true,
      "withinSpeedBudget": true,
      "withinMemoryBudget": true,
      "nonRepetitive": true,
      "tokenRecall": 0.95,
      "characterErrorRate": 0.006968641114982578,
      "textQuality": true,
      "passed": true
    },
    "runtime": {
      "engine": "transformers",
      "version": "5.22.1",
      "torchVersion": "2.10.0",
      "pythonVersion": "3.13.18",
      "resolvedModelClass": "LightOnOcrForConditionalGeneration",
      "originalConfigModelType": "mistral3",
      "checkpointLoading": {
        "missing_keys": [],
        "unexpected_keys": [],
        "mismatched_keys": []
      },
      "pdfiumVersion": "5.14.0",
      "loadMs": 647.3277079985564,
      "placement": {
        "mps:0/torch.float32": 532
      },
      "parameterDtype": "torch.float32",
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "attentionImplementation": "sdpa",
      "accelerationDetails": "Vision/language parameters, inputs and vision activations on selected device; rendering, tokenizer and decoding on CPU",
      "durationMs": 4043.4326249996957,
      "inferenceMs": 4011.8473330003326,
      "pagesPerSecond": 0.2492617283250736,
      "tokensPerSecond": 16.70053579777993,
      "neuralInferencePerformed": true,
      "outputTokens": 67,
      "maxNewTokens": 256,
      "pdfScale": 1.5,
      "inputKind": "image",
      "activationPlacement": {
        "visionOutput": "mps:0",
        "languageOutput": "mps:0"
      },
      "pageInferenceMs": [
        4011.8473330003326
      ],
      "decoding": "greedy",
      "outputLimitReached": false,
      "allPagesReachedEos": true,
      "driverAllocatedMemoryBytes": 8775548928,
      "memoryMeasurementScope": "Process lifetime peakRSS through complete output construction; not a validated minimum.",
      "peakResidentMemoryBytes": 6485868544,
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "45be956cc2af90a5f53459989bcdd09357013e9f",
      "fallback": false,
      "requestWallMs": 4046.651833999931,
      "totalMs": 4693.979541998488,
      "postUseRssBytes": 1161297920,
      "grade": "fast"
    }
  }
]

Something not quite right?

Tell us what happened with LightOnOCR 2 Desktop. Loading, results, or the page itself—we’re here for all of it.

Attachments Optional

Up to 3 files · 50 MB each

Browser, OS, CPU/GPU, memory, screen, storage, and network details are included automatically. Model inputs, results, and browsing history are not collected.