A model is still running

A model is still running or downloading. Leaving will stop the current operation. Stay on this page to let it finish.

Skip to content
LocalAI.toolsBeta

Join the waitlist

Get an email when the new apps and model runs launch.

No account needed.

LFM2-VL 450M — Text & Image Chat

Ask text questions or ask about an image with Liquid AI LFM2-VL450M. Returns local text replies; small-model recognition, reasoning and factual accuracy need review.

Browser inferencePowered by WebAI · Private · Unlimited runs
About this model

Ask text questions or ask about an image with Liquid AI LFM2-VL450M. Returns local text replies; small-model recognition, reasoning and factual accuracy need review.

Created by
Liquid AI
Model released
Unknown
Source repository created
Aug 12, 2025
Model weights · Q4F16
316.7 MB

Best for

  • Draft image descriptions and answer simple visual questions.
  • Prototype local image-and-text assistance.

Keep in mind

  • May hallucinate objects, text, numbers or relationships; review responses against the image.
  • Small text, low-quality images and complex reasoning can reduce accuracy.
  • English-centric model; other languages are not validated by this fixture.
  • One image and one question per request; no video or multi-turn chat adapter.
  • Do not use as the sole basis for medical, identity, safety-critical or consequential decisions.
  • Weights use the custom LFM Open License v1.0; review its commercial and redistribution terms.

Processed on your deviceInference runs in this browser. Input/output sharing requires consent for each run. Basic run logs include device information and approximate connection location. Model and runtime files download from external hosts. Saved downloads may be cleared by your browser.

Sources & technical details
Original model
LiquidAI/LFM2-VL-450M
Release verification
Unknown
Release evidence
Exact original checkpoint public release date has not been verified. Repository creation, training, paper, artifact conversion and update dates are not release evidence.
Source updated
Jun 29, 2026
Browser model files
onnx-community/LFM2-VL-450M-ONNX
Files updated
Mar 12, 2026
Artifact revision
308cf784b35ce25274540e1bf5592c33a0433469

Input

IMAGE

Sample result

LFM2-VL 450M — Text & Image Chat

Settings

Maximum generated tokens; longer pages may need more tokens and memory. Lower values can truncate captions or document text. Higher values allow longer output at greater time and memory cost.

Output

Your result will appear here

Add input or try the sample, then run the model.

Benchmark evidence

Saved worker evidence is separate from benchmarks run on your device. It does not guarantee speed or quality on every browser.

LFM2-VL 450M — Text & Image Chat

18 configurations tested
Passed10
Failed8
TestedOct 31, 2026
RuntimeTransformers.js 4.2.0

Quality criteria

Nonempty, non-repetitive caption with at least five words and a person label matching the independently specified portrait reference.

PrecisionDeviceResult
Q4F16GPU · WebGPUAcceleratedPassedVery fast
Q4GPU · WebGPUAcceleratedPassedVery fast
Q4F16GPU · WebGPUAcceleratedPassedModerate
Q4F16GPU · WebGPUAcceleratedPassedModerate
Q4GPU · WebGPUAcceleratedPassedModerate
Q4GPU · WebGPUAcceleratedPassedModerate
Q4GPU · WebGPUAcceleratedPassedModerate
Q4F16GPU · WebGPUAcceleratedPassedSlow
Q4F16GPU · WebGPUAcceleratedPassedSlow
Q4GPU · WebGPUAcceleratedPassedVery slow
Q4CPU · WASMFailed—
Q4F16CPU · WASMFailed—
Q8GPU · WebGPUFailed—
Q8CPU · WASMFailed—
FP16GPU · WebGPUFailed—
FP16CPU · WASMFailed—
FP32GPU · WebGPUFailed—
FP32CPU · WASMFailed—
Test setup & sample details
Quality gate
Nonempty, non-repetitive caption with at least five words and a person label matching the independently specified portrait reference.
Tested
2026-10-31T18:06:16.798Z
Environment
Isolated Chrome 156.0.8078.79 module worker per case on macOS arm64; Transformers.js 4.2.0; cold model cache
Runtime
Transformers.js 4.2.0
Artifact revision
308cf784b35ce25274540e1bf5592c33a0433469
Fixture
{
  "file": "model-samples/lfm2-vl-450m.json",
  "url": "https://f005.backblazeb2.com/file/hubters-webai-public/assets/benchmarks/lfm2-vl-450m.json",
  "size": 417,
  "sha1": "2c1a441093498eea1887511f171471d1bfc608a3"
}
Rerun when
artifact revision change; runtime version change; fixture or quality-gate change; browser/backend behavior change
Per-case quality & failure details
[
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "nonempty": true,
      "person": true,
      "repetitive": false,
      "referenceLabelRecall": 1,
      "passed": true
    },
    "runtime": {
      "loadMs": 51274.90000000596,
      "inferenceMs": 5750.800000011921,
      "totalMs": 58365.40000000596,
      "grade": "slow",
      "imagesPerSecond": 0.1738888502465617
    }
  },
  {
    "precision": "q4",
    "device": "wasm",
    "status": "fail",
    "quality": "Not embedded",
    "runtime": {
      "loadMs": null,
      "inferenceMs": null,
      "totalMs": 25943.09999999404,
      "grade": "failed"
    },
    "failure": "Can't create a session. ERROR_CODE: 9, ERROR_MESSAGE: Could not find an implementation for GatherBlockQuantized(1) node with name '/model/embed_tokens/Gather_Quant'"
  },
  {
    "precision": "q4f16",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "nonempty": true,
      "person": true,
      "repetitive": false,
      "referenceLabelRecall": 1,
      "passed": true
    },
    "runtime": {
      "loadMs": 45174.70000001788,
      "inferenceMs": 4149,
      "totalMs": 50679.19999998808,
      "grade": "good",
      "imagesPerSecond": 0.24102193299590263
    }
  },
  {
    "precision": "q4f16",
    "device": "wasm",
    "status": "fail",
    "quality": "Not embedded",
    "runtime": {
      "loadMs": null,
      "inferenceMs": null,
      "totalMs": 23055.30000001192,
      "grade": "failed"
    },
    "failure": "Can't create a session. ERROR_CODE: 9, ERROR_MESSAGE: Failed to find kernel for com.microsoft.GatherBlockQuantized(1) (node:'/model/embed_tokens/Gather_Quant' ep:'CPUExecutionProvider'). Kernel not found"
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "fail",
    "quality": {
      "nonempty": true,
      "person": false,
      "repetitive": false,
      "referenceLabelRecall": 0,
      "passed": false
    },
    "runtime": {
      "loadMs": 72033.90000000596,
      "inferenceMs": 4667.5,
      "totalMs": 78078.10000002384,
      "grade": "good",
      "imagesPerSecond": 0.21424745581146223
    },
    "failure": "Caption quality gate failed"
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "fail",
    "quality": "Not embedded",
    "runtime": {
      "loadMs": null,
      "inferenceMs": null,
      "totalMs": 38305.30000001192,
      "grade": "failed"
    },
    "failure": "Can't create a session. ERROR_CODE: 9, ERROR_MESSAGE: Could not find an implementation for GatherBlockQuantized(1) node with name '/model/embed_tokens/Gather_Quant'"
  },
  {
    "precision": "fp16",
    "device": "webgpu",
    "status": "fail",
    "quality": {
      "nonempty": true,
      "person": false,
      "repetitive": false,
      "referenceLabelRecall": 0,
      "passed": false
    },
    "runtime": {
      "loadMs": 357256.90000000596,
      "inferenceMs": 3265.9000000059605,
      "totalMs": 361915.5,
      "grade": "good",
      "imagesPerSecond": 0.30619431090914445
    },
    "failure": "Caption quality gate failed"
  },
  {
    "precision": "fp16",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "nonempty": true,
      "person": false,
      "repetitive": false,
      "referenceLabelRecall": 0,
      "passed": false
    },
    "runtime": {
      "loadMs": 5706.700000017881,
      "inferenceMs": 63730.5,
      "totalMs": 71155.09999999404,
      "grade": "very-slow",
      "imagesPerSecond": 0.01569107413247974
    },
    "failure": "Caption quality gate failed"
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "fail",
    "quality": {
      "nonempty": true,
      "person": false,
      "repetitive": false,
      "referenceLabelRecall": 0,
      "passed": false
    },
    "runtime": {
      "loadMs": 2779,
      "inferenceMs": 4625.4000000059605,
      "totalMs": 8756.699999988079,
      "grade": "good",
      "imagesPerSecond": 0.21619751805221415
    },
    "failure": "Caption quality gate failed"
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "nonempty": true,
      "person": false,
      "repetitive": false,
      "referenceLabelRecall": 0,
      "passed": false
    },
    "runtime": {
      "loadMs": 3455.7000000178814,
      "inferenceMs": 62562.40000000596,
      "totalMs": 67572.09999999404,
      "grade": "very-slow",
      "imagesPerSecond": 0.015984041532931998
    },
    "failure": "Caption quality gate failed"
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "scope": "Fixed authored/retained fixture; not broad task-quality certification."
    },
    "runtime": {
      "loadMs": 12807.475000023842,
      "inferenceMs": 1263.2950000166893,
      "totalMs": 14070.770000040531,
      "wallMs": 1263.5149999856949,
      "charactersPerSecond": 3.166322988650439,
      "version": "4.2.0",
      "artifactRevision": "308cf784b35ce25274540e1bf5592c33a0433469",
      "grade": "slow",
      "totalTimingMethod": "Sum of measured initialization and this inference; excludes preceding fixture calls.",
      "imagesPerSecond": 0.7915807471626097
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "scope": "Fixed authored/retained fixture; not broad task-quality certification."
    },
    "runtime": {
      "loadMs": 12807.475000023842,
      "inferenceMs": 886.0600000023842,
      "totalMs": 13693.535000026226,
      "wallMs": 886.1299999952316,
      "charactersPerSecond": 14.671692661857008,
      "version": "4.2.0",
      "artifactRevision": "308cf784b35ce25274540e1bf5592c33a0433469",
      "grade": "good",
      "totalTimingMethod": "Sum of measured initialization and this inference; excludes preceding fixture calls.",
      "imagesPerSecond": 1.1285917432197698
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "scope": "Fixed authored/retained fixture; not broad task-quality certification."
    },
    "runtime": {
      "loadMs": 12807.475000023842,
      "inferenceMs": 999.2749999761581,
      "totalMs": 13806.75,
      "wallMs": 999.3400000333786,
      "charactersPerSecond": 1.000725526030231,
      "version": "4.2.0",
      "artifactRevision": "308cf784b35ce25274540e1bf5592c33a0433469",
      "grade": "slow",
      "totalTimingMethod": "Sum of measured initialization and this inference; excludes preceding fixture calls.",
      "imagesPerSecond": 1.000725526030231
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "scope": "Fixed authored/retained fixture; not broad task-quality certification."
    },
    "runtime": {
      "loadMs": 12807.475000023842,
      "inferenceMs": 83.9549999833107,
      "totalMs": 12891.430000007153,
      "wallMs": 84.06999999284744,
      "charactersPerSecond": 59.55571438263288,
      "version": "4.2.0",
      "artifactRevision": "308cf784b35ce25274540e1bf5592c33a0433469",
      "grade": "fast",
      "totalTimingMethod": "Sum of measured initialization and this inference; excludes preceding fixture calls."
    }
  },
  {
    "precision": "q4f16",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "scope": "Fixed authored/retained fixture; not broad task-quality certification."
    },
    "runtime": {
      "loadMs": 13256.759999990463,
      "inferenceMs": 2540.3799999952316,
      "totalMs": 15797.139999985695,
      "wallMs": 2540.564999997616,
      "charactersPerSecond": 1.574567584380096,
      "version": "4.2.0",
      "artifactRevision": "308cf784b35ce25274540e1bf5592c33a0433469",
      "grade": "slow",
      "totalTimingMethod": "Sum of measured initialization and this inference; excludes preceding fixture calls.",
      "imagesPerSecond": 0.393641896095024
    }
  },
  {
    "precision": "q4f16",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "scope": "Fixed authored/retained fixture; not broad task-quality certification."
    },
    "runtime": {
      "loadMs": 13256.759999990463,
      "inferenceMs": 757.9150000214577,
      "totalMs": 14014.675000011921,
      "wallMs": 757.9850000143051,
      "charactersPerSecond": 17.152319190980457,
      "version": "4.2.0",
      "artifactRevision": "308cf784b35ce25274540e1bf5592c33a0433469",
      "grade": "good",
      "totalTimingMethod": "Sum of measured initialization and this inference; excludes preceding fixture calls.",
      "imagesPerSecond": 1.319409168536958
    }
  },
  {
    "precision": "q4f16",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "scope": "Fixed authored/retained fixture; not broad task-quality certification."
    },
    "runtime": {
      "loadMs": 13256.759999990463,
      "inferenceMs": 531.5099999904633,
      "totalMs": 13788.269999980927,
      "wallMs": 531.5749999880791,
      "charactersPerSecond": 1.8814321461834074,
      "version": "4.2.0",
      "artifactRevision": "308cf784b35ce25274540e1bf5592c33a0433469",
      "grade": "slow",
      "totalTimingMethod": "Sum of measured initialization and this inference; excludes preceding fixture calls.",
      "imagesPerSecond": 1.8814321461834072
    }
  },
  {
    "precision": "q4f16",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "scope": "Fixed authored/retained fixture; not broad task-quality certification."
    },
    "runtime": {
      "loadMs": 13256.759999990463,
      "inferenceMs": 31.514999985694885,
      "totalMs": 13288.274999976158,
      "wallMs": 31.584999978542328,
      "charactersPerSecond": 158.65460898840462,
      "version": "4.2.0",
      "artifactRevision": "308cf784b35ce25274540e1bf5592c33a0433469",
      "grade": "fast",
      "totalTimingMethod": "Sum of measured initialization and this inference; excludes preceding fixture calls."
    }
  }
]

LFM2-VL 1.6B — Text & Image Chat

14 configurations tested
Passed12
Failed2
TestedNov 11, 2026
RuntimeTransformers.js 4.2.0

Quality criteria

{ "allCasesRequired": true, "maximumInferenceMs": 60000, "gibberishRejected": true, "streamingParityRequired": true, "malformedInputRejected": true, "scoreMetric": "Exact/accepted answer match;real photo labels plus isolated OCR/count and text context;not broad task-quality certification.", "speedGradePolicy": { "textCharactersPerSecond": { "fast": 20, "good": 5, "slow": 1 }, "imageInferenceMs": { "excellent": 1000, "good": 5000, "slow": 15000 }, "note": "Descriptive grades derived from actual timings;frozen60s acceptance gate unchanged." }, "prototypeEvidence": [ { "file": "research/lfm2-vl-variants/1.6b-fp16-matrix.json", "sha256": "c8945f63b26b425fdfe8eb00ad6a10451ddbdea7e6c3963fe2ecbb8e6e3e59bf", "worker": { "file": "research/lfm2-vl-variants/probe-b905deef2ecd6a58ffd927e258ac103905d001aac482b0eaf4ca513b0e2e1e70.worker.js", "sha256": "b905deef2ecd6a58ffd927e258ac103905d001aac482b0eaf4ca513b0e2e1e70" } }, { "file": "research/lfm2-vl-variants/1.6b-fp32-matrix.json", "sha256": "5a16ed04364c1072f92ad656a52a2acf627b24abdba173f4dafe21638ba0267b", "worker": { "file": "research/lfm2-vl-variants/probe.worker.js", "sha256": "c44313ae06768ccb4cd679151c2d5aee09a47c886f759629b3ca629ab7e910ce" } } ] }

PrecisionDeviceResult
FP16GPU · WebGPUAcceleratedPassedFast
FP32GPU · WebGPUAcceleratedPassedFast
FP16GPU · WebGPUAcceleratedPassedFast
FP32GPU · WebGPUAcceleratedPassedFast
FP16GPU · WebGPUAcceleratedPassedModerate
FP16GPU · WebGPUAcceleratedPassedModerate
FP16GPU · WebGPUAcceleratedPassedModerate
FP32GPU · WebGPUAcceleratedPassedSlow
FP32GPU · WebGPUAcceleratedPassedSlow
FP32GPU · WebGPUAcceleratedPassedSlow
FP16GPU · WebGPUAcceleratedPassedVery slow
FP32GPU · WebGPUAcceleratedPassedVery slow
FP16CPU · WASMFailed—
FP32CPU · WASMFailed—
Test setup & sample details
Quality gate
{ "allCasesRequired": true, "maximumInferenceMs": 60000, "gibberishRejected": true, "streamingParityRequired": true, "malformedInputRejected": true, "scoreMetric": "Exact/accepted answer match;real photo labels plus isolated OCR/count and text context;not broad task-quality certification.", "speedGradePolicy": { "textCharactersPerSecond": { "fast": 20, "good": 5, "slow": 1 }, "imageInferenceMs": { "excellent": 1000, "good": 5000, "slow": 15000 }, "note": "Descriptive grades derived from actual timings;frozen60s acceptance gate unchanged." }, "prototypeEvidence": [ { "file": "research/lfm2-vl-variants/1.6b-fp16-matrix.json", "sha256": "c8945f63b26b425fdfe8eb00ad6a10451ddbdea7e6c3963fe2ecbb8e6e3e59bf", "worker": { "file": "research/lfm2-vl-variants/probe-b905deef2ecd6a58ffd927e258ac103905d001aac482b0eaf4ca513b0e2e1e70.worker.js", "sha256": "b905deef2ecd6a58ffd927e258ac103905d001aac482b0eaf4ca513b0e2e1e70" } }, { "file": "research/lfm2-vl-variants/1.6b-fp32-matrix.json", "sha256": "5a16ed04364c1072f92ad656a52a2acf627b24abdba173f4dafe21638ba0267b", "worker": { "file": "research/lfm2-vl-variants/probe.worker.js", "sha256": "c44313ae06768ccb4cd679151c2d5aee09a47c886f759629b3ca629ab7e910ce" } } ] }
Tested
2026-11-11T19:03:06.280Z
Environment
{ "hardware": "Apple M3 Max", "os": "macOS27.2", "browser": "157.0.8103.40", "scope": "Isolated persistent Chrome public WebAI module worker;verified local immutable artifact snapshot,not network load latency.Concurrent source-download activity,if any,is retained in the linked public API report;not a network-download timing." }
Runtime
Transformers.js 4.2.0
Artifact revision
220b5d921f82d691667c9d36b039a0c62bc973cd
Fixture
{
  "file": "model-samples/lfm2-vl-variants/lfm2-vl-1.6b-text-fixture.json",
  "url": "https://assets.localai.tools/samples/v1/files/cfac05d7c77d523bca9cae49d22993e52898c22f8fd039d2684b211cb67359b2/lfm2-vl-1.6b-text-fixture.json",
  "size": 397,
  "sha1": "750e5ea7c8af16b857b6c16dfbffced95b4b039e",
  "sha256": "cfac05d7c77d523bca9cae49d22993e52898c22f8fd039d2684b211cb67359b2"
}
Rerun when
artifact revision; runtime version; fixture checksum; quality gate; backend behavior; adapter preprocessing or inference changes
Per-case quality & failure details
[
  {
    "precision": "fp16",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "frozenAnswerMatch",
      "score": 1,
      "expected": [
        "paris"
      ]
    },
    "runtime": {
      "inferenceMs": 286.09999999403954,
      "loadMs": 4011.5,
      "totalMs": 4297.5999999940395,
      "charactersPerSecond": 17.47640685111558,
      "grade": "good",
      "precision": "fp16",
      "device": "webgpu",
      "artifactRevision": "220b5d921f82d691667c9d36b039a0c62bc973cd",
      "version": "4.2.0",
      "runtimeVersion": "4.2.0",
      "engine": "Transformers.js",
      "performanceMetric": {
        "name": "charactersPerSecond",
        "value": 17.47640685111558
      }
    }
  },
  {
    "precision": "fp16",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "frozenAnswerMatch",
      "score": 1,
      "expected": [
        "person",
        "woman",
        "lady",
        "girl",
        "female"
      ]
    },
    "runtime": {
      "inferenceMs": 10341.199999988079,
      "loadMs": 4011.5,
      "totalMs": 14352.699999988079,
      "charactersPerSecond": 11.89417088927221,
      "grade": "slow",
      "precision": "fp16",
      "device": "webgpu",
      "artifactRevision": "220b5d921f82d691667c9d36b039a0c62bc973cd",
      "version": "4.2.0",
      "runtimeVersion": "4.2.0",
      "engine": "Transformers.js",
      "imagesPerSecond": 0.09670057633554643,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.09670057633554643
      }
    }
  },
  {
    "precision": "fp16",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "frozenAnswerMatch",
      "score": 1,
      "expected": [
        "dog",
        "labrador",
        "puppy",
        "canine"
      ]
    },
    "runtime": {
      "inferenceMs": 1420.7000000178814,
      "loadMs": 4011.5,
      "totalMs": 5432.200000017881,
      "charactersPerSecond": 2.8155134792353453,
      "grade": "good",
      "precision": "fp16",
      "device": "webgpu",
      "artifactRevision": "220b5d921f82d691667c9d36b039a0c62bc973cd",
      "version": "4.2.0",
      "runtimeVersion": "4.2.0",
      "engine": "Transformers.js",
      "imagesPerSecond": 0.7038783698088362,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.7038783698088362
      }
    }
  },
  {
    "precision": "fp16",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "frozenAnswerMatch",
      "score": 1,
      "expected": [
        "localai2026"
      ]
    },
    "runtime": {
      "inferenceMs": 1460.3999999761581,
      "loadMs": 4011.5,
      "totalMs": 5471.899999976158,
      "charactersPerSecond": 8.901670775275427,
      "grade": "good",
      "precision": "fp16",
      "device": "webgpu",
      "artifactRevision": "220b5d921f82d691667c9d36b039a0c62bc973cd",
      "version": "4.2.0",
      "runtimeVersion": "4.2.0",
      "engine": "Transformers.js",
      "imagesPerSecond": 0.6847439057904174,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.6847439057904174
      }
    }
  },
  {
    "precision": "fp16",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "frozenAnswerMatch",
      "score": 1,
      "expected": [
        "3",
        "three"
      ]
    },
    "runtime": {
      "inferenceMs": 1324,
      "loadMs": 4011.5,
      "totalMs": 5335.5,
      "charactersPerSecond": 0.755287009063444,
      "grade": "good",
      "precision": "fp16",
      "device": "webgpu",
      "artifactRevision": "220b5d921f82d691667c9d36b039a0c62bc973cd",
      "version": "4.2.0",
      "runtimeVersion": "4.2.0",
      "engine": "Transformers.js",
      "imagesPerSecond": 0.7552870090634441,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.7552870090634441
      }
    }
  },
  {
    "precision": "fp16",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "contextAnswerMatch",
      "score": 1,
      "expected": [
        "BLUE"
      ]
    },
    "runtime": {
      "inferenceMs": 113.39999997615814,
      "loadMs": 4011.5,
      "totalMs": 4124.899999976158,
      "charactersPerSecond": 35.27336861411801,
      "precision": "fp16",
      "device": "webgpu",
      "artifactRevision": "220b5d921f82d691667c9d36b039a0c62bc973cd",
      "version": "4.2.0",
      "runtimeVersion": "4.2.0",
      "engine": "Transformers.js",
      "grade": "fast",
      "performanceMetric": {
        "name": "charactersPerSecond",
        "value": 35.27336861411801
      }
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "frozenAnswerMatch",
      "score": 1,
      "expected": [
        "paris"
      ]
    },
    "runtime": {
      "inferenceMs": 458.59999999403954,
      "loadMs": 6449.199999988079,
      "totalMs": 6907.799999982119,
      "charactersPerSecond": 10.90274749250978,
      "grade": "good",
      "precision": "fp32",
      "device": "webgpu",
      "artifactRevision": "220b5d921f82d691667c9d36b039a0c62bc973cd",
      "version": "4.2.0",
      "runtimeVersion": "4.2.0",
      "engine": "Transformers.js",
      "performanceMetric": {
        "name": "charactersPerSecond",
        "value": 10.90274749250978
      }
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "frozenAnswerMatch",
      "score": 1,
      "expected": [
        "person",
        "woman",
        "lady",
        "girl",
        "female"
      ]
    },
    "runtime": {
      "inferenceMs": 14836.5,
      "loadMs": 6449.199999988079,
      "totalMs": 21285.69999998808,
      "charactersPerSecond": 8.694773025983217,
      "grade": "slow",
      "precision": "fp32",
      "device": "webgpu",
      "artifactRevision": "220b5d921f82d691667c9d36b039a0c62bc973cd",
      "version": "4.2.0",
      "runtimeVersion": "4.2.0",
      "engine": "Transformers.js",
      "imagesPerSecond": 0.0674013412866916,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.0674013412866916
      }
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "frozenAnswerMatch",
      "score": 1,
      "expected": [
        "dog",
        "labrador",
        "puppy",
        "canine"
      ]
    },
    "runtime": {
      "inferenceMs": 2131.5,
      "loadMs": 6449.199999988079,
      "totalMs": 8580.699999988079,
      "charactersPerSecond": 1.8766127140511377,
      "grade": "good",
      "precision": "fp32",
      "device": "webgpu",
      "artifactRevision": "220b5d921f82d691667c9d36b039a0c62bc973cd",
      "version": "4.2.0",
      "runtimeVersion": "4.2.0",
      "engine": "Transformers.js",
      "imagesPerSecond": 0.46915317851278443,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.46915317851278443
      }
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "frozenAnswerMatch",
      "score": 1,
      "expected": [
        "localai2026"
      ]
    },
    "runtime": {
      "inferenceMs": 2170.600000023842,
      "loadMs": 6449.199999988079,
      "totalMs": 8619.800000011921,
      "charactersPerSecond": 5.989127430137846,
      "grade": "good",
      "precision": "fp32",
      "device": "webgpu",
      "artifactRevision": "220b5d921f82d691667c9d36b039a0c62bc973cd",
      "version": "4.2.0",
      "runtimeVersion": "4.2.0",
      "engine": "Transformers.js",
      "imagesPerSecond": 0.4607021100106035,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.4607021100106035
      }
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "frozenAnswerMatch",
      "score": 1,
      "expected": [
        "3",
        "three"
      ]
    },
    "runtime": {
      "inferenceMs": 2007.199999988079,
      "loadMs": 6449.199999988079,
      "totalMs": 8456.399999976158,
      "charactersPerSecond": 0.49820645675863845,
      "grade": "good",
      "precision": "fp32",
      "device": "webgpu",
      "artifactRevision": "220b5d921f82d691667c9d36b039a0c62bc973cd",
      "version": "4.2.0",
      "runtimeVersion": "4.2.0",
      "engine": "Transformers.js",
      "imagesPerSecond": 0.49820645675863845,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.49820645675863845
      }
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "contextAnswerMatch",
      "score": 1,
      "expected": [
        "BLUE"
      ]
    },
    "runtime": {
      "inferenceMs": 143.59999999403954,
      "loadMs": 6449.199999988079,
      "totalMs": 6592.799999982119,
      "charactersPerSecond": 27.855153204498816,
      "precision": "fp32",
      "device": "webgpu",
      "artifactRevision": "220b5d921f82d691667c9d36b039a0c62bc973cd",
      "version": "4.2.0",
      "runtimeVersion": "4.2.0",
      "engine": "Transformers.js",
      "grade": "fast",
      "performanceMetric": {
        "name": "charactersPerSecond",
        "value": 27.855153204498816
      }
    }
  },
  {
    "precision": "fp16",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "passed": false,
      "reason": "Error: Error: Can't create a session. ERROR_CODE: 6, ERROR_MESSAGE: std::bad_alloc\n    at Le (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:12:31247)\n    at Id (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:22953)\n    at async $2.loadModel (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:35835)\n    at async gd.createInferenceSessionHandler (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:37556)\n    at async u2.create (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:10:47888)\n    at async Pc (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:54332)\n    at async https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:37:16886\n    at async Promise.all (index 1)\n    at async RT (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:37:16743)\n    at async Promise.all (index 0)"
    },
    "runtime": {
      "loadMs": null,
      "inferenceMs": null,
      "totalMs": null,
      "grade": "failed",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "220b5d921f82d691667c9d36b039a0c62bc973cd"
    },
    "failure": "Error: Error: Can't create a session. ERROR_CODE: 6, ERROR_MESSAGE: std::bad_alloc\n    at Le (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:12:31247)\n    at Id (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:22953)\n    at async $2.loadModel (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:35835)\n    at async gd.createInferenceSessionHandler (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:37556)\n    at async u2.create (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:10:47888)\n    at async Pc (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:54332)\n    at async https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:37:16886\n    at async Promise.all (index 1)\n    at async RT (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:37:16743)\n    at async Promise.all (index 0)"
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "passed": false,
      "reason": "Error: Error: Can't create a session. ERROR_CODE: 6, ERROR_MESSAGE: std::bad_alloc\n    at Le (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:12:31247)\n    at Id (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:22953)\n    at async $2.loadModel (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:35835)\n    at async gd.createInferenceSessionHandler (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:37556)\n    at async u2.create (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:10:47888)\n    at async Pc (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:54332)\n    at async https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:37:16886\n    at async Promise.all (index 1)\n    at async RT (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:37:16743)\n    at async Promise.all (index 0)"
    },
    "runtime": {
      "loadMs": null,
      "inferenceMs": null,
      "totalMs": null,
      "grade": "failed",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "220b5d921f82d691667c9d36b039a0c62bc973cd"
    },
    "failure": "Error: Error: Can't create a session. ERROR_CODE: 6, ERROR_MESSAGE: std::bad_alloc\n    at Le (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:12:31247)\n    at Id (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:22953)\n    at async $2.loadModel (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:35835)\n    at async gd.createInferenceSessionHandler (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:37556)\n    at async u2.create (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:10:47888)\n    at async Pc (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:54332)\n    at async https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:37:16886\n    at async Promise.all (index 1)\n    at async RT (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:37:16743)\n    at async Promise.all (index 0)"
  }
]

LFM2-VL 3B — Text & Image Chat

14 configurations tested
Passed12
Failed2
TestedNov 11, 2026
RuntimeTransformers.js 4.2.0

Quality criteria

{ "allCasesRequired": true, "maximumInferenceMs": 60000, "gibberishRejected": true, "streamingParityRequired": true, "malformedInputRejected": true, "scoreMetric": "Exact/accepted answer match;real photo labels plus isolated OCR/count and text context;not broad task-quality certification.", "speedGradePolicy": { "textCharactersPerSecond": { "fast": 20, "good": 5, "slow": 1 }, "imageInferenceMs": { "excellent": 1000, "good": 5000, "slow": 15000 }, "note": "Descriptive grades derived from actual timings;frozen60s acceptance gate unchanged." }, "prototypeEvidence": [ { "file": "research/lfm2-vl-variants/3b-fp16-matrix.json", "sha256": "e8766c52c90158ef3a689f70403cd20462349fc36f6adc816822e29fce1c41c9", "worker": { "file": "research/lfm2-vl-variants/probe.worker.js", "sha256": "c44313ae06768ccb4cd679151c2d5aee09a47c886f759629b3ca629ab7e910ce" } }, { "file": "research/lfm2-vl-variants/3b-fp32-matrix.json", "sha256": "9ccfd82d63e12c2ff265c10ade00c3ca4ff4c87e0a903666486b2b268079fbf5", "worker": { "file": "research/lfm2-vl-variants/probe.worker.js", "sha256": "c44313ae06768ccb4cd679151c2d5aee09a47c886f759629b3ca629ab7e910ce" } } ] }

PrecisionDeviceResult
FP16GPU · WebGPUAcceleratedPassedFast
FP32GPU · WebGPUAcceleratedPassedFast
FP16GPU · WebGPUAcceleratedPassedModerate
FP32GPU · WebGPUAcceleratedPassedModerate
FP16GPU · WebGPUAcceleratedPassedModerate
FP16GPU · WebGPUAcceleratedPassedModerate
FP16GPU · WebGPUAcceleratedPassedModerate
FP32GPU · WebGPUAcceleratedPassedSlow
FP32GPU · WebGPUAcceleratedPassedSlow
FP32GPU · WebGPUAcceleratedPassedSlow
FP16GPU · WebGPUAcceleratedPassedVery slow
FP32GPU · WebGPUAcceleratedPassedVery slow
FP16CPU · WASMFailed—
FP32CPU · WASMFailed—
Test setup & sample details
Quality gate
{ "allCasesRequired": true, "maximumInferenceMs": 60000, "gibberishRejected": true, "streamingParityRequired": true, "malformedInputRejected": true, "scoreMetric": "Exact/accepted answer match;real photo labels plus isolated OCR/count and text context;not broad task-quality certification.", "speedGradePolicy": { "textCharactersPerSecond": { "fast": 20, "good": 5, "slow": 1 }, "imageInferenceMs": { "excellent": 1000, "good": 5000, "slow": 15000 }, "note": "Descriptive grades derived from actual timings;frozen60s acceptance gate unchanged." }, "prototypeEvidence": [ { "file": "research/lfm2-vl-variants/3b-fp16-matrix.json", "sha256": "e8766c52c90158ef3a689f70403cd20462349fc36f6adc816822e29fce1c41c9", "worker": { "file": "research/lfm2-vl-variants/probe.worker.js", "sha256": "c44313ae06768ccb4cd679151c2d5aee09a47c886f759629b3ca629ab7e910ce" } }, { "file": "research/lfm2-vl-variants/3b-fp32-matrix.json", "sha256": "9ccfd82d63e12c2ff265c10ade00c3ca4ff4c87e0a903666486b2b268079fbf5", "worker": { "file": "research/lfm2-vl-variants/probe.worker.js", "sha256": "c44313ae06768ccb4cd679151c2d5aee09a47c886f759629b3ca629ab7e910ce" } } ] }
Tested
2026-11-11T19:22:51.867Z
Environment
{ "hardware": "Apple M3 Max", "os": "macOS27.2", "browser": "157.0.8103.40", "scope": "Isolated persistent Chrome public WebAI module worker;verified local immutable artifact snapshot,not network load latency.Concurrent source-download activity,if any,is retained in the linked public API report;not a network-download timing." }
Runtime
Transformers.js 4.2.0
Artifact revision
c9ac3e20e98cedf85fb31a913dfeb4e5a2a6183c
Fixture
{
  "file": "model-samples/lfm2-vl-variants/lfm2-vl-3b-text-fixture.json",
  "url": "https://assets.localai.tools/samples/v1/files/cfac05d7c77d523bca9cae49d22993e52898c22f8fd039d2684b211cb67359b2/lfm2-vl-3b-text-fixture.json",
  "size": 397,
  "sha1": "750e5ea7c8af16b857b6c16dfbffced95b4b039e",
  "sha256": "cfac05d7c77d523bca9cae49d22993e52898c22f8fd039d2684b211cb67359b2"
}
Rerun when
artifact revision; runtime version; fixture checksum; quality gate; backend behavior; adapter preprocessing or inference changes
Per-case quality & failure details
[
  {
    "precision": "fp16",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "frozenAnswerMatch",
      "score": 1,
      "expected": [
        "paris"
      ]
    },
    "runtime": {
      "inferenceMs": 1263.7000000178814,
      "loadMs": 17524.59999999404,
      "totalMs": 18788.30000001192,
      "charactersPerSecond": 3.9566352773041467,
      "grade": "slow",
      "precision": "fp16",
      "device": "webgpu",
      "artifactRevision": "c9ac3e20e98cedf85fb31a913dfeb4e5a2a6183c",
      "version": "4.2.0",
      "runtimeVersion": "4.2.0",
      "engine": "Transformers.js",
      "performanceMetric": {
        "name": "charactersPerSecond",
        "value": 3.9566352773041467
      }
    }
  },
  {
    "precision": "fp16",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "frozenAnswerMatch",
      "score": 1,
      "expected": [
        "person",
        "woman",
        "lady",
        "girl",
        "female"
      ]
    },
    "runtime": {
      "inferenceMs": 12164.800000011921,
      "loadMs": 17524.59999999404,
      "totalMs": 29689.40000000596,
      "charactersPerSecond": 6.329738261206477,
      "grade": "slow",
      "precision": "fp16",
      "device": "webgpu",
      "artifactRevision": "c9ac3e20e98cedf85fb31a913dfeb4e5a2a6183c",
      "version": "4.2.0",
      "runtimeVersion": "4.2.0",
      "engine": "Transformers.js",
      "imagesPerSecond": 0.08220439300268151,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.08220439300268151
      }
    }
  },
  {
    "precision": "fp16",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "frozenAnswerMatch",
      "score": 1,
      "expected": [
        "dog",
        "labrador",
        "puppy",
        "canine"
      ]
    },
    "runtime": {
      "inferenceMs": 1648.7999999821186,
      "loadMs": 17524.59999999404,
      "totalMs": 19173.399999976158,
      "charactersPerSecond": 2.4260067928453304,
      "grade": "good",
      "precision": "fp16",
      "device": "webgpu",
      "artifactRevision": "c9ac3e20e98cedf85fb31a913dfeb4e5a2a6183c",
      "version": "4.2.0",
      "runtimeVersion": "4.2.0",
      "engine": "Transformers.js",
      "imagesPerSecond": 0.6065016982113326,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.6065016982113326
      }
    }
  },
  {
    "precision": "fp16",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "frozenAnswerMatch",
      "score": 1,
      "expected": [
        "localai2026"
      ]
    },
    "runtime": {
      "inferenceMs": 1745.7000000178814,
      "loadMs": 17524.59999999404,
      "totalMs": 19270.30000001192,
      "charactersPerSecond": 7.44686945057389,
      "grade": "good",
      "precision": "fp16",
      "device": "webgpu",
      "artifactRevision": "c9ac3e20e98cedf85fb31a913dfeb4e5a2a6183c",
      "version": "4.2.0",
      "runtimeVersion": "4.2.0",
      "engine": "Transformers.js",
      "imagesPerSecond": 0.5728361115826069,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.5728361115826069
      }
    }
  },
  {
    "precision": "fp16",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "frozenAnswerMatch",
      "score": 1,
      "expected": [
        "3",
        "three"
      ]
    },
    "runtime": {
      "inferenceMs": 1483.3999999761581,
      "loadMs": 17524.59999999404,
      "totalMs": 19007.999999970198,
      "charactersPerSecond": 0.6741270055386762,
      "grade": "good",
      "precision": "fp16",
      "device": "webgpu",
      "artifactRevision": "c9ac3e20e98cedf85fb31a913dfeb4e5a2a6183c",
      "version": "4.2.0",
      "runtimeVersion": "4.2.0",
      "engine": "Transformers.js",
      "imagesPerSecond": 0.6741270055386763,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.6741270055386763
      }
    }
  },
  {
    "precision": "fp16",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "contextAnswerMatch",
      "score": 1,
      "expected": [
        "BLUE"
      ]
    },
    "runtime": {
      "inferenceMs": 207.09999999403954,
      "loadMs": 17524.59999999404,
      "totalMs": 17731.69999998808,
      "charactersPerSecond": 19.314340898672732,
      "precision": "fp16",
      "device": "webgpu",
      "artifactRevision": "c9ac3e20e98cedf85fb31a913dfeb4e5a2a6183c",
      "version": "4.2.0",
      "runtimeVersion": "4.2.0",
      "engine": "Transformers.js",
      "grade": "good",
      "performanceMetric": {
        "name": "charactersPerSecond",
        "value": 19.314340898672732
      }
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "frozenAnswerMatch",
      "score": 1,
      "expected": [
        "paris"
      ]
    },
    "runtime": {
      "inferenceMs": 1335.5999999940395,
      "loadMs": 11959.5,
      "totalMs": 13295.09999999404,
      "charactersPerSecond": 3.7436358191242243,
      "grade": "slow",
      "precision": "fp32",
      "device": "webgpu",
      "artifactRevision": "c9ac3e20e98cedf85fb31a913dfeb4e5a2a6183c",
      "version": "4.2.0",
      "runtimeVersion": "4.2.0",
      "engine": "Transformers.js",
      "performanceMetric": {
        "name": "charactersPerSecond",
        "value": 3.7436358191242243
      }
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "frozenAnswerMatch",
      "score": 1,
      "expected": [
        "person",
        "woman",
        "lady",
        "girl",
        "female"
      ]
    },
    "runtime": {
      "inferenceMs": 18414.20000001788,
      "loadMs": 11959.5,
      "totalMs": 30373.70000001788,
      "charactersPerSecond": 3.910025958224092,
      "grade": "very-slow",
      "precision": "fp32",
      "device": "webgpu",
      "artifactRevision": "c9ac3e20e98cedf85fb31a913dfeb4e5a2a6183c",
      "version": "4.2.0",
      "runtimeVersion": "4.2.0",
      "engine": "Transformers.js",
      "imagesPerSecond": 0.05430591608644573,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.05430591608644573
      }
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "frozenAnswerMatch",
      "score": 1,
      "expected": [
        "dog",
        "labrador",
        "puppy",
        "canine"
      ]
    },
    "runtime": {
      "inferenceMs": 2698.9000000059605,
      "loadMs": 11959.5,
      "totalMs": 14658.40000000596,
      "charactersPerSecond": 1.482085294005397,
      "grade": "good",
      "precision": "fp32",
      "device": "webgpu",
      "artifactRevision": "c9ac3e20e98cedf85fb31a913dfeb4e5a2a6183c",
      "version": "4.2.0",
      "runtimeVersion": "4.2.0",
      "engine": "Transformers.js",
      "imagesPerSecond": 0.37052132350134925,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.37052132350134925
      }
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "frozenAnswerMatch",
      "score": 1,
      "expected": [
        "localai2026"
      ]
    },
    "runtime": {
      "inferenceMs": 2812.199999988079,
      "loadMs": 11959.5,
      "totalMs": 14771.699999988079,
      "charactersPerSecond": 4.6227153118750826,
      "grade": "good",
      "precision": "fp32",
      "device": "webgpu",
      "artifactRevision": "c9ac3e20e98cedf85fb31a913dfeb4e5a2a6183c",
      "version": "4.2.0",
      "runtimeVersion": "4.2.0",
      "engine": "Transformers.js",
      "imagesPerSecond": 0.3555934855288525,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.3555934855288525
      }
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "frozenAnswerMatch",
      "score": 1,
      "expected": [
        "3",
        "three"
      ]
    },
    "runtime": {
      "inferenceMs": 2406.4000000059605,
      "loadMs": 11959.5,
      "totalMs": 14365.90000000596,
      "charactersPerSecond": 0.4155585106372685,
      "grade": "good",
      "precision": "fp32",
      "device": "webgpu",
      "artifactRevision": "c9ac3e20e98cedf85fb31a913dfeb4e5a2a6183c",
      "version": "4.2.0",
      "runtimeVersion": "4.2.0",
      "engine": "Transformers.js",
      "imagesPerSecond": 0.41555851063726856,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.41555851063726856
      }
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "contextAnswerMatch",
      "score": 1,
      "expected": [
        "BLUE"
      ]
    },
    "runtime": {
      "inferenceMs": 282.19999998807907,
      "loadMs": 11959.5,
      "totalMs": 12241.699999988079,
      "charactersPerSecond": 14.174344437168571,
      "precision": "fp32",
      "device": "webgpu",
      "artifactRevision": "c9ac3e20e98cedf85fb31a913dfeb4e5a2a6183c",
      "version": "4.2.0",
      "runtimeVersion": "4.2.0",
      "engine": "Transformers.js",
      "grade": "good",
      "performanceMetric": {
        "name": "charactersPerSecond",
        "value": 14.174344437168571
      }
    }
  },
  {
    "precision": "fp16",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "passed": false,
      "reason": "Error: Error: Can't create a session. ERROR_CODE: 6, ERROR_MESSAGE: std::bad_alloc\n    at Le (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:12:31247)\n    at Id (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:22953)\n    at async $2.loadModel (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:35835)\n    at async gd.createInferenceSessionHandler (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:37556)\n    at async u2.create (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:10:47888)\n    at async Pc (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:54332)\n    at async https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:37:16886\n    at async Promise.all (index 1)\n    at async RT (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:37:16743)\n    at async Promise.all (index 0)"
    },
    "runtime": {
      "loadMs": null,
      "inferenceMs": null,
      "totalMs": null,
      "grade": "failed",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "c9ac3e20e98cedf85fb31a913dfeb4e5a2a6183c"
    },
    "failure": "Error: Error: Can't create a session. ERROR_CODE: 6, ERROR_MESSAGE: std::bad_alloc\n    at Le (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:12:31247)\n    at Id (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:22953)\n    at async $2.loadModel (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:35835)\n    at async gd.createInferenceSessionHandler (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:37556)\n    at async u2.create (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:10:47888)\n    at async Pc (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:54332)\n    at async https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:37:16886\n    at async Promise.all (index 1)\n    at async RT (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:37:16743)\n    at async Promise.all (index 0)"
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "passed": false,
      "reason": "Error: Error: Can't create a session. ERROR_CODE: 6, ERROR_MESSAGE: std::bad_alloc\n    at Le (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:12:31247)\n    at Id (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:22953)\n    at async $2.loadModel (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:35835)\n    at async gd.createInferenceSessionHandler (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:37556)\n    at async u2.create (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:10:47888)\n    at async Pc (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:54332)\n    at async https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:37:16886\n    at async Promise.all (index 1)\n    at async RT (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:37:16743)\n    at async Promise.all (index 0)"
    },
    "runtime": {
      "loadMs": null,
      "inferenceMs": null,
      "totalMs": null,
      "grade": "failed",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "c9ac3e20e98cedf85fb31a913dfeb4e5a2a6183c"
    },
    "failure": "Error: Error: Can't create a session. ERROR_CODE: 6, ERROR_MESSAGE: std::bad_alloc\n    at Le (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:12:31247)\n    at Id (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:22953)\n    at async $2.loadModel (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:35835)\n    at async gd.createInferenceSessionHandler (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:37556)\n    at async u2.create (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:10:47888)\n    at async Pc (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:13:54332)\n    at async https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:37:16886\n    at async Promise.all (index 1)\n    at async RT (https://cdn.jsdelivr.net/npm/@huggingface/transformers@4.2.0:37:16743)\n    at async Promise.all (index 0)"
  }
]

Something not quite right?

Tell us what happened with LFM2-VL. Loading, results, or the page itself—we’re here for all of it.

Attachments Optional

Up to 3 files · 50 MB each

Browser, OS, CPU/GPU, memory, screen, storage, and network details are included automatically. Model inputs, results, and browsing history are not collected.