A model is still running

A model is still running or downloading. Leaving will stop the current operation. Stay on this page to let it finish.

Skip to content
LocalAI.toolsBeta

Join the waitlist

Get an email when the new apps and model runs launch.

No account needed.

SAM 2.1 Hiera-Tiny

Select an object in a still image with include/exclude clicks and refine the selection with more points. Returns an object mask and candidate scores; this worker does not track video.

Browser inferencePowered by WebAI · Private · Unlimited runs
About this model

Select an object in a still image with include/exclude clicks and refine the selection with more points. Returns an object mask and candidate scores; this worker does not track video.

Created by
Meta
License
Apache-2.0
Model released
Unknown
Source repository created
Sep 24, 2024
Model weights · FP16
78.0 MB

Best for

  • Interactive object selection in still images.
  • Draft masks for image editing and annotation.

Keep in mind

  • Image-only adapter; video tracking and temporal memory are not supported.
  • Point placement, blurred images, fine boundaries, transparent objects and overlapping objects can reduce accuracy.
  • Scores are model estimates, not guaranteed mask accuracy. Review masks before use.
  • Not validated for medical, safety-critical or consequential segmentation decisions.

Processed on your deviceInference runs in this browser. Input/output sharing requires consent for each run. Basic run logs include device information and approximate connection location. Model and runtime files download from external hosts. Saved downloads may be cleared by your browser.

Sources & technical details
Original model
facebook/sam2.1-hiera-tiny
Release verification
Unknown
Release evidence
Upstream README gives conflicting September 29 and 30, 2024 checkpoint dates; exact public release day unresolved.
Source updated
Aug 15, 2025
Browser model files
onnx-community/sam2.1-hiera-tiny-ONNX
Files updated
Nov 18, 2025
Artifact revision
814a066640debee5a91e70aa401fb8e17e030503

Input

IMAGE

Sample result

SAM 2.1 Hiera-Tiny

Settings

Adds a self-contained SVG presentation image alongside the unchanged native model fields. When enabled, draws model predictions or presents generated media and text. Adds CPU postprocessing time and image bytes. It does not change model predictions.

Output

Your result will appear here

Add input or try the sample, then run the model.

Benchmark evidence

Saved worker evidence is separate from benchmarks run on your device. It does not guarantee speed or quality on every browser.

SAM 2.1 Hiera-Tiny

16 configurations tested
Passed10
Failed6
TestedOct 31, 2026
RuntimeTransformers.js 4.2.0

Quality criteria

Expected dimensions, finite scores, whole-person foreground ratio 0.15–0.40, reference prompt inside, and 100% accuracy on independently annotated foreground/background probes.

PrecisionDeviceResult
FP16GPU · WebGPUAcceleratedPassedFast
FP32GPU · WebGPUAcceleratedPassedModerate
BNB4GPU · WebGPUAcceleratedPassedVery slow
UINT8GPU · WebGPUAcceleratedPassedVery slow
Q8GPU · WebGPUAcceleratedPassedVery slow
INT8GPU · WebGPUAcceleratedPassedVery slow
BNB4CPU · WASMPassedVery slow
Q8CPU · WASMPassedVery slow
FP32CPU · WASMPassedVery slow
FP16CPU · WASMPassedVery slow
INT8CPU · WASMFailed—
UINT8CPU · WASMFailed—
Q4GPU · WebGPUFailed—
Q4CPU · WASMFailed—
Q4F16GPU · WebGPUFailed—
Q4F16CPU · WASMFailed—
Test setup & sample details
Quality gate
Expected dimensions, finite scores, whole-person foreground ratio 0.15–0.40, reference prompt inside, and 100% accuracy on independently annotated foreground/background probes.
Tested
2026-10-31T17:39:26.389Z
Environment
Isolated Chrome module worker per case on macOS arm64; Transformers.js 4.2.0
Runtime
Transformers.js 4.2.0
Artifact revision
814a066640debee5a91e70aa401fb8e17e030503
Fixture
{
  "file": "model-samples/sam2.1-hiera-tiny.json",
  "url": "https://f005.backblazeb2.com/file/hubters-webai-public/assets/benchmarks/sam2.1-hiera-tiny.json",
  "size": 1194,
  "sha1": "42420a6017382788ab3b1a6b078ed63f382f3b5e"
}
Rerun when
artifact revision change; runtime version change; fixture or quality gate change; browser/backend change
Per-case quality & failure details
[
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "shape": true,
      "finite": true,
      "pointInside": true,
      "foregroundRatio": 0.24932941755124452,
      "nonDegenerate": true,
      "probes": [
        {
          "x": 450,
          "y": 120,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 460,
          "y": 210,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 430,
          "y": 350,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 350,
          "y": 420,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 460,
          "y": 520,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 480,
          "y": 630,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 580,
          "y": 470,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 50,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 800,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 900,
          "y": 100,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 100,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 700,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 200,
          "y": 200,
          "expected": 0,
          "actual": 0
        }
      ],
      "probeAccuracy": 1,
      "passed": true
    },
    "runtime": {
      "loadMs": 12848.799999982119,
      "inferenceMs": 806.4000000059605,
      "totalMs": 14931.5,
      "grade": "excellent",
      "megapixelsPerSecond": 0.8673015872951767
    }
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "shape": true,
      "finite": true,
      "pointInside": true,
      "foregroundRatio": 0.24932941755124452,
      "nonDegenerate": true,
      "probes": [
        {
          "x": 450,
          "y": 120,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 460,
          "y": 210,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 430,
          "y": 350,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 350,
          "y": 420,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 460,
          "y": 520,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 480,
          "y": 630,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 580,
          "y": 470,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 50,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 800,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 900,
          "y": 100,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 100,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 700,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 200,
          "y": 200,
          "expected": 0,
          "actual": 0
        }
      ],
      "probeAccuracy": 1,
      "passed": true
    },
    "runtime": {
      "loadMs": 12634.800000011921,
      "inferenceMs": 7286.300000011921,
      "totalMs": 21193.5,
      "grade": "slow",
      "megapixelsPerSecond": 0.09598726376883408
    }
  },
  {
    "precision": "fp16",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "shape": true,
      "finite": true,
      "pointInside": true,
      "foregroundRatio": 0.24926364613836016,
      "nonDegenerate": true,
      "probes": [
        {
          "x": 450,
          "y": 120,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 460,
          "y": 210,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 430,
          "y": 350,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 350,
          "y": 420,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 460,
          "y": 520,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 480,
          "y": 630,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 580,
          "y": 470,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 50,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 800,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 900,
          "y": 100,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 100,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 700,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 200,
          "y": 200,
          "expected": 0,
          "actual": 0
        }
      ],
      "probeAccuracy": 1,
      "passed": true
    },
    "runtime": {
      "loadMs": 11640.700000017881,
      "inferenceMs": 306.5,
      "totalMs": 13345.199999988079,
      "grade": "excellent",
      "megapixelsPerSecond": 2.281866231647635
    }
  },
  {
    "precision": "fp16",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "shape": true,
      "finite": true,
      "pointInside": true,
      "foregroundRatio": 0.24926078651171302,
      "nonDegenerate": true,
      "probes": [
        {
          "x": 450,
          "y": 120,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 460,
          "y": 210,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 430,
          "y": 350,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 350,
          "y": 420,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 460,
          "y": 520,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 480,
          "y": 630,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 580,
          "y": 470,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 50,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 800,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 900,
          "y": 100,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 100,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 700,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 200,
          "y": 200,
          "expected": 0,
          "actual": 0
        }
      ],
      "probeAccuracy": 1,
      "passed": true
    },
    "runtime": {
      "loadMs": 12687.199999988079,
      "inferenceMs": 7500.800000011921,
      "totalMs": 21706.59999999404,
      "grade": "slow",
      "megapixelsPerSecond": 0.09324232081896444
    }
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "shape": true,
      "finite": true,
      "pointInside": true,
      "foregroundRatio": 0.2509808519399707,
      "nonDegenerate": true,
      "probes": [
        {
          "x": 450,
          "y": 120,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 460,
          "y": 210,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 430,
          "y": 350,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 350,
          "y": 420,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 460,
          "y": 520,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 480,
          "y": 630,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 580,
          "y": 470,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 50,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 800,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 900,
          "y": 100,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 100,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 700,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 200,
          "y": 200,
          "expected": 0,
          "actual": 0
        }
      ],
      "probeAccuracy": 1,
      "passed": true
    },
    "runtime": {
      "loadMs": 10530.699999988079,
      "inferenceMs": 5602,
      "totalMs": 17510.80000001192,
      "grade": "slow",
      "megapixelsPerSecond": 0.12484684041413781
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "shape": true,
      "finite": true,
      "pointInside": true,
      "foregroundRatio": 0.25070918740849196,
      "nonDegenerate": true,
      "probes": [
        {
          "x": 450,
          "y": 120,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 460,
          "y": 210,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 430,
          "y": 350,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 350,
          "y": 420,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 460,
          "y": 520,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 480,
          "y": 630,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 580,
          "y": 470,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 50,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 800,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 900,
          "y": 100,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 100,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 700,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 200,
          "y": 200,
          "expected": 0,
          "actual": 0
        }
      ],
      "probeAccuracy": 1,
      "passed": true
    },
    "runtime": {
      "loadMs": 9646.300000011921,
      "inferenceMs": 7259.9000000059605,
      "totalMs": 18259.80000001192,
      "grade": "slow",
      "megapixelsPerSecond": 0.09633631317227866
    }
  },
  {
    "precision": "int8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "shape": true,
      "finite": true,
      "pointInside": true,
      "foregroundRatio": 0.24986130810761348,
      "nonDegenerate": true,
      "probes": [
        {
          "x": 450,
          "y": 120,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 460,
          "y": 210,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 430,
          "y": 350,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 350,
          "y": 420,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 460,
          "y": 520,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 480,
          "y": 630,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 580,
          "y": 470,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 50,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 800,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 900,
          "y": 100,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 100,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 700,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 200,
          "y": 200,
          "expected": 0,
          "actual": 0
        }
      ],
      "probeAccuracy": 1,
      "passed": true
    },
    "runtime": {
      "loadMs": 9184.59999999404,
      "inferenceMs": 6342,
      "totalMs": 16788.69999998808,
      "grade": "slow",
      "megapixelsPerSecond": 0.11027940712708925
    }
  },
  {
    "precision": "int8",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "shape": true,
      "finite": true,
      "pointInside": true,
      "foregroundRatio": 0.058766757412152267,
      "nonDegenerate": false,
      "probes": [
        {
          "x": 450,
          "y": 120,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 460,
          "y": 210,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 430,
          "y": 350,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 350,
          "y": 420,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 460,
          "y": 520,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 480,
          "y": 630,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 580,
          "y": 470,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 50,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 800,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 900,
          "y": 100,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 100,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 700,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 200,
          "y": 200,
          "expected": 0,
          "actual": 0
        }
      ],
      "probeAccuracy": 0.5384615384615384,
      "passed": false
    },
    "runtime": {
      "loadMs": 11850.59999999404,
      "inferenceMs": 7802.300000011921,
      "totalMs": 21002,
      "grade": "slow",
      "megapixelsPerSecond": 0.08963920895106973
    },
    "failure": "Segmentation quality gate failed"
  },
  {
    "precision": "uint8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "shape": true,
      "finite": true,
      "pointInside": true,
      "foregroundRatio": 0.25080355508784774,
      "nonDegenerate": true,
      "probes": [
        {
          "x": 450,
          "y": 120,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 460,
          "y": 210,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 430,
          "y": 350,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 350,
          "y": 420,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 460,
          "y": 520,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 480,
          "y": 630,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 580,
          "y": 470,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 50,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 800,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 900,
          "y": 100,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 100,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 700,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 200,
          "y": 200,
          "expected": 0,
          "actual": 0
        }
      ],
      "probeAccuracy": 1,
      "passed": true
    },
    "runtime": {
      "loadMs": 10170.300000011921,
      "inferenceMs": 5372.799999982119,
      "totalMs": 16971.19999998808,
      "grade": "slow",
      "megapixelsPerSecond": 0.13017272185868217
    }
  },
  {
    "precision": "uint8",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "shape": true,
      "finite": true,
      "pointInside": true,
      "foregroundRatio": 0.05889115117130307,
      "nonDegenerate": false,
      "probes": [
        {
          "x": 450,
          "y": 120,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 460,
          "y": 210,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 430,
          "y": 350,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 350,
          "y": 420,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 460,
          "y": 520,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 480,
          "y": 630,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 580,
          "y": 470,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 50,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 800,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 900,
          "y": 100,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 100,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 700,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 200,
          "y": 200,
          "expected": 0,
          "actual": 0
        }
      ],
      "probeAccuracy": 0.5384615384615384,
      "passed": false
    },
    "runtime": {
      "loadMs": 9808.09999999404,
      "inferenceMs": 7109.5,
      "totalMs": 18375.19999998808,
      "grade": "slow",
      "megapixelsPerSecond": 0.09837428792460792
    },
    "failure": "Segmentation quality gate failed"
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "fail",
    "quality": {
      "shape": true,
      "finite": true,
      "pointInside": true,
      "foregroundRatio": 0.05988058199121523,
      "nonDegenerate": false,
      "probes": [
        {
          "x": 450,
          "y": 120,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 460,
          "y": 210,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 430,
          "y": 350,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 350,
          "y": 420,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 460,
          "y": 520,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 480,
          "y": 630,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 580,
          "y": 470,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 50,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 800,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 900,
          "y": 100,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 100,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 700,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 200,
          "y": 200,
          "expected": 0,
          "actual": 0
        }
      ],
      "probeAccuracy": 0.5384615384615384,
      "passed": false
    },
    "runtime": {
      "loadMs": 8588.800000011921,
      "inferenceMs": 351.09999999403954,
      "totalMs": 10469.90000000596,
      "grade": "excellent",
      "megapixelsPerSecond": 1.9920022785869362
    },
    "failure": "Segmentation quality gate failed"
  },
  {
    "precision": "q4",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "shape": true,
      "finite": true,
      "pointInside": true,
      "foregroundRatio": 0.05988058199121523,
      "nonDegenerate": false,
      "probes": [
        {
          "x": 450,
          "y": 120,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 460,
          "y": 210,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 430,
          "y": 350,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 350,
          "y": 420,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 460,
          "y": 520,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 480,
          "y": 630,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 580,
          "y": 470,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 50,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 800,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 900,
          "y": 100,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 100,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 700,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 200,
          "y": 200,
          "expected": 0,
          "actual": 0
        }
      ],
      "probeAccuracy": 0.5384615384615384,
      "passed": false
    },
    "runtime": {
      "loadMs": 8845,
      "inferenceMs": 7194,
      "totalMs": 17418.69999998808,
      "grade": "slow",
      "megapixelsPerSecond": 0.09721879343897692
    },
    "failure": "Segmentation quality gate failed"
  },
  {
    "precision": "q4f16",
    "device": "webgpu",
    "status": "fail",
    "quality": {
      "shape": true,
      "finite": true,
      "pointInside": true,
      "foregroundRatio": 0.0596117770863836,
      "nonDegenerate": false,
      "probes": [
        {
          "x": 450,
          "y": 120,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 460,
          "y": 210,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 430,
          "y": 350,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 350,
          "y": 420,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 460,
          "y": 520,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 480,
          "y": 630,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 580,
          "y": 470,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 50,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 800,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 900,
          "y": 100,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 100,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 700,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 200,
          "y": 200,
          "expected": 0,
          "actual": 0
        }
      ],
      "probeAccuracy": 0.5384615384615384,
      "passed": false
    },
    "runtime": {
      "loadMs": 7632.0999999940395,
      "inferenceMs": 291.5,
      "totalMs": 9460.09999999404,
      "grade": "excellent",
      "megapixelsPerSecond": 2.399286449399657
    },
    "failure": "Segmentation quality gate failed"
  },
  {
    "precision": "q4f16",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "shape": true,
      "finite": true,
      "pointInside": true,
      "foregroundRatio": 0.05987915217789166,
      "nonDegenerate": false,
      "probes": [
        {
          "x": 450,
          "y": 120,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 460,
          "y": 210,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 430,
          "y": 350,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 350,
          "y": 420,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 460,
          "y": 520,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 480,
          "y": 630,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 580,
          "y": 470,
          "expected": 1,
          "actual": 0
        },
        {
          "x": 50,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 800,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 900,
          "y": 100,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 100,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 700,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 200,
          "y": 200,
          "expected": 0,
          "actual": 0
        }
      ],
      "probeAccuracy": 0.5384615384615384,
      "passed": false
    },
    "runtime": {
      "loadMs": 9803.300000011921,
      "inferenceMs": 7904.699999988079,
      "totalMs": 19128.59999999404,
      "grade": "slow",
      "megapixelsPerSecond": 0.08847799410490655
    },
    "failure": "Segmentation quality gate failed"
  },
  {
    "precision": "bnb4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "shape": true,
      "finite": true,
      "pointInside": true,
      "foregroundRatio": 0.25469264732796487,
      "nonDegenerate": true,
      "probes": [
        {
          "x": 450,
          "y": 120,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 460,
          "y": 210,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 430,
          "y": 350,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 350,
          "y": 420,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 460,
          "y": 520,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 480,
          "y": 630,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 580,
          "y": 470,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 50,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 800,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 900,
          "y": 100,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 100,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 700,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 200,
          "y": 200,
          "expected": 0,
          "actual": 0
        }
      ],
      "probeAccuracy": 1,
      "passed": true
    },
    "runtime": {
      "loadMs": 9344.700000017881,
      "inferenceMs": 5021.5,
      "totalMs": 15843.699999988079,
      "grade": "slow",
      "megapixelsPerSecond": 0.13927949815792096
    }
  },
  {
    "precision": "bnb4",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "shape": true,
      "finite": true,
      "pointInside": true,
      "foregroundRatio": 0.25469264732796487,
      "nonDegenerate": true,
      "probes": [
        {
          "x": 450,
          "y": 120,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 460,
          "y": 210,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 430,
          "y": 350,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 350,
          "y": 420,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 460,
          "y": 520,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 480,
          "y": 630,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 580,
          "y": 470,
          "expected": 1,
          "actual": 1
        },
        {
          "x": 50,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 800,
          "y": 350,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 900,
          "y": 100,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 100,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 700,
          "y": 600,
          "expected": 0,
          "actual": 0
        },
        {
          "x": 200,
          "y": 200,
          "expected": 0,
          "actual": 0
        }
      ],
      "probeAccuracy": 1,
      "passed": true
    },
    "runtime": {
      "loadMs": 11020.799999982119,
      "inferenceMs": 7196.5,
      "totalMs": 19668.29999998212,
      "grade": "slow",
      "megapixelsPerSecond": 0.09718502049607448
    }
  }
]

SAM 2.1 Hiera-small

4 configurations tested
Passed4
Failed0
TestedNov 4, 2026
RuntimeTransformers.js 4.2.0

Quality criteria

Expected dimensions, finite scores, whole-person foreground ratio 0.15–0.40, reference prompt inside, and 100% accuracy on independently annotated foreground/background probes.

PrecisionDeviceResult
FP16GPU · WebGPUAcceleratedPassedFast
Q8GPU · WebGPUAcceleratedPassedVery slow
Q8CPU · WASMPassedVery slow
FP16CPU · WASMPassedVery slow
Test setup & sample details
Quality gate
Expected dimensions, finite scores, whole-person foreground ratio 0.15–0.40, reference prompt inside, and 100% accuracy on independently annotated foreground/background probes.
Tested
2026-11-04T16:39:27.876Z
Environment
Isolated Chrome module worker per case on macOS arm64; Transformers.js 4.2.0
Runtime
Transformers.js 4.2.0
Artifact revision
a7df49d8de14b9d2e4504d1687b0d568f905fd8d
Fixture
{
  "file": "model-samples/sam2.1-hiera-tiny.json",
  "url": "https://f005.backblazeb2.com/file/hubters-webai-public/assets/benchmarks/sam2.1-hiera-tiny.json",
  "size": 1194,
  "sha1": "42420a6017382788ab3b1a6b078ed63f382f3b5e"
}
Rerun when
artifact revision change; runtime version change; fixture or quality gate change; browser/backend change
Per-case quality & failure details
[
  {
    "precision": "q8",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "probeAccuracy": 1,
      "foregroundRatio": 0.2515327598828697,
      "passed": true,
      "visualization": true
    },
    "runtime": {
      "loadMs": 2179.5,
      "inferenceMs": 8801.199999988079,
      "totalMs": 12868.5,
      "grade": "slow",
      "imagesPerSecond": 0.1136208698815337,
      "artifactRevision": "a7df49d8de14b9d2e4504d1687b0d568f905fd8d",
      "engine": {
        "name": "Transformers.js",
        "version": "4.2.0"
      }
    }
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "probeAccuracy": 1,
      "foregroundRatio": 0.25123392889824303,
      "passed": true,
      "visualization": true
    },
    "runtime": {
      "loadMs": 1767.9000000059605,
      "inferenceMs": 6860.700000017881,
      "totalMs": 9989.09999999404,
      "grade": "slow",
      "imagesPerSecond": 0.14575772151491737,
      "artifactRevision": "a7df49d8de14b9d2e4504d1687b0d568f905fd8d",
      "engine": {
        "name": "Transformers.js",
        "version": "4.2.0"
      }
    }
  },
  {
    "precision": "fp16",
    "device": "wasm",
    "status": "pass",
    "quality": {
      "probeAccuracy": 1,
      "foregroundRatio": 0.25110238607247437,
      "passed": true,
      "visualization": true
    },
    "runtime": {
      "loadMs": 2159.4000000059605,
      "inferenceMs": 9181.40000000596,
      "totalMs": 12784.59999999404,
      "grade": "slow",
      "imagesPerSecond": 0.10891585161297306,
      "artifactRevision": "a7df49d8de14b9d2e4504d1687b0d568f905fd8d",
      "engine": {
        "name": "Transformers.js",
        "version": "4.2.0"
      }
    }
  },
  {
    "precision": "fp16",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "probeAccuracy": 1,
      "foregroundRatio": 0.25050186447657397,
      "passed": true,
      "visualization": true
    },
    "runtime": {
      "loadMs": 1742.4000000059605,
      "inferenceMs": 455.7000000178814,
      "totalMs": 3546.600000023842,
      "grade": "excellent",
      "imagesPerSecond": 2.19442615747369,
      "artifactRevision": "a7df49d8de14b9d2e4504d1687b0d568f905fd8d",
      "engine": {
        "name": "Transformers.js",
        "version": "4.2.0"
      }
    }
  }
]

SAM 2.1 Hiera-base-plus

4 configurations tested
Passed2
Failed2
TestedNov 4, 2026
RuntimeTransformers.js 4.2.0

Quality criteria

Expected dimensions, finite scores, whole-person foreground ratio 0.15–0.40, reference prompt inside, and 100% accuracy on independently annotated foreground/background probes.

PrecisionDeviceResult
FP16GPU · WebGPUAcceleratedPassedModerate
Q8GPU · WebGPUAcceleratedPassedVery slow
Q8CPU · WASMFailed—
FP16CPU · WASMFailed—
Test setup & sample details
Quality gate
Expected dimensions, finite scores, whole-person foreground ratio 0.15–0.40, reference prompt inside, and 100% accuracy on independently annotated foreground/background probes.
Tested
2026-11-04T16:43:23.405Z
Environment
Isolated Chrome module worker per case on macOS arm64; Transformers.js 4.2.0
Runtime
Transformers.js 4.2.0
Artifact revision
bab18593f44e652f04cf18b60b3690f60e8996b0
Fixture
{
  "file": "model-samples/sam2.1-hiera-tiny.json",
  "url": "https://f005.backblazeb2.com/file/hubters-webai-public/assets/benchmarks/sam2.1-hiera-tiny.json",
  "size": 1194,
  "sha1": "42420a6017382788ab3b1a6b078ed63f382f3b5e"
}
Rerun when
artifact revision change; runtime version change; fixture or quality gate change; browser/backend change
Per-case quality & failure details
[
  {
    "precision": "q8",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "probeAccuracy": 1,
      "foregroundRatio": 0.2459178829612006,
      "passed": true,
      "visualization": true
    },
    "runtime": {
      "loadMs": 1976.800000011921,
      "inferenceMs": 15797.09999999404,
      "totalMs": 19158.19999998808,
      "grade": "very-slow",
      "imagesPerSecond": 0.06330275810119436,
      "artifactRevision": "bab18593f44e652f04cf18b60b3690f60e8996b0",
      "engine": {
        "name": "Transformers.js",
        "version": "4.2.0"
      }
    },
    "failure": "Quality or 15-second interactive usability gate failed"
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "probeAccuracy": 1,
      "foregroundRatio": 0.2439847753477306,
      "passed": true,
      "visualization": true
    },
    "runtime": {
      "loadMs": 1938.5,
      "inferenceMs": 13092.5,
      "totalMs": 16497.5,
      "grade": "slow",
      "imagesPerSecond": 0.07637960664502577,
      "artifactRevision": "bab18593f44e652f04cf18b60b3690f60e8996b0",
      "engine": {
        "name": "Transformers.js",
        "version": "4.2.0"
      }
    }
  },
  {
    "precision": "fp16",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "probeAccuracy": 1,
      "foregroundRatio": 0.2450599949670571,
      "passed": true,
      "visualization": true
    },
    "runtime": {
      "loadMs": 2638,
      "inferenceMs": 16846.59999999404,
      "totalMs": 21474,
      "grade": "very-slow",
      "imagesPerSecond": 0.059359158524589756,
      "artifactRevision": "bab18593f44e652f04cf18b60b3690f60e8996b0",
      "engine": {
        "name": "Transformers.js",
        "version": "4.2.0"
      }
    },
    "failure": "Quality or 15-second interactive usability gate failed"
  },
  {
    "precision": "fp16",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "probeAccuracy": 1,
      "foregroundRatio": 0.2436158835102489,
      "passed": true,
      "visualization": true
    },
    "runtime": {
      "loadMs": 1909.5999999940395,
      "inferenceMs": 501.2000000178814,
      "totalMs": 3992.0999999940395,
      "grade": "excellent",
      "imagesPerSecond": 1.9952114923470128,
      "artifactRevision": "bab18593f44e652f04cf18b60b3690f60e8996b0",
      "engine": {
        "name": "Transformers.js",
        "version": "4.2.0"
      }
    }
  }
]

SAM 2.1 Large — Image Object Selection

34 configurations tested
Passed12
Failed22
TestedNov 6, 2026
RuntimeTransformers.js 4.2.0

Quality criteria

Both independently annotated refined person/dog prompts must meet original dimensions, finite scores, binary full masks,100% foreground/background probe accuracy and frozen area bounds. Maximum per-image15s WASM/5s WebGPU on these fixtures. Legacy single-point whole-person is diagnostic, with all failures retained.

PrecisionDeviceResult
Q4F16GPU · WebGPUAcceleratedPassedModerate
Q4F16GPU · WebGPUAcceleratedPassedModerate
FP16GPU · WebGPUAcceleratedPassedModerate
FP16GPU · WebGPUAcceleratedPassedModerate
Q4F16GPU · WebGPUAcceleratedPassedModerate
Q4GPU · WebGPUAcceleratedPassedModerate
Q4GPU · WebGPUAcceleratedPassedModerate
FP32GPU · WebGPUAcceleratedPassedModerate
FP32GPU · WebGPUAcceleratedPassedModerate
FP16GPU · WebGPUAcceleratedPassedModerate
Q4GPU · WebGPUAcceleratedPassedModerate
FP32GPU · WebGPUAcceleratedPassedSlow
FP32CPU · WASMFailed—
FP32CPU · WASMFailed—
FP32CPU · WASMFailed—
FP16CPU · WASMFailed—
FP16CPU · WASMFailed—
FP16CPU · WASMFailed—
Q8GPU · WebGPUFailed—
Q8GPU · WebGPUFailed—
Q8GPU · WebGPUFailed—
Q8CPU · WASMFailed—
Q8CPU · WASMFailed—
Q8CPU · WASMFailed—
INT8GPU · WebGPUFailed—
INT8GPU · WebGPUFailed—
INT8GPU · WebGPUFailed—
INT8CPU · WASMFailed—
UINT8GPU · WebGPUFailed—
UINT8CPU · WASMFailed—
Q4CPU · WASMFailed—
Q4F16CPU · WASMFailed—
BNB4GPU · WebGPUFailed—
BNB4CPU · WASMFailed—
Test setup & sample details
Quality gate
Both independently annotated refined person/dog prompts must meet original dimensions, finite scores, binary full masks,100% foreground/background probe accuracy and frozen area bounds. Maximum per-image15s WASM/5s WebGPU on these fixtures. Legacy single-point whole-person is diagnostic, with all failures retained.
Tested
2026-11-06T00:39:49.360Z
Environment
Apple M3Max/macOS27.2/Chrome;8actualartifactprecisions ×WebGPU/WASM;not broadsegmentationquality/platformcertification
Runtime
Transformers.js 4.2.0
Artifact revision
3c23431f721e69cae82dbfd0c28fd692cc714021
Fixture
{
  "file": "model-samples/browser/sam21-large/person-refine-fixture.json",
  "size": 1960,
  "sha1": "c8da4f97e3cdb98e4188a927d165d633bb40c8e9",
  "sha256": "36e5416e8b81d4795801d95f48e683560da4a034894b2a26ca96aa36c29f3a4a",
  "url": "https://assets.localai.tools/samples/v1/files/36e5416e8b81d4795801d95f48e683560da4a034894b2a26ca96aa36c29f3a4a/person-refine-fixture.json"
}
Rerun when
artifact revision change; runtime version change; fixture or quality gate change; browser/backend change
Per-case quality & failure details
[
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "usabilityPassed": true,
      "maximumInferenceMs": 5000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.2511881748718887,
      "previousShapeHarnessPassed": true,
      "shapeEvidence": "Original JPEG header dimensions supplied where native fixture omitted redundant width/height; actual output/timings unchanged."
    },
    "runtime": {
      "loadMs": 1801.5999999642372,
      "inferenceMs": 2222.300000011921,
      "totalMs": 4023.899999976158,
      "megapixelsPerSecond": 0.31471538495983814,
      "grade": "good",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "usabilityPassed": true,
      "maximumInferenceMs": 5000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.23863584370424598,
      "previousShapeHarnessPassed": true,
      "shapeEvidence": "Original JPEG header dimensions supplied where native fixture omitted redundant width/height; actual output/timings unchanged."
    },
    "runtime": {
      "loadMs": 1801.5999999642372,
      "inferenceMs": 1342.8999999761581,
      "totalMs": 3144.4999999403954,
      "megapixelsPerSecond": 0.5208072082898332,
      "grade": "good",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "fp32",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "usabilityPassed": true,
      "maximumInferenceMs": 5000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.37341421143847486,
      "previousShapeHarnessPassed": false,
      "shapeEvidence": "Original JPEG header dimensions supplied where native fixture omitted redundant width/height; actual output/timings unchanged."
    },
    "runtime": {
      "loadMs": 1801.5999999642372,
      "inferenceMs": 1267.5999999642372,
      "totalMs": 3069.1999999284744,
      "megapixelsPerSecond": 0.31863363838071573,
      "grade": "good",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "passed": false,
      "usabilityPassed": false,
      "maximumInferenceMs": 15000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.2511881748718887
    },
    "runtime": {
      "loadMs": 1890.2000000476837,
      "inferenceMs": 41974.39999997616,
      "totalMs": 43864.60000002384,
      "megapixelsPerSecond": 0.016662346573158814,
      "grade": "very-slow",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "passed": false,
      "usabilityPassed": false,
      "maximumInferenceMs": 15000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.23863584370424598
    },
    "runtime": {
      "loadMs": 1890.2000000476837,
      "inferenceMs": 41342.80000001192,
      "totalMs": 43233.000000059605,
      "megapixelsPerSecond": 0.016916899677810848,
      "grade": "very-slow",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "fp32",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "passed": false,
      "usabilityPassed": false,
      "maximumInferenceMs": 15000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.37341421143847486
    },
    "runtime": {
      "loadMs": 1890.2000000476837,
      "inferenceMs": 41556.69999998808,
      "totalMs": 43446.90000003576,
      "megapixelsPerSecond": 0.009719251047366992,
      "grade": "very-slow",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "fp16",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "usabilityPassed": true,
      "maximumInferenceMs": 5000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.2514541201500732
    },
    "runtime": {
      "loadMs": 1639.4000000357628,
      "inferenceMs": 1449.800000011921,
      "totalMs": 3089.2000000476837,
      "megapixelsPerSecond": 0.48240584907866557,
      "grade": "good",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "fp16",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "usabilityPassed": true,
      "maximumInferenceMs": 5000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.23924351436676428
    },
    "runtime": {
      "loadMs": 1639.4000000357628,
      "inferenceMs": 894.1999999880791,
      "totalMs": 2533.600000023842,
      "megapixelsPerSecond": 0.7821426973935628,
      "grade": "excellent",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "fp16",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "usabilityPassed": true,
      "maximumInferenceMs": 5000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.3736642733349839
    },
    "runtime": {
      "loadMs": 1639.4000000357628,
      "inferenceMs": 791.3999999761581,
      "totalMs": 2430.800000011921,
      "megapixelsPerSecond": 0.5103613849029163,
      "grade": "excellent",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "fp16",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "passed": false,
      "usabilityPassed": false,
      "maximumInferenceMs": 15000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.25117101711200585
    },
    "runtime": {
      "loadMs": 2685.300000011921,
      "inferenceMs": 43596.30000001192,
      "totalMs": 46281.60000002384,
      "megapixelsPerSecond": 0.016042462319045624,
      "grade": "very-slow",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "fp16",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "passed": false,
      "usabilityPassed": false,
      "maximumInferenceMs": 15000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.2385357567715959
    },
    "runtime": {
      "loadMs": 2685.300000011921,
      "inferenceMs": 43570.59999996424,
      "totalMs": 46255.89999997616,
      "megapixelsPerSecond": 0.01605192492186415,
      "grade": "very-slow",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "fp16",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "passed": false,
      "usabilityPassed": false,
      "maximumInferenceMs": 15000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.3734265907402822
    },
    "runtime": {
      "loadMs": 2685.300000011921,
      "inferenceMs": 43490.39999997616,
      "totalMs": 46175.69999998808,
      "megapixelsPerSecond": 0.009287107039719604,
      "grade": "very-slow",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "fail",
    "quality": {
      "passed": false,
      "usabilityPassed": false,
      "maximumInferenceMs": 5000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.24815411099926793
    },
    "runtime": {
      "loadMs": 1473.199999988079,
      "inferenceMs": 39413,
      "totalMs": 40886.19999998808,
      "megapixelsPerSecond": 0.017745210970999417,
      "grade": "very-slow",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "fail",
    "quality": {
      "passed": false,
      "usabilityPassed": false,
      "maximumInferenceMs": 5000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.23994412289531478
    },
    "runtime": {
      "loadMs": 1473.199999988079,
      "inferenceMs": 38580.80000001192,
      "totalMs": 40054,
      "megapixelsPerSecond": 0.018127980757262265,
      "grade": "very-slow",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "q8",
    "device": "webgpu",
    "status": "fail",
    "quality": {
      "passed": false,
      "usabilityPassed": false,
      "maximumInferenceMs": 5000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.37337212181232976
    },
    "runtime": {
      "loadMs": 1473.199999988079,
      "inferenceMs": 38229.69999998808,
      "totalMs": 39702.89999997616,
      "megapixelsPerSecond": 0.010565084214632234,
      "grade": "very-slow",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "passed": false,
      "usabilityPassed": false,
      "maximumInferenceMs": 15000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.24848153825036604
    },
    "runtime": {
      "loadMs": 1228.5,
      "inferenceMs": 42765.30000001192,
      "totalMs": 43993.80000001192,
      "megapixelsPerSecond": 0.016354193703769296,
      "grade": "very-slow",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "passed": false,
      "usabilityPassed": false,
      "maximumInferenceMs": 15000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.24060612646412885
    },
    "runtime": {
      "loadMs": 1228.5,
      "inferenceMs": 42998,
      "totalMs": 44226.5,
      "megapixelsPerSecond": 0.016265686776129124,
      "grade": "very-slow",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "q8",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "passed": false,
      "usabilityPassed": false,
      "maximumInferenceMs": 15000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.37361723198811586
    },
    "runtime": {
      "loadMs": 1228.5,
      "inferenceMs": 43066.19999998808,
      "totalMs": 44294.69999998808,
      "megapixelsPerSecond": 0.009378584597668514,
      "grade": "very-slow",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "int8",
    "device": "webgpu",
    "status": "fail",
    "quality": {
      "passed": false,
      "usabilityPassed": false,
      "maximumInferenceMs": 5000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.24775233345534406
    },
    "runtime": {
      "loadMs": 1520.199999988079,
      "inferenceMs": 39617.69999998808,
      "totalMs": 41137.89999997616,
      "megapixelsPerSecond": 0.017653523551347264,
      "grade": "very-slow",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "int8",
    "device": "webgpu",
    "status": "fail",
    "quality": {
      "passed": false,
      "usabilityPassed": false,
      "maximumInferenceMs": 5000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.24122523563323572
    },
    "runtime": {
      "loadMs": 1520.199999988079,
      "inferenceMs": 38841.40000003576,
      "totalMs": 40361.60000002384,
      "megapixelsPerSecond": 0.018006354044894264,
      "grade": "very-slow",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "int8",
    "device": "webgpu",
    "status": "fail",
    "quality": {
      "passed": false,
      "usabilityPassed": false,
      "maximumInferenceMs": 5000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.3731591978212429
    },
    "runtime": {
      "loadMs": 1520.199999988079,
      "inferenceMs": 39067.40000003576,
      "totalMs": 40587.60000002384,
      "megapixelsPerSecond": 0.010338543133139914,
      "grade": "very-slow",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "int8",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "passed": false,
      "usabilityPassed": false,
      "maximumInferenceMs": 15000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.2466699647693997
    },
    "runtime": {
      "loadMs": 1656.8999999761581,
      "inferenceMs": 43678,
      "totalMs": 45334.89999997616,
      "megapixelsPerSecond": 0.01601245478272815,
      "grade": "very-slow",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "uint8",
    "device": "webgpu",
    "status": "fail",
    "quality": {
      "passed": false,
      "usabilityPassed": false,
      "maximumInferenceMs": 5000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.24770657942898974
    },
    "runtime": {
      "loadMs": 1450,
      "inferenceMs": 38709.80000001192,
      "totalMs": 40159.80000001192,
      "megapixelsPerSecond": 0.018067569452691168,
      "grade": "very-slow",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "uint8",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "passed": false,
      "usabilityPassed": false,
      "maximumInferenceMs": 15000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.2481140762262079
    },
    "runtime": {
      "loadMs": 1028.2000000476837,
      "inferenceMs": 43081.19999998808,
      "totalMs": 44109.40000003576,
      "megapixelsPerSecond": 0.01623427388281184,
      "grade": "very-slow",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "usabilityPassed": true,
      "maximumInferenceMs": 5000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.25154133876281115
    },
    "runtime": {
      "loadMs": 964.6000000238419,
      "inferenceMs": 1959.199999988079,
      "totalMs": 2923.800000011921,
      "megapixelsPerSecond": 0.35697835851585114,
      "grade": "good",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "usabilityPassed": true,
      "maximumInferenceMs": 5000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.24650124679721816
    },
    "runtime": {
      "loadMs": 964.6000000238419,
      "inferenceMs": 1184,
      "totalMs": 2148.600000023842,
      "megapixelsPerSecond": 0.5907027027027028,
      "grade": "good",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "q4",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "usabilityPassed": true,
      "maximumInferenceMs": 5000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.37340430799702895
    },
    "runtime": {
      "loadMs": 964.6000000238419,
      "inferenceMs": 1075.2999999523163,
      "totalMs": 2039.8999999761581,
      "megapixelsPerSecond": 0.3756161071495497,
      "grade": "good",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "q4",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "passed": false,
      "usabilityPassed": false,
      "maximumInferenceMs": 15000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.25154133876281115
    },
    "runtime": {
      "loadMs": 948.3000000119209,
      "inferenceMs": 44357.40000003576,
      "totalMs": 45305.700000047684,
      "megapixelsPerSecond": 0.015767200061307385,
      "grade": "very-slow",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "q4f16",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "usabilityPassed": true,
      "maximumInferenceMs": 5000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.25167574121522696
    },
    "runtime": {
      "loadMs": 1354.5,
      "inferenceMs": 960.3999999761581,
      "totalMs": 2314.899999976158,
      "megapixelsPerSecond": 0.7282299042246589,
      "grade": "excellent",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "q4f16",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "usabilityPassed": true,
      "maximumInferenceMs": 5000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.2472833546852123
    },
    "runtime": {
      "loadMs": 1354.5,
      "inferenceMs": 736.1000000238419,
      "totalMs": 2090.600000023842,
      "megapixelsPerSecond": 0.9501317755431966,
      "grade": "excellent",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "q4f16",
    "device": "webgpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "usabilityPassed": true,
      "maximumInferenceMs": 5000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.37356771478088635
    },
    "runtime": {
      "loadMs": 1354.5,
      "inferenceMs": 716,
      "totalMs": 2070.5,
      "megapixelsPerSecond": 0.5641061452513967,
      "grade": "excellent",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "q4f16",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "passed": false,
      "usabilityPassed": false,
      "maximumInferenceMs": 15000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.25153704932284043
    },
    "runtime": {
      "loadMs": 2101.800000011921,
      "inferenceMs": 47017.89999997616,
      "totalMs": 49119.69999998808,
      "megapixelsPerSecond": 0.014875015685523059,
      "grade": "very-slow",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "bnb4",
    "device": "webgpu",
    "status": "fail",
    "quality": {
      "passed": false,
      "usabilityPassed": false,
      "maximumInferenceMs": 5000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.24986273792093705
    },
    "runtime": {
      "loadMs": 1017.5,
      "inferenceMs": 38631.69999998808,
      "totalMs": 39649.19999998808,
      "megapixelsPerSecond": 0.018104095859105756,
      "grade": "very-slow",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  },
  {
    "precision": "bnb4",
    "device": "wasm",
    "status": "fail",
    "quality": {
      "passed": false,
      "usabilityPassed": false,
      "maximumInferenceMs": 15000,
      "probeAccuracy": 1,
      "threshold": 1,
      "foregroundRatio": 0.24986273792093705
    },
    "runtime": {
      "loadMs": 840.6000000238419,
      "inferenceMs": 43907.80000001192,
      "totalMs": 44748.40000003576,
      "megapixelsPerSecond": 0.015928650490341357,
      "grade": "very-slow",
      "engine": "Transformers.js",
      "version": "4.2.0",
      "artifactRevision": "3c23431f721e69cae82dbfd0c28fd692cc714021"
    }
  }
]

Something not quite right?

Tell us what happened with SAM 2.1. Loading, results, or the page itself—we’re here for all of it.

Attachments Optional

Up to 3 files · 50 MB each

Browser, OS, CPU/GPU, memory, screen, storage, and network details are included automatically. Model inputs, results, and browsing history are not collected.