VitMatte Small Composition-1K — Trimap Matting
4 configurations testedQuality criteria
Finite original-size alpha in [0,1], non-degenerate foreground, mean absolute error <= 0.2 versus the local MODNet regression reference; trimap preserves certain foreground/background and marks the boundary unknown.
| Precision | Device | Result | |
|---|---|---|---|
FP32 | GPU · WebGPUAccelerated | Passed | Moderate |
Q8 | GPU · WebGPUAccelerated | Passed | Very slow |
Q8 | CPU · WASM | Passed | Very slow |
FP32 | CPU · WASM | Passed | Very slow |
Test setup & sample details
- Quality gate
- Finite original-size alpha in [0,1], non-degenerate foreground, mean absolute error <= 0.2 versus the local MODNet regression reference; trimap preserves certain foreground/background and marks the boundary unknown.
- Tested
- 2026-09-15T11:30:48.843Z
- Environment
- Isolated headless Chrome on macOS; Transformers.js 4.2.0
- Runtime
- Transformers.js 4.2.0
- Artifact revision
- 6bc1297f6140f055a227b6d2cfe8c093281f35d2
- Fixture
{ "file": "modnet-portrait-pexels-5965592.jpg", "url": "https://f005.backblazeb2.com/file/hubters-webai-public/assets/benchmarks/modnet-portrait-pexels-5965592.jpg", "size": 78124, "sha1": "38212739a4a4f0be25d84863cf991d7fb6c6d818", "width": 1024, "height": 683, "source": "https://www.pexels.com/photo/woman-wearing-pink-turtleneck-sweater-5965592/", "license": "Pexels License", "licenseUrl": "https://www.pexels.com/license/", "preprocessing": "RGB image through pinned processor; the checked-in 0/128/255 trimap is derived from the MODNet reference with an 8-pixel sampled boundary.", "reference": { "file": "modnet-portrait-pexels-5965592-mask.png", "url": "https://f005.backblazeb2.com/file/hubters-webai-public/assets/benchmarks/modnet-portrait-pexels-5965592-mask.png", "size": 67541, "sha1": "01ace4f95454ce44cc53c2c797a87a583c86cee8", "width": 1024, "height": 683 }, "trimap": { "file": "vitmatte-portrait-5965592-trimap.png", "url": "https://f005.backblazeb2.com/file/hubters-webai-public/assets/benchmarks/vitmatte-portrait-5965592-trimap.png", "size": 22459, "sha1": "64b06a53a2b0f33507093d2696911ec236a00396", "width": 1024, "height": 683 } }- Rerun when
- artifact revision change; runtime version change; fixture or quality-gate change; browser/backend behavior change
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "wasm",
"status": "pass",
"quality": {
"valid": true,
"meanAbsoluteError": 0.0033597094516932442,
"foregroundRatio": 0.25441955298316254,
"grade": "matting-pass"
},
"runtime": {
"loadMs": 6372.700000017881,
"inferenceMs": 9082,
"totalMs": 15585.600000023842,
"grade": "very-slow",
"imagesPerSecond": 0.11010790574763268
}
},
{
"precision": "fp32",
"device": "webgpu",
"status": "pass",
"quality": {
"valid": true,
"meanAbsoluteError": 0.003359716394162342,
"foregroundRatio": 0.25441955298316254,
"grade": "matting-pass"
},
"runtime": {
"loadMs": 7088.199999988079,
"inferenceMs": 661.8000000119209,
"totalMs": 7969.0999999940395,
"grade": "good",
"imagesPerSecond": 1.5110305227893428
}
},
{
"precision": "q8",
"device": "wasm",
"status": "pass",
"quality": {
"valid": true,
"meanAbsoluteError": 0.003484805486398143,
"foregroundRatio": 0.25471409452781846,
"grade": "matting-pass"
},
"runtime": {
"loadMs": 3443.300000011921,
"inferenceMs": 9065.299999982119,
"totalMs": 12636.899999976158,
"grade": "very-slow",
"imagesPerSecond": 0.11031074536992405
}
},
{
"precision": "q8",
"device": "webgpu",
"status": "pass",
"quality": {
"valid": true,
"meanAbsoluteError": 0.003507440455528697,
"foregroundRatio": 0.2546383144216691,
"grade": "matting-pass"
},
"runtime": {
"loadMs": 3362.5,
"inferenceMs": 7796,
"totalMs": 11286.90000000596,
"grade": "very-slow",
"imagesPerSecond": 0.12827090815802974
}
}
]