A model is still running

A model is still running or downloading. Leaving will stop the current operation. Stay on this page to let it finish.

Skip to content
LocalAI.toolsBeta

Join the waitlist

Get an email when the new apps and model runs launch.

No account needed.

BEN2 Desktop

Remove still-image backgrounds with the exact original BEN2 Base checkpoint and strict native PyTorch CPU/Apple Silicon MPS execution.

Desktop inferencePrivate · Runs on your computer
About this model

Remove still-image backgrounds with the exact original BEN2 Base checkpoint and strict native PyTorch CPU/Apple Silicon MPS execution.

Created by
Prama LLC
License
MIT
Model released
Unknown
Source repository created
Jan 22, 2025
Model weights · FP32
380.6 MB

Best for

  • Portrait and object foreground cutout experiments
  • Background replacement

Keep in mind

  • Native helper quality/repetition passes; managed DesktopAI and packaged app acceptance remain pending.

Processed on your deviceYour input is processed locally in the desktop app. Model and runtime files download from external hosts.

Target platforms · verification required

  • macos · aarch64, x86_64
  • windows · x86_64

Recommended configuration

FP32 · mps (verified platform only)

Sources & technical details
Original model
https://huggingface.co/PramaLLC/BEN2
Release verification
Unknown
Release evidence
Original checkpoint release day not established in bounded official source review; GitHub repository was created2025-01-28. Conversion/update dates are separate.
Source updated
Dec 31, 2025
Native model files
PramaLLC/BEN2
Files updated
Dec 31, 2025
Artifact revision
e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f

Desktop app

Sample result

BEN2 Base Desktop

Run BEN2 Desktop on your computer

Download the desktop app to load this model, provide input and view results locally.

Public desktop downloads are coming soon.

Device requirements

macOS Apple SiliconMPS / FP32Tested16.0 GiBRAM estimate
macOS Apple SiliconCPU / FP32Tested16.0 GiBRAM estimate
If your device falls short

MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.

GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.

PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.

Benchmark evidence

Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.

BEN2 Base Desktop

38 configurations tested
Passed38
Failed0
TestedNov 16, 2026
Runtimepytorch 2.10.0

Quality criteria

{ "version": 1, "scope": "Compatibility and portrait matte fidelity on the existing annotated portrait and its mirrored form; not broad segmentation certification", "fixture": "model-samples/modnet-portrait-pexels-5965592.jpg", "reference": "test-app/public/test-images/modnet-portrait-pexels-5965592-mask.png", "minimumIoU": 0.7, "maximumAlphaMAE": 0.16, "minimumBoundaryF1": 0.6, "boundaryTolerancePixels": 12, "minimumForegroundRecall": 0.85, "maximumWarmInferenceMs": 10000, "initializationTimeoutMs": 180000, "preprocessing": "Check original BEN2.py ImageNet-normalized Lanczos1024 first; retain published onnx_run.py unnormalized bilinear alternative as a separately identified diagnostic because the two official sources conflict.", "postprocessing": "Output is already sigmoid probability. Finite min-max normalize with constant-mask guard; resize to original width,height. Do not repeat the official onnx_run.py width/height interpolation inversion.", "nativePlan": "ONNX runtime1.23.2 CPU compatibility first; original reviewed Torch2.10 CPU/MPS if needed, exact retained app-managed runtime. No Transformers5.22.1 built-in BEN2 architecture. GPU claims require measured placement.", "repetitions": "Compatibility one cold process then recommend only after repeated timing and suite; failures terminate affected case." }

PrecisionDeviceResultPlatformInference / load
FP32mpsAcceleratedPassedFastmacos · aarch64554 ms / 385 ms
FP32mpsAcceleratedPassedFastmacos · aarch64556 ms / 404 ms
FP32mpsAcceleratedPassedFastmacos · aarch64557 ms / 404 ms
FP32mpsAcceleratedPassedFastmacos · aarch64560 ms / 404 ms
FP32mpsAcceleratedPassedFastmacos · aarch64560 ms / 404 ms
FP32mpsAcceleratedPassedFastmacos · aarch64561 ms / 404 ms
FP32mpsAcceleratedPassedFastmacos · aarch64562 ms / 386 ms
FP32mpsAcceleratedPassedFastmacos · aarch64562 ms / 386 ms
FP32mpsAcceleratedPassedFastmacos · aarch64562 ms / 385 ms
FP32mpsAcceleratedPassedFastmacos · aarch64562 ms / 385 ms
FP32mpsAcceleratedPassedFastmacos · aarch64564 ms / 385 ms
FP32mpsAcceleratedPassedFastmacos · aarch64564 ms / 386 ms
FP32mpsAcceleratedPassedFastmacos · aarch64566 ms / 386 ms
FP32mpsAcceleratedPassedFastmacos · aarch64566 ms / 385 ms
FP32mpsAcceleratedPassedFastmacos · aarch64582 ms / 386 ms
FP32mpsAcceleratedPassedFastmacos · aarch64778 ms / 404 ms
FP32mpsAcceleratedPassedFastmacos · aarch64786 ms / 385 ms
FP32mpsAcceleratedPassedFastmacos · aarch64805 ms / 386 ms
FP32mpsAcceleratedPassedFastmacos · aarch641038 ms / 393 ms
FP32cpuPassedModeratemacos · aarch643063 ms / 235 ms
FP32cpuPassedModeratemacos · aarch643068 ms / 227 ms
FP32cpuPassedModeratemacos · aarch643071 ms / 227 ms
FP32cpuPassedModeratemacos · aarch643082 ms / 232 ms
FP32cpuPassedModeratemacos · aarch643085 ms / 227 ms
FP32cpuPassedModeratemacos · aarch643088 ms / 232 ms
FP32cpuPassedModeratemacos · aarch643092 ms / 235 ms
FP32cpuPassedModeratemacos · aarch643097 ms / 235 ms
FP32cpuPassedModeratemacos · aarch643105 ms / 232 ms
FP32cpuPassedModeratemacos · aarch643107 ms / 235 ms
FP32cpuPassedModeratemacos · aarch643154 ms / 232 ms
FP32cpuPassedModeratemacos · aarch643155 ms / 227 ms
FP32cpuPassedModeratemacos · aarch643157 ms / 235 ms
FP32cpuPassedModeratemacos · aarch643160 ms / 227 ms
FP32cpuPassedModeratemacos · aarch643241 ms / 235 ms
FP32cpuPassedModeratemacos · aarch643251 ms / 232 ms
FP32cpuPassedModeratemacos · aarch643256 ms / 232 ms
FP32cpuPassedModeratemacos · aarch643270 ms / 227 ms
FP32cpuPassedModeratemacos · aarch643622 ms / 543 ms
Test setup & sample details
Quality gate
{ "version": 1, "scope": "Compatibility and portrait matte fidelity on the existing annotated portrait and its mirrored form; not broad segmentation certification", "fixture": "model-samples/modnet-portrait-pexels-5965592.jpg", "reference": "test-app/public/test-images/modnet-portrait-pexels-5965592-mask.png", "minimumIoU": 0.7, "maximumAlphaMAE": 0.16, "minimumBoundaryF1": 0.6, "boundaryTolerancePixels": 12, "minimumForegroundRecall": 0.85, "maximumWarmInferenceMs": 10000, "initializationTimeoutMs": 180000, "preprocessing": "Check original BEN2.py ImageNet-normalized Lanczos1024 first; retain published onnx_run.py unnormalized bilinear alternative as a separately identified diagnostic because the two official sources conflict.", "postprocessing": "Output is already sigmoid probability. Finite min-max normalize with constant-mask guard; resize to original width,height. Do not repeat the official onnx_run.py width/height interpolation inversion.", "nativePlan": "ONNX runtime1.23.2 CPU compatibility first; original reviewed Torch2.10 CPU/MPS if needed, exact retained app-managed runtime. No Transformers5.22.1 built-in BEN2 architecture. GPU claims require measured placement.", "repetitions": "Compatibility one cold process then recommend only after repeated timing and suite; failures terminate affected case." }
Tested
2026-11-16T11:41:19Z
Environment
Apple M3 Max /macOS27.2 /PyTorch2.10.0 /app-owned isolated CPython3.13.18 seed; helper qualification only
Runtime
pytorch 2.10.0
Artifact revision
e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f
Fixture
{
  "file": "model-samples/modnet-portrait-pexels-5965592.jpg",
  "size": 78124,
  "sha1": "38212739a4a4f0be25d84863cf991d7fb6c6d818",
  "sha256": "2b5d6423b8948eb53319661633039912afa6455a9055f0c984ff88eeae1b5bfe",
  "url": "https://assets.localai.tools/samples/v1/files/2b5d6423b8948eb53319661633039912afa6455a9055f0c984ff88eeae1b5bfe/modnet-portrait-pexels-5965592.jpg",
  "width": 1024,
  "height": 683
}
Rerun when
model artifact revision change; Transformers.js or ONNX Runtime version change; benchmark fixture, reference matte, or quality-gate change; target browser/backend behavior change
Per-case quality & failure details
[
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "id": "native-cpu",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156265475626562,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3240.509582999948,
      "durationMs": 3315.038624998124,
      "imagesPerSecond": 0.3085934401324114,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 1.71050000062678,
      "driverAllocatedMemoryBytes": null,
      "loadMs": 234.8862500002724,
      "totalMs": 3475.3958330002206,
      "grade": "acceptable",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "id": "native-cpu",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156265475626562,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3092.02754099897,
      "durationMs": 3156.151459003013,
      "imagesPerSecond": 0.32341238450836074,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "loadMs": 234.8862500002724,
      "totalMs": 3326.9137909992423,
      "grade": "acceptable",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "id": "native-cpu",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156265475626562,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3096.558499997627,
      "durationMs": 3160.61954199904,
      "imagesPerSecond": 0.32293915971578324,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "loadMs": 234.8862500002724,
      "totalMs": 3331.4447499978996,
      "grade": "acceptable",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "id": "native-cpu",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156265475626562,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3063.0117500004417,
      "durationMs": 3127.6987079982064,
      "imagesPerSecond": 0.32647605742937674,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "loadMs": 234.8862500002724,
      "totalMs": 3297.898000000714,
      "grade": "acceptable",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "id": "native-cpu",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156265475626562,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3107.217542001308,
      "durationMs": 3171.158582998032,
      "imagesPerSecond": 0.3218313447586667,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "loadMs": 234.8862500002724,
      "totalMs": 3342.1037920015806,
      "grade": "acceptable",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "id": "native-cpu",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156265475626562,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3157.4549159995513,
      "durationMs": 3222.3382080010197,
      "imagesPerSecond": 0.3167107770669249,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "loadMs": 234.8862500002724,
      "totalMs": 3392.3411659998237,
      "grade": "acceptable",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "id": "native-cpu",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156265475626562,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3269.7246670031745,
      "durationMs": 3343.761166997865,
      "imagesPerSecond": 0.30583614886342636,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 1.71549999868148,
      "driverAllocatedMemoryBytes": null,
      "loadMs": 227.45949999807635,
      "totalMs": 3497.184167001251,
      "grade": "acceptable",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "id": "native-cpu",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156265475626562,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3068.4579169974313,
      "durationMs": 3132.350249998126,
      "imagesPerSecond": 0.3258965992202777,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "loadMs": 227.45949999807635,
      "totalMs": 3295.9174169955077,
      "grade": "acceptable",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "id": "native-cpu",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156265475626562,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3159.77083299731,
      "durationMs": 3223.782916997152,
      "imagesPerSecond": 0.31647864761490163,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "loadMs": 227.45949999807635,
      "totalMs": 3387.2303329953866,
      "grade": "acceptable",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "id": "native-cpu",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156265475626562,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3070.989375002682,
      "durationMs": 3135.2552919997834,
      "imagesPerSecond": 0.3256279582533973,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "loadMs": 227.45949999807635,
      "totalMs": 3298.4488750007586,
      "grade": "acceptable",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "id": "native-cpu",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156265475626562,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3084.87900000182,
      "durationMs": 3149.5229590000235,
      "imagesPerSecond": 0.3241618228784371,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "loadMs": 227.45949999807635,
      "totalMs": 3312.338499999896,
      "grade": "acceptable",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "id": "native-cpu",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156265475626562,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3154.689499999222,
      "durationMs": 3219.109291003406,
      "imagesPerSecond": 0.31698840725854216,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "loadMs": 227.45949999807635,
      "totalMs": 3382.1489999972982,
      "grade": "acceptable",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "id": "native-cpu",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156265475626562,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3255.7030000025406,
      "durationMs": 3328.2595409982605,
      "imagesPerSecond": 0.3071533244891256,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 1.7040000020642765,
      "driverAllocatedMemoryBytes": null,
      "loadMs": 232.423249999556,
      "totalMs": 3488.1262500020966,
      "grade": "acceptable",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "id": "native-cpu",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156265475626562,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3088.3350410003914,
      "durationMs": 3152.286583001114,
      "imagesPerSecond": 0.32379906542655235,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "loadMs": 232.423249999556,
      "totalMs": 3320.7582909999473,
      "grade": "acceptable",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "id": "native-cpu",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156265475626562,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3251.1717909983417,
      "durationMs": 3315.2768750005635,
      "imagesPerSecond": 0.3075814088842499,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "loadMs": 232.423249999556,
      "totalMs": 3483.5950409978977,
      "grade": "acceptable",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "id": "native-cpu",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156265475626562,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3081.6968330000236,
      "durationMs": 3145.789000001969,
      "imagesPerSecond": 0.3244965530975033,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "loadMs": 232.423249999556,
      "totalMs": 3314.1200829995796,
      "grade": "acceptable",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "id": "native-cpu",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156265475626562,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3153.8753750028263,
      "durationMs": 3217.819707999297,
      "imagesPerSecond": 0.3170702329983802,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "loadMs": 232.423249999556,
      "totalMs": 3386.2986250023823,
      "grade": "acceptable",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "id": "native-cpu",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156265475626562,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 3104.92449999947,
      "durationMs": 3168.933417000517,
      "imagesPerSecond": 0.3220690229344291,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": null,
      "loadMs": 232.423249999556,
      "totalMs": 3337.347749999026,
      "grade": "acceptable",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "id": "native-mps",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156276689848706,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 778.2441660019686,
      "durationMs": 849.7565420002502,
      "imagesPerSecond": 1.2849437794532346,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 1.7061660000763368,
      "driverAllocatedMemoryBytes": 5975261184,
      "loadMs": 403.5935409992817,
      "totalMs": 1181.8377070012502,
      "grade": "good",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "id": "native-mps",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156276689848706,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 561.1634160013637,
      "durationMs": 626.410125001712,
      "imagesPerSecond": 1.7820121046479087,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 6512132096,
      "loadMs": 403.5935409992817,
      "totalMs": 964.7569570006453,
      "grade": "good",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "id": "native-mps",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156276689848706,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 560.3067079973698,
      "durationMs": 625.4732919987873,
      "imagesPerSecond": 1.7847367981264544,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 6512132096,
      "loadMs": 403.5935409992817,
      "totalMs": 963.9002489966515,
      "grade": "good",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "id": "native-mps",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156276689848706,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 556.5138749989273,
      "durationMs": 621.6292919998523,
      "imagesPerSecond": 1.79690039175021,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 6512132096,
      "loadMs": 403.5935409992817,
      "totalMs": 960.107415998209,
      "grade": "good",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "id": "native-mps",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156276689848706,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 556.448958999681,
      "durationMs": 621.6681669975515,
      "imagesPerSecond": 1.7971100202931158,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 6512132096,
      "loadMs": 403.5935409992817,
      "totalMs": 960.0424999989627,
      "grade": "good",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "id": "native-mps",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156276689848706,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 560.2808339972398,
      "durationMs": 625.7339170006162,
      "imagesPerSecond": 1.7848192180083147,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 6512132096,
      "loadMs": 403.5935409992817,
      "totalMs": 963.8743749965215,
      "grade": "good",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "id": "native-mps",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156276689848706,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 786.3682919996791,
      "durationMs": 858.5929590008163,
      "imagesPerSecond": 1.2716687717113702,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 1.7049589987436775,
      "driverAllocatedMemoryBytes": 5975277568,
      "loadMs": 385.10658299856004,
      "totalMs": 1171.474874998239,
      "grade": "good",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "id": "native-mps",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156276689848706,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 562.4899579997873,
      "durationMs": 627.5695840013213,
      "imagesPerSecond": 1.7778095160240677,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 6512132096,
      "loadMs": 385.10658299856004,
      "totalMs": 947.5965409983473,
      "grade": "good",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "id": "native-mps",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156276689848706,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 553.9846669998951,
      "durationMs": 619.1606249994948,
      "imagesPerSecond": 1.805104111302397,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 6512132096,
      "loadMs": 385.10658299856004,
      "totalMs": 939.0912499984552,
      "grade": "good",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "id": "native-mps",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156276689848706,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 562.3725420009578,
      "durationMs": 627.5810000006459,
      "imagesPerSecond": 1.778180699295765,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 6512132096,
      "loadMs": 385.10658299856004,
      "totalMs": 947.4791249995178,
      "grade": "good",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "id": "native-mps",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156276689848706,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 563.7285830016481,
      "durationMs": 629.1161669978464,
      "imagesPerSecond": 1.7739033111916493,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 6512132096,
      "loadMs": 385.10658299856004,
      "totalMs": 948.8351660002081,
      "grade": "good",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "id": "native-mps",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156276689848706,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 566.1182910007483,
      "durationMs": 631.8545000031008,
      "imagesPerSecond": 1.7664152808634093,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 6512132096,
      "loadMs": 385.10658299856004,
      "totalMs": 951.2248739993083,
      "grade": "good",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "id": "native-mps",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156276689848706,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 805.2730829986103,
      "durationMs": 877.372999999352,
      "imagesPerSecond": 1.2418147596294682,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 1.7039999984262977,
      "driverAllocatedMemoryBytes": 5975261184,
      "loadMs": 386.1663749994477,
      "totalMs": 1191.439457998058,
      "grade": "good",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "id": "native-mps",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156276689848706,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 564.3538750009611,
      "durationMs": 630.5239579996851,
      "imagesPerSecond": 1.7719378643378625,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 6512132096,
      "loadMs": 386.1663749994477,
      "totalMs": 950.5202500004089,
      "grade": "good",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "id": "native-mps",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156276689848706,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 561.548292000225,
      "durationMs": 628.8554169987037,
      "imagesPerSecond": 1.7807907427480862,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 6512132096,
      "loadMs": 386.1663749994477,
      "totalMs": 947.7146669996728,
      "grade": "good",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "id": "native-mps",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156276689848706,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 582.2772920000716,
      "durationMs": 649.4478749991686,
      "imagesPerSecond": 1.7173948112678195,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 6512132096,
      "loadMs": 386.1663749994477,
      "totalMs": 968.4436669995193,
      "grade": "good",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "id": "native-mps",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156276689848706,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 561.8795000009413,
      "durationMs": 629.6864590003679,
      "imagesPerSecond": 1.77974102987976,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 6512132096,
      "loadMs": 386.1663749994477,
      "totalMs": 948.0458750003891,
      "grade": "good",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "id": "native-mps",
      "iou": 0.9893696017508892,
      "boundaryF1": 0.9782789317507418,
      "foregroundRecall": 0.9923892833941892,
      "alphaMAE": 0.004156276689848706,
      "passed": true
    },
    "runtime": {
      "inferenceMs": 565.7362080019084,
      "durationMs": 634.1490000013437,
      "imagesPerSecond": 1.7676082701721414,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 0,
      "driverAllocatedMemoryBytes": 6512132096,
      "loadMs": 386.1663749994477,
      "totalMs": 951.9025830013561,
      "grade": "good",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false,
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "platform": "desktop",
      "device": "cpu",
      "id": "dog",
      "reused": false,
      "probeAccuracy": 1,
      "foregroundRatio": 0.3673632087150285,
      "probes": [
        {
          "point": [
            200,
            150
          ],
          "foreground": true,
          "passed": true
        },
        {
          "point": [
            350,
            200
          ],
          "foreground": true,
          "passed": true
        },
        {
          "point": [
            500,
            400
          ],
          "foreground": true,
          "passed": true
        },
        {
          "point": [
            0,
            0
          ],
          "foreground": false,
          "passed": true
        },
        {
          "point": [
            690,
            570
          ],
          "foreground": false,
          "passed": true
        },
        {
          "point": [
            680,
            10
          ],
          "foreground": false,
          "passed": true
        }
      ],
      "passed": true,
      "runtime": {
        "inferenceMs": 3622.0360410006833,
        "durationMs": 3700.0232499995036,
        "imagesPerSecond": 0.2760878104690873,
        "predictionDevice": "cpu",
        "implicitMpsFallback": false,
        "provider": "PyTorch CPU",
        "acceleration": "cpu",
        "visualizationMs": 2.146250000805594,
        "driverAllocatedMemoryBytes": null
      }
    },
    "runtime": {
      "inferenceMs": 3622.0360410006833,
      "durationMs": 3700.0232499995036,
      "imagesPerSecond": 0.2760878104690873,
      "predictionDevice": "cpu",
      "implicitMpsFallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "visualizationMs": 2.146250000805594,
      "driverAllocatedMemoryBytes": null,
      "loadMs": 542.8527499971096,
      "totalMs": 4164.888790997793,
      "grade": "acceptable",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "actualDevice": "cpu",
      "actualPrecision": "fp32",
      "requestedDevice": "cpu",
      "requestedPrecision": "fp32",
      "fallback": false,
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "platform": "desktop",
      "device": "mps",
      "id": "dog",
      "reused": false,
      "probeAccuracy": 1,
      "foregroundRatio": 0.3673632087150285,
      "probes": [
        {
          "point": [
            200,
            150
          ],
          "foreground": true,
          "passed": true
        },
        {
          "point": [
            350,
            200
          ],
          "foreground": true,
          "passed": true
        },
        {
          "point": [
            500,
            400
          ],
          "foreground": true,
          "passed": true
        },
        {
          "point": [
            0,
            0
          ],
          "foreground": false,
          "passed": true
        },
        {
          "point": [
            690,
            570
          ],
          "foreground": false,
          "passed": true
        },
        {
          "point": [
            680,
            10
          ],
          "foreground": false,
          "passed": true
        }
      ],
      "passed": true,
      "runtime": {
        "inferenceMs": 1037.7365409985941,
        "durationMs": 1105.9999579993018,
        "imagesPerSecond": 0.963635721102891,
        "predictionDevice": "mps:0",
        "implicitMpsFallback": false,
        "provider": "PyTorch MPS",
        "acceleration": "partial",
        "visualizationMs": 2.239292000012938,
        "driverAllocatedMemoryBytes": 5975261184
      }
    },
    "runtime": {
      "inferenceMs": 1037.7365409985941,
      "durationMs": 1105.9999579993018,
      "imagesPerSecond": 0.963635721102891,
      "predictionDevice": "mps:0",
      "implicitMpsFallback": false,
      "provider": "PyTorch MPS",
      "acceleration": "partial",
      "visualizationMs": 2.239292000012938,
      "driverAllocatedMemoryBytes": 5975261184,
      "loadMs": 393.3495419987594,
      "totalMs": 1431.0860829973535,
      "grade": "good",
      "engine": "pytorch",
      "version": "2.10.0",
      "artifactRevision": "e48a20765fb421d19dcdb0bf3cc61e802ca5ec8f",
      "actualDevice": "mps",
      "actualPrecision": "fp32",
      "requestedDevice": "mps",
      "requestedPrecision": "fp32",
      "fallback": false,
      "timingScope": "Model forward only; helper durationMs separately includes decode/matte/PNG/visualization. Cached weight initialization; process import/network transfer excluded."
    }
  }
]
Release validation still required
  • Complete dependency backup and cold model/runtime-source recovery remain pending.

Something not quite right?

Tell us what happened with BEN2 Desktop. Loading, results, or the page itself—we’re here for all of it.

Attachments Optional

Up to 3 files · 50 MB each

Browser, OS, CPU/GPU, memory, screen, storage, and network details are included automatically. Model inputs, results, and browsing history are not collected.