BiRefNet Desktop
Separates a foreground subject from an image locally with native ONNX Runtime and returns a transparent PNG plus an alpha mask.
Desktop app
Run BiRefNet Desktop on your computer
Download the desktop app to load this model, provide input and view results locally.
Public desktop downloads are coming soon.Device requirements
If your device falls short
MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.
GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.
PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.
Benchmark evidence
Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.
BiRefNet — Native Background Removal Desktop
36 configurations testedQuality criteria
{ "version": 1, "scope": "Small portrait compatibility/robustness suite, not broad segmentation accuracy", "fixtures": [ { "id": "portrait", "file": "model-samples/modnet-portrait-pexels-5965592.jpg", "reference": "test-app/public/test-images/modnet-portrait-pexels-5965592-mask.png", "minIoU": 0.7, "maxMeanAbsoluteAlphaError": 0.16 }, { "id": "portrait-mirrored", "derivedFrom": "portrait", "transform": "horizontal flip of input and retained reference", "minIoU": 0.7, "maxMeanAbsoluteAlphaError": 0.16 } ], "negativeInputs": [ "empty encoded bytes", "corrupt image", "unknown fields", "threshold out of range", "image above pixel/byte limit" ], "requirements": [ "finite mask", "nonempty foreground and background", "exact original dimensions", "valid RGBA PNG and grayscale mask" ] }
| Precision | Device | Result | Platform | Inference / load | Task metric | |
|---|---|---|---|---|---|---|
FP32 | cpu | Passed | Fast | macos · aarch64 | 5590 ms / 0 ms | 0.125 MP/s |
FP32 | cpu | Passed | Fast | macos · aarch64 | 5881 ms / 0 ms | 0.119 MP/s |
FP32 | cpu | Passed | Fast | macos · aarch64 | 5895 ms / 0 ms | 0.119 MP/s |
FP32 | cpu | Passed | Fast | macos · aarch64 | 6098 ms / 2148 ms | 0.115 MP/s |
FP32 | cpu | Passed | Fast | macos · aarch64 | 6133 ms / 2240 ms | 0.114 MP/s |
FP32 | cpu | Passed | Fast | macos · aarch64 | 6544 ms / 0 ms | 0.107 MP/s |
FP32 | cpu | Passed | Fast | macos · aarch64 | 6900 ms / 2209 ms | 0.101 MP/s |
FP16 | coreml | Passed | Fast | macos · aarch64 | 15466 ms / 0 ms | 0.045 MP/s |
FP16 | coreml | Passed | Fast | macos · aarch64 | 16186 ms / 0 ms | 0.043 MP/s |
FP16 | coreml | Passed | Fast | macos · aarch64 | 16378 ms / 0 ms | 0.043 MP/s |
FP16 | coreml | Passed | Fast | macos · aarch64 | 16494 ms / 12508 ms | 0.042 MP/s |
FP16 | coreml | Passed | Fast | macos · aarch64 | 17766 ms / 0 ms | 0.039 MP/s |
FP16 | coreml | Passed | Fast | macos · aarch64 | 17935 ms / 13930 ms | 0.039 MP/s |
FP16 | coreml | Passed | Fast | macos · aarch64 | 20439 ms / 12816 ms | 0.034 MP/s |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 5947 ms / 1672 ms | 0.118 MP/s |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 5957 ms / 1672 ms | 0.117 MP/s |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 6098 ms / 1672 ms | 0.115 MP/s |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 6204 ms / 1672 ms | 0.113 MP/s |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 7861 ms / 4088 ms | 0.089 MP/s |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 9184 ms / 1750 ms | 0.076 MP/s |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 9263 ms / 1750 ms | 0.076 MP/s |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 9317 ms / 1750 ms | 0.075 MP/s |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 9537 ms / 1750 ms | 0.073 MP/s |
FP16 | coreml | Passed | Slow | macos · aarch64 | 16116 ms / 12746 ms | 0.043 MP/s |
FP16 | coreml | Passed | Slow | macos · aarch64 | 16409 ms / 12746 ms | 0.043 MP/s |
FP16 | cpu | Passed | Slow | macos · aarch64 | 16537 ms / 1637 ms | 0.042 MP/s |
FP16 | coreml | Passed | Slow | macos · aarch64 | 16547 ms / 12746 ms | 0.042 MP/s |
FP16 | cpu | Passed | Slow | macos · aarch64 | 16570 ms / 1637 ms | 0.042 MP/s |
FP16 | coreml | Passed | Slow | macos · aarch64 | 16728 ms / 12746 ms | 0.042 MP/s |
FP16 | cpu | Passed | Slow | macos · aarch64 | 16769 ms / 1637 ms | 0.042 MP/s |
FP16 | cpu | Passed | Slow | macos · aarch64 | 17361 ms / 1637 ms | 0.040 MP/s |
FP32 | cpu | Passed | Slow | macos · aarch64 | 29658 ms / 1804 ms | 0.024 MP/s |
FP32 | cpu | Passed | Slow | macos · aarch64 | 30226 ms / 1804 ms | 0.023 MP/s |
FP32 | cpu | Passed | Slow | macos · aarch64 | 31270 ms / 1804 ms | 0.022 MP/s |
FP32 | cpu | Passed | Slow | macos · aarch64 | 32328 ms / 1804 ms | 0.022 MP/s |
FP32 | coreml | Failed | — | macos · aarch64 | — / — | — |
Test setup & sample details
- Quality gate
- { "version": 1, "scope": "Small portrait compatibility/robustness suite, not broad segmentation accuracy", "fixtures": [ { "id": "portrait", "file": "model-samples/modnet-portrait-pexels-5965592.jpg", "reference": "test-app/public/test-images/modnet-portrait-pexels-5965592-mask.png", "minIoU": 0.7, "maxMeanAbsoluteAlphaError": 0.16 }, { "id": "portrait-mirrored", "derivedFrom": "portrait", "transform": "horizontal flip of input and retained reference", "minIoU": 0.7, "maxMeanAbsoluteAlphaError": 0.16 } ], "negativeInputs": [ "empty encoded bytes", "corrupt image", "unknown fields", "threshold out of range", "image above pixel/byte limit" ], "requirements": [ "finite mask", "nonempty foreground and background", "exact original dimensions", "valid RGBA PNG and grayscale mask" ] }
- Tested
- 2026-11-02T11:09:33.230Z
- Environment
- { "os": "macos", "arch": "aarch64", "hardware": "Apple M3 Max", "runtimeProvisioning": "App-owned CPython3.13.18; model-owned pinned packages" }
- Runtime
- onnxruntime 1.23.2
- Artifact revision
- 534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67
- Fixture
{ "url": "https://assets.localai.tools/samples/v1/files/2b5d6423b8948eb53319661633039912afa6455a9055f0c984ff88eeae1b5bfe/modnet-portrait-pexels-5965592.jpg", "file": "model-samples/modnet-portrait-pexels-5965592.jpg", "size": 78124, "sha1": "38212739a4a4f0be25d84863cf991d7fb6c6d818" }- Rerun when
- ONNX artifact revision or runtime build/version change; Preprocessing, alpha postprocessing, fixture/reference or quality gate change; Host OS/hardware/provider compatibility change
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9934004436863872,
"meanAbsoluteAlphaError": 0.003595565212890506,
"minimumIoU": 0.7,
"maximumAlphaMae": 0.16,
"scope": "Frozen algorithm-reference portrait agreement; not human alpha ground truth"
},
"runtime": {
"acceleration": "cpu",
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
"coremlComputeUnits": null,
"cpuThreads": 8,
"device": "cpu",
"durationMs": 7051.082334000001,
"engine": "onnxruntime",
"fallback": false,
"fallbackReason": null,
"family": {
"catalogId": "birefnet",
"defaultModelId": "birefnet-native",
"displayName": "BiRefNet",
"id": "birefnet",
"variantId": "birefnet-default",
"variantName": "General"
},
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"inferenceMs": 6900.128250010312,
"loadMs": 2208.8568750000004,
"modelId": "birefnet-native",
"placement": {
"CPUExecutionProvider": 4781
},
"precision": "fp32",
"provider": "CPUExecutionProvider",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"reused": false,
"selectionReason": "Explicit device selection; actual placement is reported after inference",
"version": "1.23.2",
"totalMs": 9259.939209,
"grade": "good",
"megapixelsPerSecond": 0.10135927545969234
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9929692026563266,
"meanAbsoluteAlphaError": 0.0036524273455142975,
"minimumIoU": 0.7,
"maximumAlphaMae": 0.16,
"scope": "Frozen algorithm-reference portrait agreement; not human alpha ground truth"
},
"runtime": {
"acceleration": "cpu",
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
"coremlComputeUnits": null,
"cpuThreads": 8,
"device": "cpu",
"durationMs": 6689.009666999999,
"engine": "onnxruntime",
"fallback": false,
"fallbackReason": null,
"family": {
"catalogId": "birefnet",
"defaultModelId": "birefnet-native",
"displayName": "BiRefNet",
"id": "birefnet",
"variantId": "birefnet-default",
"variantName": "General"
},
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"inferenceMs": 6544.446625004639,
"loadMs": 0,
"modelId": "birefnet-native",
"placement": {
"CPUExecutionProvider": 4781
},
"precision": "fp32",
"provider": "CPUExecutionProvider",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"reused": false,
"selectionReason": "Explicit device selection; actual placement is reported after inference",
"version": "1.23.2",
"totalMs": 6689.009666999999,
"grade": "good",
"megapixelsPerSecond": 0.10686801193057392
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9934004436863872,
"meanAbsoluteAlphaError": 0.003595565212890506,
"minimumIoU": 0.7,
"maximumAlphaMae": 0.16,
"scope": "Frozen algorithm-reference portrait agreement; not human alpha ground truth"
},
"runtime": {
"acceleration": "cpu",
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
"coremlComputeUnits": null,
"cpuThreads": 8,
"device": "cpu",
"durationMs": 5691.34225,
"engine": "onnxruntime",
"fallback": false,
"fallbackReason": null,
"family": {
"catalogId": "birefnet",
"defaultModelId": "birefnet-native",
"displayName": "BiRefNet",
"id": "birefnet",
"variantId": "birefnet-default",
"variantName": "General"
},
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"inferenceMs": 5590.116417006357,
"loadMs": 0,
"modelId": "birefnet-native",
"placement": {
"CPUExecutionProvider": 4781
},
"precision": "fp32",
"provider": "CPUExecutionProvider",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"reused": false,
"selectionReason": "Explicit device selection; actual placement is reported after inference",
"version": "1.23.2",
"totalMs": 5691.34225,
"grade": "good",
"megapixelsPerSecond": 0.12511224236266288
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9934004436863872,
"meanAbsoluteAlphaError": 0.003595565212890506,
"minimumIoU": 0.7,
"maximumAlphaMae": 0.16,
"scope": "Frozen algorithm-reference portrait agreement; not human alpha ground truth"
},
"runtime": {
"acceleration": "cpu",
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
"coremlComputeUnits": null,
"cpuThreads": 8,
"device": "cpu",
"durationMs": 6285.246459,
"engine": "onnxruntime",
"fallback": false,
"fallbackReason": null,
"family": {
"catalogId": "birefnet",
"defaultModelId": "birefnet-native",
"displayName": "BiRefNet",
"id": "birefnet",
"variantId": "birefnet-default",
"variantName": "General"
},
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"inferenceMs": 6133.474415997625,
"loadMs": 2240.2006660000006,
"modelId": "birefnet-native",
"placement": {
"CPUExecutionProvider": 4781
},
"precision": "fp32",
"provider": "CPUExecutionProvider",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"reused": false,
"selectionReason": "Explicit device selection; actual placement is reported after inference",
"version": "1.23.2",
"totalMs": 8525.447125,
"grade": "good",
"megapixelsPerSecond": 0.11402868139073212
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9934004436863872,
"meanAbsoluteAlphaError": 0.003595565212890506,
"minimumIoU": 0.7,
"maximumAlphaMae": 0.16,
"scope": "Frozen algorithm-reference portrait agreement; not human alpha ground truth"
},
"runtime": {
"acceleration": "cpu",
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
"coremlComputeUnits": null,
"cpuThreads": 8,
"device": "cpu",
"durationMs": 5992.744625,
"engine": "onnxruntime",
"fallback": false,
"fallbackReason": null,
"family": {
"catalogId": "birefnet",
"defaultModelId": "birefnet-native",
"displayName": "BiRefNet",
"id": "birefnet",
"variantId": "birefnet-default",
"variantName": "General"
},
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"inferenceMs": 5894.694749993505,
"loadMs": 0,
"modelId": "birefnet-native",
"placement": {
"CPUExecutionProvider": 4781
},
"precision": "fp32",
"provider": "CPUExecutionProvider",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"reused": false,
"selectionReason": "Explicit device selection; actual placement is reported after inference",
"version": "1.23.2",
"totalMs": 5992.744625,
"grade": "good",
"megapixelsPerSecond": 0.11864770436175183
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9934004436863872,
"meanAbsoluteAlphaError": 0.003595565212890506,
"minimumIoU": 0.7,
"maximumAlphaMae": 0.16,
"scope": "Frozen algorithm-reference portrait agreement; not human alpha ground truth"
},
"runtime": {
"acceleration": "cpu",
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
"coremlComputeUnits": null,
"cpuThreads": 8,
"device": "cpu",
"durationMs": 6248.213625,
"engine": "onnxruntime",
"fallback": false,
"fallbackReason": null,
"family": {
"catalogId": "birefnet",
"defaultModelId": "birefnet-native",
"displayName": "BiRefNet",
"id": "birefnet",
"variantId": "birefnet-default",
"variantName": "General"
},
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"inferenceMs": 6097.706499989727,
"loadMs": 2148.0670000000027,
"modelId": "birefnet-native",
"placement": {
"CPUExecutionProvider": 4781
},
"precision": "fp32",
"provider": "CPUExecutionProvider",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"reused": false,
"selectionReason": "Explicit device selection; actual placement is reported after inference",
"version": "1.23.2",
"totalMs": 8396.280625000003,
"grade": "good",
"megapixelsPerSecond": 0.11469755062844995
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9934004436863872,
"meanAbsoluteAlphaError": 0.003595565212890506,
"minimumIoU": 0.7,
"maximumAlphaMae": 0.16,
"scope": "Frozen algorithm-reference portrait agreement; not human alpha ground truth"
},
"runtime": {
"acceleration": "cpu",
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
"coremlComputeUnits": null,
"cpuThreads": 8,
"device": "cpu",
"durationMs": 5987.626833,
"engine": "onnxruntime",
"fallback": false,
"fallbackReason": null,
"family": {
"catalogId": "birefnet",
"defaultModelId": "birefnet-native",
"displayName": "BiRefNet",
"id": "birefnet",
"variantId": "birefnet-default",
"variantName": "General"
},
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"inferenceMs": 5881.22758299869,
"loadMs": 0,
"modelId": "birefnet-native",
"placement": {
"CPUExecutionProvider": 4781
},
"precision": "fp32",
"provider": "CPUExecutionProvider",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"reused": false,
"selectionReason": "Explicit device selection; actual placement is reported after inference",
"version": "1.23.2",
"totalMs": 5987.626833,
"grade": "good",
"megapixelsPerSecond": 0.11891939057447554
}
},
{
"precision": "fp16",
"device": "coreml",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9934004436863872,
"meanAbsoluteAlphaError": 0.0035958345979452133,
"minimumIoU": 0.7,
"maximumAlphaMae": 0.16,
"scope": "Frozen algorithm-reference portrait agreement; not human alpha ground truth"
},
"runtime": {
"acceleration": "partial",
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
"coremlComputeUnits": "CPUAndGPU",
"cpuThreads": 4,
"device": "coreml",
"durationMs": 20590.324458000003,
"engine": "onnxruntime",
"fallback": false,
"fallbackReason": null,
"family": {
"catalogId": "birefnet",
"defaultModelId": "birefnet-native",
"displayName": "BiRefNet",
"id": "birefnet",
"variantId": "birefnet-default",
"variantName": "General"
},
"gpuPlanOperations": 45,
"gpuPlanSamples": [
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.041522",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.055363",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.041522",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.041522",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.055363"
],
"inferenceMs": 20438.721708007502,
"loadMs": 12815.646041,
"modelId": "birefnet-native",
"placement": {
"CPUExecutionProvider": 6098,
"CoreMLExecutionProvider": 139
},
"precision": "fp16",
"provider": "CoreMLExecutionProvider",
"requestedDevice": "coreml",
"requestedPrecision": "fp16",
"reused": false,
"selectionReason": "Explicit device selection; actual placement is reported after inference",
"version": "1.23.2",
"totalMs": 33405.970499,
"grade": "good",
"megapixelsPerSecond": 0.0342189697570955
}
},
{
"precision": "fp16",
"device": "coreml",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9929636707020173,
"meanAbsoluteAlphaError": 0.003651771228760481,
"minimumIoU": 0.7,
"maximumAlphaMae": 0.16,
"scope": "Frozen algorithm-reference portrait agreement; not human alpha ground truth"
},
"runtime": {
"acceleration": "partial",
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
"coremlComputeUnits": "CPUAndGPU",
"cpuThreads": 4,
"device": "coreml",
"durationMs": 17908.491667,
"engine": "onnxruntime",
"fallback": false,
"fallbackReason": null,
"family": {
"catalogId": "birefnet",
"defaultModelId": "birefnet-native",
"displayName": "BiRefNet",
"id": "birefnet",
"variantId": "birefnet-default",
"variantName": "General"
},
"gpuPlanOperations": 45,
"gpuPlanSamples": [
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.041522",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.055363",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.041522",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.041522",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.055363"
],
"inferenceMs": 17765.677250004956,
"loadMs": 0,
"modelId": "birefnet-native",
"placement": {
"CPUExecutionProvider": 6098,
"CoreMLExecutionProvider": 139
},
"precision": "fp16",
"provider": "CoreMLExecutionProvider",
"requestedDevice": "coreml",
"requestedPrecision": "fp16",
"reused": false,
"selectionReason": "Explicit device selection; actual placement is reported after inference",
"version": "1.23.2",
"totalMs": 17908.491667,
"grade": "good",
"megapixelsPerSecond": 0.03936759573856408
}
},
{
"precision": "fp16",
"device": "coreml",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9934004436863872,
"meanAbsoluteAlphaError": 0.0035958345979452133,
"minimumIoU": 0.7,
"maximumAlphaMae": 0.16,
"scope": "Frozen algorithm-reference portrait agreement; not human alpha ground truth"
},
"runtime": {
"acceleration": "partial",
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
"coremlComputeUnits": "CPUAndGPU",
"cpuThreads": 4,
"device": "coreml",
"durationMs": 16482.777416,
"engine": "onnxruntime",
"fallback": false,
"fallbackReason": null,
"family": {
"catalogId": "birefnet",
"defaultModelId": "birefnet-native",
"displayName": "BiRefNet",
"id": "birefnet",
"variantId": "birefnet-default",
"variantName": "General"
},
"gpuPlanOperations": 45,
"gpuPlanSamples": [
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.041522",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.055363",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.041522",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.041522",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7a69b5cb30> Apple M3 Max, Estimated Cost: 0.055363"
],
"inferenceMs": 16377.515208005208,
"loadMs": 0,
"modelId": "birefnet-native",
"placement": {
"CPUExecutionProvider": 6098,
"CoreMLExecutionProvider": 139
},
"precision": "fp16",
"provider": "CoreMLExecutionProvider",
"requestedDevice": "coreml",
"requestedPrecision": "fp16",
"reused": false,
"selectionReason": "Explicit device selection; actual placement is reported after inference",
"version": "1.23.2",
"totalMs": 16482.777416,
"grade": "good",
"megapixelsPerSecond": 0.04270440241497332
}
},
{
"precision": "fp16",
"device": "coreml",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9934004436863872,
"meanAbsoluteAlphaError": 0.0035958345979452133,
"minimumIoU": 0.7,
"maximumAlphaMae": 0.16,
"scope": "Frozen algorithm-reference portrait agreement; not human alpha ground truth"
},
"runtime": {
"acceleration": "partial",
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
"coremlComputeUnits": "CPUAndGPU",
"cpuThreads": 4,
"device": "coreml",
"durationMs": 16646.121375,
"engine": "onnxruntime",
"fallback": false,
"fallbackReason": null,
"family": {
"catalogId": "birefnet",
"defaultModelId": "birefnet-native",
"displayName": "BiRefNet",
"id": "birefnet",
"variantId": "birefnet-default",
"variantName": "General"
},
"gpuPlanOperations": 45,
"gpuPlanSamples": [
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x79fac54b30> Apple M3 Max, Estimated Cost: 0.041522",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x79fac54b30> Apple M3 Max, Estimated Cost: 0.055363",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x79fac54b30> Apple M3 Max, Estimated Cost: 0.041522",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x79fac54b30> Apple M3 Max, Estimated Cost: 0.041522",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x79fac54b30> Apple M3 Max, Estimated Cost: 0.055363"
],
"inferenceMs": 16494.358291995013,
"loadMs": 12507.695334000004,
"modelId": "birefnet-native",
"placement": {
"CPUExecutionProvider": 6098,
"CoreMLExecutionProvider": 139
},
"precision": "fp16",
"provider": "CoreMLExecutionProvider",
"requestedDevice": "coreml",
"requestedPrecision": "fp16",
"reused": false,
"selectionReason": "Explicit device selection; actual placement is reported after inference",
"version": "1.23.2",
"totalMs": 29153.816709000002,
"grade": "good",
"megapixelsPerSecond": 0.04240189206629679
}
},
{
"precision": "fp16",
"device": "coreml",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9934004436863872,
"meanAbsoluteAlphaError": 0.0035958345979452133,
"minimumIoU": 0.7,
"maximumAlphaMae": 0.16,
"scope": "Frozen algorithm-reference portrait agreement; not human alpha ground truth"
},
"runtime": {
"acceleration": "partial",
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
"coremlComputeUnits": "CPUAndGPU",
"cpuThreads": 4,
"device": "coreml",
"durationMs": 16287.758333,
"engine": "onnxruntime",
"fallback": false,
"fallbackReason": null,
"family": {
"catalogId": "birefnet",
"defaultModelId": "birefnet-native",
"displayName": "BiRefNet",
"id": "birefnet",
"variantId": "birefnet-default",
"variantName": "General"
},
"gpuPlanOperations": 45,
"gpuPlanSamples": [
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x79fac54b30> Apple M3 Max, Estimated Cost: 0.041522",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x79fac54b30> Apple M3 Max, Estimated Cost: 0.055363",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x79fac54b30> Apple M3 Max, Estimated Cost: 0.041522",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x79fac54b30> Apple M3 Max, Estimated Cost: 0.041522",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x79fac54b30> Apple M3 Max, Estimated Cost: 0.055363"
],
"inferenceMs": 16185.825957989437,
"loadMs": 0,
"modelId": "birefnet-native",
"placement": {
"CPUExecutionProvider": 6098,
"CoreMLExecutionProvider": 139
},
"precision": "fp16",
"provider": "CoreMLExecutionProvider",
"requestedDevice": "coreml",
"requestedPrecision": "fp16",
"reused": false,
"selectionReason": "Explicit device selection; actual placement is reported after inference",
"version": "1.23.2",
"totalMs": 16287.758333,
"grade": "good",
"megapixelsPerSecond": 0.04321015200677944
}
},
{
"precision": "fp16",
"device": "coreml",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9934004436863872,
"meanAbsoluteAlphaError": 0.0035958345979452133,
"minimumIoU": 0.7,
"maximumAlphaMae": 0.16,
"scope": "Frozen algorithm-reference portrait agreement; not human alpha ground truth"
},
"runtime": {
"acceleration": "partial",
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
"coremlComputeUnits": "CPUAndGPU",
"cpuThreads": 4,
"device": "coreml",
"durationMs": 18102.993208,
"engine": "onnxruntime",
"fallback": false,
"fallbackReason": null,
"family": {
"catalogId": "birefnet",
"defaultModelId": "birefnet-native",
"displayName": "BiRefNet",
"id": "birefnet",
"variantId": "birefnet-default",
"variantName": "General"
},
"gpuPlanOperations": 45,
"gpuPlanSamples": [
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x74c8a60b30> Apple M3 Max, Estimated Cost: 0.041522",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x74c8a60b30> Apple M3 Max, Estimated Cost: 0.055363",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x74c8a60b30> Apple M3 Max, Estimated Cost: 0.041522",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x74c8a60b30> Apple M3 Max, Estimated Cost: 0.041522",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x74c8a60b30> Apple M3 Max, Estimated Cost: 0.055363"
],
"inferenceMs": 17934.571125006187,
"loadMs": 13930.44862499999,
"modelId": "birefnet-native",
"placement": {
"CPUExecutionProvider": 6098,
"CoreMLExecutionProvider": 139
},
"precision": "fp16",
"provider": "CoreMLExecutionProvider",
"requestedDevice": "coreml",
"requestedPrecision": "fp16",
"reused": false,
"selectionReason": "Explicit device selection; actual placement is reported after inference",
"version": "1.23.2",
"totalMs": 32033.44183299999,
"grade": "good",
"megapixelsPerSecond": 0.0389968622681385
}
},
{
"precision": "fp16",
"device": "coreml",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9934004436863872,
"meanAbsoluteAlphaError": 0.0035958345979452133,
"minimumIoU": 0.7,
"maximumAlphaMae": 0.16,
"scope": "Frozen algorithm-reference portrait agreement; not human alpha ground truth"
},
"runtime": {
"acceleration": "partial",
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
"coremlComputeUnits": "CPUAndGPU",
"cpuThreads": 4,
"device": "coreml",
"durationMs": 15566.008791,
"engine": "onnxruntime",
"fallback": false,
"fallbackReason": null,
"family": {
"catalogId": "birefnet",
"defaultModelId": "birefnet-native",
"displayName": "BiRefNet",
"id": "birefnet",
"variantId": "birefnet-default",
"variantName": "General"
},
"gpuPlanOperations": 45,
"gpuPlanSamples": [
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x74c8a60b30> Apple M3 Max, Estimated Cost: 0.041522",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x74c8a60b30> Apple M3 Max, Estimated Cost: 0.055363",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x74c8a60b30> Apple M3 Max, Estimated Cost: 0.041522",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x74c8a60b30> Apple M3 Max, Estimated Cost: 0.041522",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x74c8a60b30> Apple M3 Max, Estimated Cost: 0.055363"
],
"inferenceMs": 15465.815042000031,
"loadMs": 0,
"modelId": "birefnet-native",
"placement": {
"CPUExecutionProvider": 6098,
"CoreMLExecutionProvider": 139
},
"precision": "fp16",
"provider": "CoreMLExecutionProvider",
"requestedDevice": "coreml",
"requestedPrecision": "fp16",
"reused": false,
"selectionReason": "Explicit device selection; actual placement is reported after inference",
"version": "1.23.2",
"totalMs": 15566.008791,
"grade": "good",
"megapixelsPerSecond": 0.04522180034486918
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"intersectionOverUnion": 0.9934004436863872,
"meanAbsoluteAlphaError": 0.003595565212890506,
"passed": true
},
"runtime": {
"acceleration": "cpu",
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67",
"coremlComputeUnits": null,
"cpuThreads": 8,
"device": "cpu",
"durationMs": 8103.189917,
"engine": "onnxruntime",
"fallback": false,
"fallbackReason": null,
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"inferenceMs": 7861.286750000545,
"loadMs": 4088.3054999999995,
"placement": {
"CPUExecutionProvider": 4781
},
"precision": "fp32",
"provider": "CPUExecutionProvider",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"reused": false,
"selectionReason": "Explicit device selection; actual placement is reported after inference",
"version": "1.23.2",
"totalMs": 12191.495416999998,
"grade": "moderate",
"megapixelsPerSecond": 0.08896660588038613
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"intersectionOverUnion": 0.9934004436863872,
"meanAbsoluteAlphaError": 0.003595565212890506,
"passed": true
},
"runtime": {
"durationMs": 9650.103458989179,
"inferenceMs": 9537.218083016342,
"engine": "onnxruntime",
"version": "1.23.2",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 4781
},
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"coremlComputeUnits": null,
"loadMs": 1750.281584012555,
"totalMs": 11400.385043001734,
"grade": "moderate",
"megapixelsPerSecond": 0.07333291468352403,
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"intersectionOverUnion": 0.9929692026563266,
"meanAbsoluteAlphaError": 0.0036524273455142975,
"passed": true
},
"runtime": {
"durationMs": 9385.465125000337,
"inferenceMs": 9316.74304101034,
"engine": "onnxruntime",
"version": "1.23.2",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 4781
},
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"coremlComputeUnits": null,
"loadMs": 1750.281584012555,
"totalMs": 11135.746709012892,
"grade": "moderate",
"megapixelsPerSecond": 0.07506829338551291,
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"intersectionOverUnion": 0.9934004436863872,
"meanAbsoluteAlphaError": 0.003595565212890506,
"passed": true
},
"runtime": {
"durationMs": 9331.89820899861,
"inferenceMs": 9262.828875012929,
"engine": "onnxruntime",
"version": "1.23.2",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 4781
},
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"coremlComputeUnits": null,
"loadMs": 1750.281584012555,
"totalMs": 11082.179793011164,
"grade": "moderate",
"megapixelsPerSecond": 0.0755052273379091,
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"intersectionOverUnion": 0.9934004436863872,
"meanAbsoluteAlphaError": 0.003595565212890506,
"passed": true
},
"runtime": {
"durationMs": 9252.401915990049,
"inferenceMs": 9184.013542020693,
"engine": "onnxruntime",
"version": "1.23.2",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 4781
},
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"coremlComputeUnits": null,
"loadMs": 1750.281584012555,
"totalMs": 11002.683500002604,
"grade": "moderate",
"megapixelsPerSecond": 0.0761531978148758,
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
}
},
{
"precision": "fp16",
"device": "coreml",
"status": "pass",
"quality": {
"intersectionOverUnion": 0.9934004436863872,
"meanAbsoluteAlphaError": 0.0035958345979452133,
"passed": true
},
"runtime": {
"durationMs": 16854.750583996065,
"inferenceMs": 16728.48433299805,
"engine": "onnxruntime",
"version": "1.23.2",
"provider": "CoreMLExecutionProvider",
"acceleration": "partial",
"placement": {
"CPUExecutionProvider": 6098,
"CoreMLExecutionProvider": 139
},
"gpuPlanOperations": 45,
"gpuPlanSamples": [
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.041522",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.055363",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.041522",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.041522",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.055363"
],
"coremlComputeUnits": "CPUAndGPU",
"loadMs": 12746.039084013319,
"totalMs": 29600.789668009384,
"grade": "slow",
"megapixelsPerSecond": 0.041808449951464086,
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
}
},
{
"precision": "fp16",
"device": "coreml",
"status": "pass",
"quality": {
"intersectionOverUnion": 0.9929636707020173,
"meanAbsoluteAlphaError": 0.003651771228760481,
"passed": true
},
"runtime": {
"durationMs": 16478.438707999885,
"inferenceMs": 16409.00995800621,
"engine": "onnxruntime",
"version": "1.23.2",
"provider": "CoreMLExecutionProvider",
"acceleration": "partial",
"placement": {
"CPUExecutionProvider": 6098,
"CoreMLExecutionProvider": 139
},
"gpuPlanOperations": 45,
"gpuPlanSamples": [
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.041522",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.055363",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.041522",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.041522",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.055363"
],
"coremlComputeUnits": "CPUAndGPU",
"loadMs": 12746.039084013319,
"totalMs": 29224.477792013204,
"grade": "slow",
"megapixelsPerSecond": 0.04262243741638757,
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
}
},
{
"precision": "fp16",
"device": "coreml",
"status": "pass",
"quality": {
"intersectionOverUnion": 0.9934004436863872,
"meanAbsoluteAlphaError": 0.0035958345979452133,
"passed": true
},
"runtime": {
"durationMs": 16615.748457988957,
"inferenceMs": 16546.533375018043,
"engine": "onnxruntime",
"version": "1.23.2",
"provider": "CoreMLExecutionProvider",
"acceleration": "partial",
"placement": {
"CPUExecutionProvider": 6098,
"CoreMLExecutionProvider": 139
},
"gpuPlanOperations": 45,
"gpuPlanSamples": [
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.041522",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.055363",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.041522",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.041522",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.055363"
],
"coremlComputeUnits": "CPUAndGPU",
"loadMs": 12746.039084013319,
"totalMs": 29361.787542002276,
"grade": "slow",
"megapixelsPerSecond": 0.042268189000600094,
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
}
},
{
"precision": "fp16",
"device": "coreml",
"status": "pass",
"quality": {
"intersectionOverUnion": 0.9934004436863872,
"meanAbsoluteAlphaError": 0.0035958345979452133,
"passed": true
},
"runtime": {
"durationMs": 16192.21620899043,
"inferenceMs": 16115.530500013847,
"engine": "onnxruntime",
"version": "1.23.2",
"provider": "CoreMLExecutionProvider",
"acceleration": "partial",
"placement": {
"CPUExecutionProvider": 6098,
"CoreMLExecutionProvider": 139
},
"gpuPlanOperations": 45,
"gpuPlanSamples": [
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.041522",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.055363",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.041522",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.041522",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x78ad7c8e20> Apple M3 Max, Estimated Cost: 0.055363"
],
"coremlComputeUnits": "CPUAndGPU",
"loadMs": 12746.039084013319,
"totalMs": 28938.25529300375,
"grade": "slow",
"megapixelsPerSecond": 0.04339863338655833,
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
}
},
{
"precision": "fp16",
"device": "cpu",
"status": "pass",
"quality": {
"intersectionOverUnion": 0.9933948697367981,
"meanAbsoluteAlphaError": 0.003596467897295952,
"passed": true
},
"runtime": {
"durationMs": 17484.155625017593,
"inferenceMs": 17361.20512499474,
"engine": "onnxruntime",
"version": "1.23.2",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 6459
},
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"coremlComputeUnits": null,
"loadMs": 1637.409499991918,
"totalMs": 19121.56512500951,
"grade": "slow",
"megapixelsPerSecond": 0.040284761049974166,
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
}
},
{
"precision": "fp16",
"device": "cpu",
"status": "pass",
"quality": {
"intersectionOverUnion": 0.9929636707020173,
"meanAbsoluteAlphaError": 0.003651389852166176,
"passed": true
},
"runtime": {
"durationMs": 16837.733416992705,
"inferenceMs": 16769.226250005886,
"engine": "onnxruntime",
"version": "1.23.2",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 6459
},
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"coremlComputeUnits": null,
"loadMs": 1637.409499991918,
"totalMs": 18475.142916984623,
"grade": "slow",
"megapixelsPerSecond": 0.04170687362511759,
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
}
},
{
"precision": "fp16",
"device": "cpu",
"status": "pass",
"quality": {
"intersectionOverUnion": 0.9933948697367981,
"meanAbsoluteAlphaError": 0.003596467897295952,
"passed": true
},
"runtime": {
"durationMs": 16607.06737500732,
"inferenceMs": 16536.870791984256,
"engine": "onnxruntime",
"version": "1.23.2",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 6459
},
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"coremlComputeUnits": null,
"loadMs": 1637.409499991918,
"totalMs": 18244.476874999236,
"grade": "slow",
"megapixelsPerSecond": 0.042292886532016016,
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
}
},
{
"precision": "fp16",
"device": "cpu",
"status": "pass",
"quality": {
"intersectionOverUnion": 0.9933948697367981,
"meanAbsoluteAlphaError": 0.003596467897295952,
"passed": true
},
"runtime": {
"durationMs": 16638.124666002113,
"inferenceMs": 16569.83391600079,
"engine": "onnxruntime",
"version": "1.23.2",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 6459
},
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"coremlComputeUnits": null,
"loadMs": 1637.409499991918,
"totalMs": 18275.53416599403,
"grade": "slow",
"megapixelsPerSecond": 0.042208751369838815,
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"intersectionOverUnion": 0.9934004436863872,
"meanAbsoluteAlphaError": 0.003595565212890506,
"passed": true
},
"runtime": {
"durationMs": 6321.10987501801,
"inferenceMs": 6204.315959010273,
"engine": "onnxruntime",
"version": "1.23.2",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 4781
},
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"coremlComputeUnits": null,
"loadMs": 1671.9599580101203,
"totalMs": 7993.06983302813,
"grade": "moderate",
"megapixelsPerSecond": 0.1127266897141661,
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"intersectionOverUnion": 0.9929692026563266,
"meanAbsoluteAlphaError": 0.0036524273455142975,
"passed": true
},
"runtime": {
"durationMs": 6027.188584004762,
"inferenceMs": 5956.907374988077,
"engine": "onnxruntime",
"version": "1.23.2",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 4781
},
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"coremlComputeUnits": null,
"loadMs": 1671.9599580101203,
"totalMs": 7699.148542014882,
"grade": "moderate",
"megapixelsPerSecond": 0.11740857394167555,
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"intersectionOverUnion": 0.9934004436863872,
"meanAbsoluteAlphaError": 0.003595565212890506,
"passed": true
},
"runtime": {
"durationMs": 6015.886708017206,
"inferenceMs": 5946.919000009075,
"engine": "onnxruntime",
"version": "1.23.2",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 4781
},
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"coremlComputeUnits": null,
"loadMs": 1671.9599580101203,
"totalMs": 7687.846666027326,
"grade": "moderate",
"megapixelsPerSecond": 0.11760577199705137,
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"intersectionOverUnion": 0.9934004436863872,
"meanAbsoluteAlphaError": 0.003595565212890506,
"passed": true
},
"runtime": {
"durationMs": 6168.159708002349,
"inferenceMs": 6098.144832998514,
"engine": "onnxruntime",
"version": "1.23.2",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 4781
},
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"coremlComputeUnits": null,
"loadMs": 1671.9599580101203,
"totalMs": 7840.11966601247,
"grade": "moderate",
"megapixelsPerSecond": 0.11468930619939088,
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"intersectionOverUnion": 0.9934004436863872,
"meanAbsoluteAlphaError": 0.003595565212890506,
"passed": true
},
"runtime": {
"durationMs": 32431.147041002987,
"inferenceMs": 32327.591999986907,
"engine": "onnxruntime",
"version": "1.23.2",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 4781
},
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"coremlComputeUnits": null,
"loadMs": 1803.6798750108574,
"totalMs": 34234.826916013844,
"grade": "slow",
"megapixelsPerSecond": 0.02163452198976909,
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"intersectionOverUnion": 0.9929692026563266,
"meanAbsoluteAlphaError": 0.0036524273455142975,
"passed": true
},
"runtime": {
"durationMs": 31338.489582994953,
"inferenceMs": 31269.53170800698,
"engine": "onnxruntime",
"version": "1.23.2",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 4781
},
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"coremlComputeUnits": null,
"loadMs": 1803.6798750108574,
"totalMs": 33142.16945800581,
"grade": "slow",
"megapixelsPerSecond": 0.0223665645693348,
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"intersectionOverUnion": 0.9934004436863872,
"meanAbsoluteAlphaError": 0.003595565212890506,
"passed": true
},
"runtime": {
"durationMs": 29727.222332992824,
"inferenceMs": 29658.449915994424,
"engine": "onnxruntime",
"version": "1.23.2",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 4781
},
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"coremlComputeUnits": null,
"loadMs": 1803.6798750108574,
"totalMs": 31530.90220800368,
"grade": "slow",
"megapixelsPerSecond": 0.023581542595145097,
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"intersectionOverUnion": 0.9934004436863872,
"meanAbsoluteAlphaError": 0.003595565212890506,
"passed": true
},
"runtime": {
"durationMs": 30295.55620800238,
"inferenceMs": 30226.36433300795,
"engine": "onnxruntime",
"version": "1.23.2",
"provider": "CPUExecutionProvider",
"acceleration": "cpu",
"placement": {
"CPUExecutionProvider": 4781
},
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"coremlComputeUnits": null,
"loadMs": 1803.6798750108574,
"totalMs": 32099.23608301324,
"grade": "slow",
"megapixelsPerSecond": 0.023138475811867534,
"artifactRevision": "534d3c82d3bb8b2f0867db6dfbc3a525b8e42f67"
}
},
{
"precision": "fp32",
"device": "coreml",
"status": "fail",
"quality": "Not embedded",
"runtime": "Not embedded",
"failure": "Initialization exceeded the 180-second candidate setup budget; probe terminated during CoreML subgraph compilation. No inference pass."
}
]BiRefNet Dynamic Desktop
73 configurations testedQuality criteria
{ "file": "research/birefnet-family-expansion/quality-gates.json", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "description": "Frozen complete PNG/dimensions/source-alpha, person/background interior, blank negative, and original reference IoU>=.7/MAE<=.16/boundaryF1>=.6. First forward<=20s, steady<=10s." }
| Precision | Device | Result | Platform | Inference / load | |
|---|---|---|---|---|---|
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 668 ms / 4144 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 676 ms / 4401 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 693 ms / 4166 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 711 ms / 4401 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 776 ms / 4144 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 786 ms / 4144 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 807 ms / 4401 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 808 ms / 4401 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 825 ms / 4401 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 826 ms / 4144 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 830 ms / 4401 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 853 ms / 4144 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 871 ms / 4144 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 882 ms / 4166 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 891 ms / 4166 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 901 ms / 4144 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 904 ms / 4401 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 914 ms / 4166 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 916 ms / 4166 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 944 ms / 4166 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 946 ms / 4166 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1091 ms / 4210 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1144 ms / 4401 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1150 ms / 4166 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1181 ms / 4191 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1191 ms / 4191 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1236 ms / 4144 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1241 ms / 4210 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1248 ms / 4171 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1253 ms / 4171 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1256 ms / 4210 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1292 ms / 4210 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1339 ms / 4171 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1347 ms / 4210 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1354 ms / 4191 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1355 ms / 4191 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1385 ms / 4191 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1385 ms / 4210 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1390 ms / 4191 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1405 ms / 4171 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1427 ms / 4171 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1466 ms / 4171 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1489 ms / 4191 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1567 ms / 4210 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1747 ms / 4171 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1792 ms / 4210 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1849 ms / 4171 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1997 ms / 4191 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7197 ms / 4047 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7202 ms / 4306 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7225 ms / 4306 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7233 ms / 4306 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7236 ms / 3941 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7251 ms / 4047 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7258 ms / 3941 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7276 ms / 3941 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7283 ms / 4306 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7308 ms / 3941 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7309 ms / 4047 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7326 ms / 4047 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7347 ms / 4306 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7352 ms / 4306 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7410 ms / 4047 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7427 ms / 3941 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7446 ms / 4047 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7474 ms / 3941 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7498 ms / 3941 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7523 ms / 4306 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7570 ms / 4047 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 8771 ms / 3941 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 8777 ms / 4306 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 8847 ms / 4047 ms |
BF16 | mps | Failed | — | Not recorded | — / 4147 ms |
Test setup & sample details
- Quality gate
- { "file": "research/birefnet-family-expansion/quality-gates.json", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "description": "Frozen complete PNG/dimensions/source-alpha, person/background interior, blank negative, and original reference IoU>=.7/MAE<=.16/boundaryF1>=.6. First forward<=20s, steady<=10s." }
- Tested
- 2026-11-13T05:48:11.367645+00:00
- Environment
- { "os": "macos", "osVersion": "27.2", "architecture": "aarch64", "hardware": "Apple M3 Max;Mac15,11;96GiB RAM", "cpu": "Apple M3 Max", "gpu": "Apple M3 Max", "driver": "OS-managed Metal/MPS macOS27.2 build26B118", "runtime": "App-owned CPython3.13.18;Torch2.10.0;Torchvision0.25.0;Transformers5.22.1;Timm1.0.22;Kornia0.8.2;Einops0.8.1", "timingScope": "Three fresh helper/model loads per pair. Five quality fixtures and three warm portrait calls each load. Full task duration in inferenceMs; synchronized forward retained in modelForwardMs. Local snapshot loads; no network-transfer or fully cold OS/shader claim.", "concurrentUploadActivity": "none; uploads excluded" }
- Runtime
- pytorch 2.10.0
- Artifact revision
- 280306042f57b7a33854319da62fd86aaa89ec4c
- Fixture
{ "file": "research/birefnet-family-expansion/quality-gates.json", "size": 4905, "sha1": "8bf1bfccd9061a4a4a696da3efcec57d86666ccb", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "url": "https://assets.localai.tools/samples/v1/files/585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897/quality-gates.json" }- Rerun when
- artifact revision change; runtime or reviewed architecture change; fixture or quality gate change; pre/postprocessing or backend behavior change
Per-case quality & failure details
[
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1143.5400830232538,
"durationMs": 1143.5400830232538,
"imagesPerSecond": 0.8744774362051505,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 1117.8373750299215,
"loadMs": 4401.398166955914,
"totalMs": 5544.938249979168,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 903.8532080012374,
"durationMs": 903.8532080012374,
"imagesPerSecond": 1.106374343917393,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 883.0992910079658,
"loadMs": 4401.398166955914,
"totalMs": 5305.251374957152,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 830.1981660188176,
"durationMs": 830.1981660188176,
"imagesPerSecond": 1.2045316900607723,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 807.6069169910625,
"loadMs": 4401.398166955914,
"totalMs": 5231.596332974732,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 808.3960830117576,
"durationMs": 808.3960830117576,
"imagesPerSecond": 1.2370173742980093,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 789.2180409980938,
"loadMs": 4401.398166955914,
"totalMs": 5209.794249967672,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9929067344232334,
"alphaMAE": 0.003487886621522691,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 807.4275410035625,
"durationMs": 807.4275410035625,
"imagesPerSecond": 1.2385012266947033,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 742.101666983217,
"loadMs": 4401.398166955914,
"totalMs": 5208.825707959477,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 676.1409160098992,
"durationMs": 676.1409160098992,
"imagesPerSecond": 1.4789816387703407,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 654.9899170058779,
"loadMs": 4401.398166955914,
"totalMs": 5077.539082965814,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 710.8488749945536,
"durationMs": 710.8488749945536,
"imagesPerSecond": 1.4067687734719447,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 690.0197920040227,
"loadMs": 4401.398166955914,
"totalMs": 5112.247041950468,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 824.643041996751,
"durationMs": 824.643041996751,
"imagesPerSecond": 1.2126458953423631,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 803.8812089944258,
"loadMs": 4401.398166955914,
"totalMs": 5226.041208952665,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1236.260708014015,
"durationMs": 1236.260708014015,
"imagesPerSecond": 0.8088908702812735,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 1209.9606249830686,
"loadMs": 4143.892832973506,
"totalMs": 5380.153540987521,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 825.9067079634406,
"durationMs": 825.9067079634406,
"imagesPerSecond": 1.2107905049782763,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 805.9035419719294,
"loadMs": 4143.892832973506,
"totalMs": 4969.799540936947,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 775.5312919616699,
"durationMs": 775.5312919616699,
"imagesPerSecond": 1.2894386214520719,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 754.5791249722242,
"loadMs": 4143.892832973506,
"totalMs": 4919.424124935176,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 871.4313340024091,
"durationMs": 871.4313340024091,
"imagesPerSecond": 1.147537345721878,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 852.1713329828344,
"loadMs": 4143.892832973506,
"totalMs": 5015.324166975915,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9929067344232334,
"alphaMAE": 0.003487886621522691,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 852.8617499978282,
"durationMs": 852.8617499978282,
"imagesPerSecond": 1.1725229792548986,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 789.9205420399085,
"loadMs": 4143.892832973506,
"totalMs": 4996.7545829713345,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 667.7241249708459,
"durationMs": 667.7241249708459,
"imagesPerSecond": 1.4976244868247974,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 646.5857500443235,
"loadMs": 4143.892832973506,
"totalMs": 4811.616957944352,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 786.072124959901,
"durationMs": 786.072124959901,
"imagesPerSecond": 1.2721478961628514,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 765.2488750172779,
"loadMs": 4143.892832973506,
"totalMs": 4929.964957933407,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 900.8344589965418,
"durationMs": 900.8344589965418,
"imagesPerSecond": 1.1100818691082497,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 879.962417006027,
"loadMs": 4143.892832973506,
"totalMs": 5044.727291970048,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1150.2603749977425,
"durationMs": 1150.2603749977425,
"imagesPerSecond": 0.8693683810519532,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 1123.7767499987967,
"loadMs": 4165.9869169816375,
"totalMs": 5316.24729197938,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 913.6763340211473,
"durationMs": 913.6763340211473,
"imagesPerSecond": 1.0944794811516423,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 893.4599999920465,
"loadMs": 4165.9869169816375,
"totalMs": 5079.663251002785,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 890.8400000073016,
"durationMs": 890.8400000073016,
"imagesPerSecond": 1.1225360333974717,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 869.2670000018552,
"loadMs": 4165.9869169816375,
"totalMs": 5056.826916988939,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 882.3005419690162,
"durationMs": 882.3005419690162,
"imagesPerSecond": 1.1334006412013709,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 859.8595830262639,
"loadMs": 4165.9869169816375,
"totalMs": 5048.287458950654,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9929067344232334,
"alphaMAE": 0.003487886621522691,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 946.0953749949113,
"durationMs": 946.0953749949113,
"imagesPerSecond": 1.0569758889323169,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 882.9766659764573,
"loadMs": 4165.9869169816375,
"totalMs": 5112.082291976549,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 692.7097499719821,
"durationMs": 692.7097499719821,
"imagesPerSecond": 1.443606070277554,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 671.8080830178224,
"loadMs": 4165.9869169816375,
"totalMs": 4858.69666695362,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 915.8691250486299,
"durationMs": 915.8691250486299,
"imagesPerSecond": 1.0918590578614635,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 894.9905000044964,
"loadMs": 4165.9869169816375,
"totalMs": 5081.856042030267,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 944.4287910009734,
"durationMs": 944.4287910009734,
"imagesPerSecond": 1.058841078891854,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 923.4444159665145,
"loadMs": 4165.9869169816375,
"totalMs": 5110.415707982611,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1567.4222920206375,
"durationMs": 1567.4222920206375,
"imagesPerSecond": 0.637990160718496,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 1541.755624988582,
"loadMs": 4209.6389579819515,
"totalMs": 5777.061250002589,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1292.1642910223454,
"durationMs": 1292.1642910223454,
"imagesPerSecond": 0.773895399329455,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 1272.2291669924743,
"loadMs": 4209.6389579819515,
"totalMs": 5501.803249004297,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1256.3299589673989,
"durationMs": 1256.3299589673989,
"imagesPerSecond": 0.7959692379077856,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 1235.3186249965802,
"loadMs": 4209.6389579819515,
"totalMs": 5465.96891694935,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1241.1330419708975,
"durationMs": 1241.1330419708975,
"imagesPerSecond": 0.8057153956774993,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 1221.4763750089332,
"loadMs": 4209.6389579819515,
"totalMs": 5450.771999952849,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9929122670158527,
"alphaMAE": 0.0034855428490942475,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1792.1967090223916,
"durationMs": 1792.1967090223916,
"imagesPerSecond": 0.5579744650605237,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 1727.284458000213,
"loadMs": 4209.6389579819515,
"totalMs": 6001.835667004343,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 1091.329083952587,
"durationMs": 1091.329083952587,
"imagesPerSecond": 0.916313891661523,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 1070.3183750156313,
"loadMs": 4209.6389579819515,
"totalMs": 5300.968041934539,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 1346.8766249716282,
"durationMs": 1346.8766249716282,
"imagesPerSecond": 0.7424585009937825,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 1325.9162500035018,
"loadMs": 4209.6389579819515,
"totalMs": 5556.51558295358,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 1384.7353750024922,
"durationMs": 1384.7353750024922,
"imagesPerSecond": 0.7221596400671141,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 1360.5582079617307,
"loadMs": 4209.6389579819515,
"totalMs": 5594.374332984444,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1747.4615829996765,
"durationMs": 1747.4615829996765,
"imagesPerSecond": 0.5722586463293855,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 1720.7183329737745,
"loadMs": 4170.872125017922,
"totalMs": 5918.333708017599,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1339.0550839831121,
"durationMs": 1339.0550839831121,
"imagesPerSecond": 0.7467952677685452,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 1317.0482080313377,
"loadMs": 4170.872125017922,
"totalMs": 5509.9272090010345,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1248.1082089943811,
"durationMs": 1248.1082089943811,
"imagesPerSecond": 0.8012125814040711,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 1226.833250024356,
"loadMs": 4170.872125017922,
"totalMs": 5418.9803340123035,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1427.2507499554195,
"durationMs": 1427.2507499554195,
"imagesPerSecond": 0.7006477313332891,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 1407.1452500065789,
"loadMs": 4170.872125017922,
"totalMs": 5598.122874973342,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9929122670158527,
"alphaMAE": 0.0034855428490942475,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1466.118166979868,
"durationMs": 1466.118166979868,
"imagesPerSecond": 0.6820732615706899,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 1401.630541018676,
"loadMs": 4170.872125017922,
"totalMs": 5636.99029199779,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 1252.8856670251116,
"durationMs": 1252.8856670251116,
"imagesPerSecond": 0.7981574267462324,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 1232.337708992418,
"loadMs": 4170.872125017922,
"totalMs": 5423.757792043034,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 1848.5712090041488,
"durationMs": 1848.5712090041488,
"imagesPerSecond": 0.5409583331868043,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 1827.3764159530401,
"loadMs": 4170.872125017922,
"totalMs": 6019.443334022071,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 1405.164625030011,
"durationMs": 1405.164625030011,
"imagesPerSecond": 0.7116603863968198,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 1384.2130419798195,
"loadMs": 4170.872125017922,
"totalMs": 5576.036750047933,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1180.9216249966994,
"durationMs": 1180.9216249966994,
"imagesPerSecond": 0.8467962469590604,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 1154.964542016387,
"loadMs": 4191.387333965395,
"totalMs": 5372.308958962094,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1390.3744159615599,
"durationMs": 1390.3744159615599,
"imagesPerSecond": 0.7192307255656862,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 1370.0469579780474,
"loadMs": 4191.387333965395,
"totalMs": 5581.7617499269545,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1997.4607499898411,
"durationMs": 1997.4607499898411,
"imagesPerSecond": 0.5006356195009518,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 1975.315416988451,
"loadMs": 4191.387333965395,
"totalMs": 6188.848083955236,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1353.8495000102557,
"durationMs": 1353.8495000102557,
"imagesPerSecond": 0.738634538028359,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 1334.8340000375174,
"loadMs": 4191.387333965395,
"totalMs": 5545.23683397565,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9929122670158527,
"alphaMAE": 0.0034855428490942475,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1488.8332089758478,
"durationMs": 1488.8332089758478,
"imagesPerSecond": 0.6716669093429808,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 1425.4039999796078,
"loadMs": 4191.387333965395,
"totalMs": 5680.2205429412425,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 1190.591708989814,
"durationMs": 1190.591708989814,
"imagesPerSecond": 0.8399184980453744,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 1169.5612909970805,
"loadMs": 4191.387333965395,
"totalMs": 5381.979042955209,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 1355.1840839791112,
"durationMs": 1355.1840839791112,
"imagesPerSecond": 0.7379071314531569,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 1334.1992089990526,
"loadMs": 4191.387333965395,
"totalMs": 5546.571417944506,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 1384.6217920072377,
"durationMs": 1384.6217920072377,
"imagesPerSecond": 0.7222188801104561,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 1362.953917006962,
"loadMs": 4191.387333965395,
"totalMs": 5576.009125972632,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 7522.509792004712,
"durationMs": 7522.509792004712,
"imagesPerSecond": 0.13293435670404158,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7497.23370897118,
"loadMs": 4306.0543749597855,
"totalMs": 11828.564166964497,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 7232.7415000181645,
"durationMs": 7232.7415000181645,
"imagesPerSecond": 0.13826016041047348,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7214.177874964662,
"loadMs": 4306.0543749597855,
"totalMs": 11538.79587497795,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 7201.836625055876,
"durationMs": 7201.836625055876,
"imagesPerSecond": 0.13885346919991282,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7181.530624977313,
"loadMs": 4306.0543749597855,
"totalMs": 11507.891000015661,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 8776.635333022568,
"durationMs": 8776.635333022568,
"imagesPerSecond": 0.11393887999851669,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 8758.623459027149,
"loadMs": 4306.0543749597855,
"totalMs": 13082.689707982354,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9929122670158527,
"alphaMAE": 0.0034855428490942475,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 7352.407249971293,
"durationMs": 7352.407249971293,
"imagesPerSecond": 0.13600987622168298,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7291.032749984879,
"loadMs": 4306.0543749597855,
"totalMs": 11658.461624931078,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 7347.254167019855,
"durationMs": 7347.254167019855,
"imagesPerSecond": 0.13610526834484254,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7327.675292035565,
"loadMs": 4306.0543749597855,
"totalMs": 11653.30854197964,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 7224.999083031435,
"durationMs": 7224.999083031435,
"imagesPerSecond": 0.13840832206450943,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7205.208584025968,
"loadMs": 4306.0543749597855,
"totalMs": 11531.05345799122,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 7283.142416970804,
"durationMs": 7283.142416970804,
"imagesPerSecond": 0.13730337026910958,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7263.276707963087,
"loadMs": 4306.0543749597855,
"totalMs": 11589.19679193059,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 7498.0128750321455,
"durationMs": 7498.0128750321455,
"imagesPerSecond": 0.1333686693617091,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7472.654958954081,
"loadMs": 3940.6678329687566,
"totalMs": 11438.680708000902,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 7308.164583984762,
"durationMs": 7308.164583984762,
"imagesPerSecond": 0.13683326210132393,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7289.843834005296,
"loadMs": 3940.6678329687566,
"totalMs": 11248.832416953519,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 7258.489500032738,
"durationMs": 7258.489500032738,
"imagesPerSecond": 0.1377697109013507,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7238.934375054669,
"loadMs": 3940.6678329687566,
"totalMs": 11199.157333001494,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 8771.157291950658,
"durationMs": 8771.157291950658,
"imagesPerSecond": 0.11401004071808242,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 8753.34820797434,
"loadMs": 3940.6678329687566,
"totalMs": 12711.825124919415,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9929122670158527,
"alphaMAE": 0.0034855428490942475,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 7275.62383300392,
"durationMs": 7275.62383300392,
"imagesPerSecond": 0.1374452587094687,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7212.508333032019,
"loadMs": 3940.6678329687566,
"totalMs": 11216.291665972676,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 7473.5780420014635,
"durationMs": 7473.5780420014635,
"imagesPerSecond": 0.13380471768408733,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7454.076582973357,
"loadMs": 3940.6678329687566,
"totalMs": 11414.24587497022,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 7427.145167021081,
"durationMs": 7427.145167021081,
"imagesPerSecond": 0.13464123529459507,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7407.451208971906,
"loadMs": 3940.6678329687566,
"totalMs": 11367.812999989837,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 7235.661750019062,
"durationMs": 7235.661750019062,
"imagesPerSecond": 0.1382043598151013,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7216.187332989648,
"loadMs": 3940.6678329687566,
"totalMs": 11176.329582987819,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 7569.658791995607,
"durationMs": 7569.658791995607,
"imagesPerSecond": 0.13210635082487882,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7544.580666988622,
"loadMs": 4046.5578750008717,
"totalMs": 11616.216666996479,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 7197.010458970908,
"durationMs": 7197.010458970908,
"imagesPerSecond": 0.13894658145918393,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7178.56379202567,
"loadMs": 4046.5578750008717,
"totalMs": 11243.56833397178,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 7251.346083998214,
"durationMs": 7251.346083998214,
"imagesPerSecond": 0.13790543002860298,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7231.689708016347,
"loadMs": 4046.5578750008717,
"totalMs": 11297.903958999086,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 8847.449249995407,
"durationMs": 8847.449249995407,
"imagesPerSecond": 0.1130269269417419,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 8829.456334002316,
"loadMs": 4046.5578750008717,
"totalMs": 12894.007124996278,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9929122670158527,
"alphaMAE": 0.0034855428490942475,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 7309.233625011984,
"durationMs": 7309.233625011984,
"imagesPerSecond": 0.136813249008491,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7247.184749983717,
"loadMs": 4046.5578750008717,
"totalMs": 11355.791500012856,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 7446.180958009791,
"durationMs": 7446.180958009791,
"imagesPerSecond": 0.1342970316782738,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7426.434165972751,
"loadMs": 4046.5578750008717,
"totalMs": 11492.738833010662,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 7410.129958996549,
"durationMs": 7410.129958996549,
"imagesPerSecond": 0.13495039972759346,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7390.614999982063,
"loadMs": 4046.5578750008717,
"totalMs": 11456.687833997421,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 7325.882334029302,
"durationMs": 7325.882334029302,
"imagesPerSecond": 0.1365023289215172,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7306.301292032003,
"loadMs": 4046.5578750008717,
"totalMs": 11372.440209030174,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "bf16",
"device": "mps",
"status": "fail",
"quality": {
"passed": false,
"error": "{'ok': False, 'code': 'runtime_error', 'error': 'Failed to create function state object for: deformable_im2col_bfloat', 'traceback': 'Traceback (most recent call last):\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 49, in <module>\\n with contextlib.redirect_stdout(sys.stderr):v=init(r)if r[\\'type\\']==\\'init\\'else {\\'healthy\\':net is not None}if r[\\'type\\']==\\'health\\'else generate(r)\\n ~~~~~~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 36, in generate\\n with torch.inference_mode():logits=net(x)[-1];matte=logits.float().sigmoid()\\n ~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2063, in forward\\n scaled_preds, class_preds = self.forward_ori(x)\\n ~~~~~~~~~~~~~~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2054, in forward_ori\\n x4 = self.squeeze_module(x4)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/container.py\", line 253, in forward\\n input = module(input)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1436, in forward\\n x = self.dec_att(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1612, in forward\\n x1 = self.aspp1(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1583, in forward\\n x = self.atrous_conv(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1290, in forward\\n x = deform_conv2d(\\n input=x,\\n ...<5 lines>...\\n stride=self.stride,\\n )\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torchvision/ops/deform_conv.py\", line 92, in deform_conv2d\\n return torch.ops.torchvision.deform_conv2d(\\n ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^\\n input,\\n ^^^^^^\\n ...<12 lines>...\\n use_mask,\\n ^^^^^^^^^\\n )\\n ^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/_ops.py\", line 1209, in __call__\\n return self._op(*args, **kwargs)\\n ~~~~~~~~^^^^^^^^^^^^^^^^^\\nRuntimeError: Failed to create function state object for: deformable_im2col_bfloat\\n'}",
"individualFixturePassedBeforeConfigurationGate": false
},
"runtime": {
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "280306042f57b7a33854319da62fd86aaa89ec4c",
"requestedDevice": "mps",
"requestedPrecision": "bf16",
"cpuThreads": 4,
"fallback": false,
"loadMs": 4147.066084027756
},
"failure": "{'ok': False, 'code': 'runtime_error', 'error': 'Failed to create function state object for: deformable_im2col_bfloat', 'traceback': 'Traceback (most recent call last):\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 49, in <module>\\n with contextlib.redirect_stdout(sys.stderr):v=init(r)if r[\\'type\\']==\\'init\\'else {\\'healthy\\':net is not None}if r[\\'type\\']==\\'health\\'else generate(r)\\n ~~~~~~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 36, in generate\\n with torch.inference_mode():logits=net(x)[-1];matte=logits.float().sigmoid()\\n ~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2063, in forward\\n scaled_preds, class_preds = self.forward_ori(x)\\n ~~~~~~~~~~~~~~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2054, in forward_ori\\n x4 = self.squeeze_module(x4)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/container.py\", line 253, in forward\\n input = module(input)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1436, in forward\\n x = self.dec_att(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1612, in forward\\n x1 = self.aspp1(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1583, in forward\\n x = self.atrous_conv(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1290, in forward\\n x = deform_conv2d(\\n input=x,\\n ...<5 lines>...\\n stride=self.stride,\\n )\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torchvision/ops/deform_conv.py\", line 92, in deform_conv2d\\n return torch.ops.torchvision.deform_conv2d(\\n ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^\\n input,\\n ^^^^^^\\n ...<12 lines>...\\n use_mask,\\n ^^^^^^^^^\\n )\\n ^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/_ops.py\", line 1209, in __call__\\n return self._op(*args, **kwargs)\\n ~~~~~~~~^^^^^^^^^^^^^^^^^\\nRuntimeError: Failed to create function state object for: deformable_im2col_bfloat\\n'}"
}
]BiRefNet Dynamic Matting Desktop
72 configurations testedQuality criteria
{ "file": "research/birefnet-family-expansion/quality-gates.json", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "description": "Frozen complete PNG/dimensions/source-alpha, person/background interior, blank negative, and original reference IoU>=.7/MAE<=.16/boundaryF1>=.6. First forward<=20s, steady<=10s." }
| Precision | Device | Result | Platform | Inference / load | |
|---|---|---|---|---|---|
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 554 ms / 4448 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 557 ms / 4448 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 558 ms / 5517 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 558 ms / 4448 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 560 ms / 4448 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 561 ms / 4448 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 561 ms / 5517 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 562 ms / 5517 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 563 ms / 5517 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 563 ms / 5517 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 565 ms / 4448 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 566 ms / 4209 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 567 ms / 5517 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 567 ms / 4209 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 567 ms / 4209 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 569 ms / 4209 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 579 ms / 4209 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 580 ms / 4209 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 600 ms / 4448 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 607 ms / 5517 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 613 ms / 4209 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 647 ms / 4270 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 648 ms / 4364 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 648 ms / 4270 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 649 ms / 4270 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 649 ms / 4270 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 650 ms / 4364 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 651 ms / 4270 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 652 ms / 4364 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 656 ms / 4279 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 658 ms / 4279 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 658 ms / 4279 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 658 ms / 4270 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 659 ms / 4364 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 659 ms / 4364 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 660 ms / 4279 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 661 ms / 4279 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 669 ms / 4364 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 674 ms / 4279 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 696 ms / 4270 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 698 ms / 4279 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 700 ms / 4364 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 833 ms / 4448 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 893 ms / 4270 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 920 ms / 4209 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 960 ms / 4279 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 965 ms / 5517 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 991 ms / 4364 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7369 ms / 5595 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7412 ms / 5187 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7415 ms / 5187 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7452 ms / 5595 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7464 ms / 5950 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7489 ms / 5595 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7501 ms / 5950 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7512 ms / 5950 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7533 ms / 5595 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7559 ms / 5595 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7560 ms / 5950 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7615 ms / 5187 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7623 ms / 5595 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7623 ms / 5950 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7648 ms / 5187 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7654 ms / 5595 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7700 ms / 5187 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7735 ms / 5187 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7923 ms / 5950 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 7949 ms / 5187 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 8008 ms / 5950 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 8976 ms / 5187 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 9031 ms / 5950 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 9258 ms / 5595 ms |
Test setup & sample details
- Quality gate
- { "file": "research/birefnet-family-expansion/quality-gates.json", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "description": "Frozen complete PNG/dimensions/source-alpha, person/background interior, blank negative, and original reference IoU>=.7/MAE<=.16/boundaryF1>=.6. First forward<=20s, steady<=10s." }
- Tested
- 2026-11-13T06:24:39.323952+00:00
- Environment
- { "os": "macos", "osVersion": "27.2", "architecture": "aarch64", "hardware": "Apple M3 Max;Mac15,11;96GiB RAM", "cpu": "Apple M3 Max", "gpu": "Apple M3 Max", "driver": "OS-managed Metal/MPS macOS27.2 build26B118", "runtime": "App-owned CPython3.13.18;Torch2.10.0;Torchvision0.25.0;Transformers5.22.1;Timm1.0.22;Kornia0.8.2;Einops0.8.1", "timingScope": "Three fresh helper/model loads per pair. Five quality fixtures and three warm portrait calls each load. Full task duration in inferenceMs; synchronized forward retained in modelForwardMs. Local snapshot loads; no network-transfer or fully cold OS/shader claim.", "concurrentUploadActivity": "none; uploads excluded" }
- Runtime
- pytorch 2.10.0
- Artifact revision
- 074df545be87034e74a96bf71566ecbbc4c15f0a
- Fixture
{ "file": "research/birefnet-family-expansion/quality-gates.json", "size": 4905, "sha1": "8bf1bfccd9061a4a4a696da3efcec57d86666ccb", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "url": "https://assets.localai.tools/samples/v1/files/585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897/quality-gates.json" }- Rerun when
- artifact revision change; runtime or reviewed architecture change; fixture or quality gate change; pre/postprocessing or backend behavior change
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 7922.983833996113,
"durationMs": 7922.983833996113,
"imagesPerSecond": 0.1262150751474688,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7886.864083004184,
"loadMs": 5950.033708999399,
"totalMs": 13873.017542995512,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 7464.253875019494,
"durationMs": 7464.253875019494,
"imagesPerSecond": 0.13397186332939248,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7445.170874998439,
"loadMs": 5950.033708999399,
"totalMs": 13414.287584018894,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 7512.170707981568,
"durationMs": 7512.170707981568,
"imagesPerSecond": 0.1331173157363843,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7492.029167013243,
"loadMs": 5950.033708999399,
"totalMs": 13462.204416980967,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 9030.664959049318,
"durationMs": 9030.664959049318,
"imagesPerSecond": 0.11073381689328807,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 9013.67695798399,
"loadMs": 5950.033708999399,
"totalMs": 14980.698668048717,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9929432618183642,
"alphaMAE": 0.0033068442192030517,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 8008.280917012598,
"durationMs": 8008.280917012598,
"imagesPerSecond": 0.12487074446597199,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7938.378916005604,
"loadMs": 5950.033708999399,
"totalMs": 13958.314626011997,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 7559.745083039161,
"durationMs": 7559.745083039161,
"imagesPerSecond": 0.1322795926338274,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7539.428125019185,
"loadMs": 5950.033708999399,
"totalMs": 13509.77879203856,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 7500.951832975261,
"durationMs": 7500.951832975261,
"imagesPerSecond": 0.13331641400546748,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7481.22366698226,
"loadMs": 5950.033708999399,
"totalMs": 13450.98554197466,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 7622.811374953017,
"durationMs": 7622.811374953017,
"imagesPerSecond": 0.13118519543665916,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7602.605084015522,
"loadMs": 5950.033708999399,
"totalMs": 13572.845083952416,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 7622.638790984638,
"durationMs": 7622.638790984638,
"imagesPerSecond": 0.1311881655972875,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7594.79945799103,
"loadMs": 5595.172542030923,
"totalMs": 13217.811333015561,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 7489.268167002592,
"durationMs": 7489.268167002592,
"imagesPerSecond": 0.13352439486757317,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7469.017583003733,
"loadMs": 5595.172542030923,
"totalMs": 13084.440709033515,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 7653.792458993848,
"durationMs": 7653.792458993848,
"imagesPerSecond": 0.13065418292403735,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7633.932083030231,
"loadMs": 5595.172542030923,
"totalMs": 13248.965001024771,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 9257.982791983522,
"durationMs": 9257.982791983522,
"imagesPerSecond": 0.1080148907671225,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 9241.355874983128,
"loadMs": 5595.172542030923,
"totalMs": 14853.155334014446,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9929432618183642,
"alphaMAE": 0.0033068442192030517,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 7368.65045898594,
"durationMs": 7368.65045898594,
"imagesPerSecond": 0.13571006055532428,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7306.277083000168,
"loadMs": 5595.172542030923,
"totalMs": 12963.823001016863,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 7532.889417023398,
"durationMs": 7532.889417023398,
"imagesPerSecond": 0.13275118545350256,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7513.287917012349,
"loadMs": 5595.172542030923,
"totalMs": 13128.061959054321,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 7558.935459004715,
"durationMs": 7558.935459004715,
"imagesPerSecond": 0.13229376086400266,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7538.604583009146,
"loadMs": 5595.172542030923,
"totalMs": 13154.108001035638,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 7452.133040991612,
"durationMs": 7452.133040991612,
"imagesPerSecond": 0.13418976747990746,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7432.4371659895405,
"loadMs": 5595.172542030923,
"totalMs": 13047.305583022535,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 7648.387749970425,
"durationMs": 7648.387749970425,
"imagesPerSecond": 0.1307465092893423,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7619.456125015859,
"loadMs": 5186.762958997861,
"totalMs": 12835.150708968285,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 7414.816999982577,
"durationMs": 7414.816999982577,
"imagesPerSecond": 0.13486509511999417,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7396.255041996483,
"loadMs": 5186.762958997861,
"totalMs": 12601.579958980437,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 7615.208583010826,
"durationMs": 7615.208583010826,
"imagesPerSecond": 0.13131616673389002,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7595.399167039432,
"loadMs": 5186.762958997861,
"totalMs": 12801.971542008687,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 8976.156791963149,
"durationMs": 8976.156791963149,
"imagesPerSecond": 0.11140625360904519,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 8959.301833005156,
"loadMs": 5186.762958997861,
"totalMs": 14162.91975096101,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9929432618183642,
"alphaMAE": 0.0033068442192030517,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 7411.64549998939,
"durationMs": 7411.64549998939,
"imagesPerSecond": 0.134922804929274,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7349.137375014834,
"loadMs": 5186.762958997861,
"totalMs": 12598.408458987251,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 7699.552250036504,
"durationMs": 7699.552250036504,
"imagesPerSecond": 0.1298776821723963,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7679.787874978501,
"loadMs": 5186.762958997861,
"totalMs": 12886.315209034365,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 7948.959166998975,
"durationMs": 7948.959166998975,
"imagesPerSecond": 0.12580263390351984,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7929.287249979097,
"loadMs": 5186.762958997861,
"totalMs": 13135.722125996836,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 7734.99345901655,
"durationMs": 7734.99345901655,
"imagesPerSecond": 0.12928259154948826,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"modelForwardMs": 7714.436583977658,
"loadMs": 5186.762958997861,
"totalMs": 12921.75641801441,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "cpu",
"actualDevice": "cpu",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 965.0358749786392,
"durationMs": 965.0358749786392,
"imagesPerSecond": 1.0362309069827427,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 937.7247090451419,
"loadMs": 5516.823041951284,
"totalMs": 6481.858916929923,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 562.7383749815635,
"durationMs": 562.7383749815635,
"imagesPerSecond": 1.7770247142515596,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 542.5572500098497,
"loadMs": 5516.823041951284,
"totalMs": 6079.561416932847,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 558.0232500215061,
"durationMs": 558.0232500215061,
"imagesPerSecond": 1.7920400269369783,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 535.8218750334345,
"loadMs": 5516.823041951284,
"totalMs": 6074.84629197279,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 561.3754999940284,
"durationMs": 561.3754999940284,
"imagesPerSecond": 1.7813388721286154,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 543.2138749747537,
"loadMs": 5516.823041951284,
"totalMs": 6078.198541945312,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9929269733688564,
"alphaMAE": 0.0033119579045014754,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 607.4858749634586,
"durationMs": 607.4858749634586,
"imagesPerSecond": 1.6461288092668027,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 542.8994169924408,
"loadMs": 5516.823041951284,
"totalMs": 6124.308916914742,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 566.6018330375664,
"durationMs": 566.6018330375664,
"imagesPerSecond": 1.7649078094911472,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 544.4768340094015,
"loadMs": 5516.823041951284,
"totalMs": 6083.42487498885,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 562.4210000387393,
"durationMs": 562.4210000387393,
"imagesPerSecond": 1.7780274917386094,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 540.6945840222761,
"loadMs": 5516.823041951284,
"totalMs": 6079.244041990023,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 563.1189169944264,
"durationMs": 563.1189169944264,
"imagesPerSecond": 1.7758238443442271,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 540.7094999682158,
"loadMs": 5516.823041951284,
"totalMs": 6079.94195894571,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 919.8917499743402,
"durationMs": 919.8917499743402,
"imagesPerSecond": 1.0870844314321706,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 893.7138339970261,
"loadMs": 4208.786458009854,
"totalMs": 5128.678207984194,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 568.9926670165733,
"durationMs": 568.9926670165733,
"imagesPerSecond": 1.757491893952427,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 548.2417920138687,
"loadMs": 4208.786458009854,
"totalMs": 4777.779125026427,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 580.1893340540119,
"durationMs": 580.1893340540119,
"imagesPerSecond": 1.7235752905221566,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 558.1722499919124,
"loadMs": 4208.786458009854,
"totalMs": 4788.975792063866,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 567.2779169981368,
"durationMs": 567.2779169981368,
"imagesPerSecond": 1.76280438570868,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 548.8926249672659,
"loadMs": 4208.786458009854,
"totalMs": 4776.064375007991,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9929269733688564,
"alphaMAE": 0.0033119579045014754,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 612.8324170131236,
"durationMs": 612.8324170131236,
"imagesPerSecond": 1.6317674656864396,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 547.1630420070142,
"loadMs": 4208.786458009854,
"totalMs": 4821.618875022978,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 578.8941659848206,
"durationMs": 578.8941659848206,
"imagesPerSecond": 1.7274314697899744,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 556.7755829542875,
"loadMs": 4208.786458009854,
"totalMs": 4787.6806239946745,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 566.8613750021905,
"durationMs": 566.8613750021905,
"imagesPerSecond": 1.76409973248951,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 545.0942090246826,
"loadMs": 4208.786458009854,
"totalMs": 4775.647833012044,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 566.0032499581575,
"durationMs": 566.0032499581575,
"imagesPerSecond": 1.7667743075219553,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 544.4957919535227,
"loadMs": 4208.786458009854,
"totalMs": 4774.7897079680115,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 832.5296660186723,
"durationMs": 832.5296660186723,
"imagesPerSecond": 1.2011583980931337,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 806.30870902678,
"loadMs": 4447.61379098054,
"totalMs": 5280.1434569992125,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 556.605292018503,
"durationMs": 556.605292018503,
"imagesPerSecond": 1.7966052682926297,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 536.7405830183998,
"loadMs": 4447.61379098054,
"totalMs": 5004.219082999043,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 558.1362080411054,
"durationMs": 558.1362080411054,
"imagesPerSecond": 1.791677346126149,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 537.1575829922222,
"loadMs": 4447.61379098054,
"totalMs": 5005.749999021646,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 554.3438330059871,
"durationMs": 554.3438330059871,
"imagesPerSecond": 1.8039345627377072,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 535.5232079746202,
"loadMs": 4447.61379098054,
"totalMs": 5001.957623986527,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9929269733688564,
"alphaMAE": 0.0033119579045014754,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 600.4571249941364,
"durationMs": 600.4571249941364,
"imagesPerSecond": 1.6653978417022952,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 536.0532919876277,
"loadMs": 4447.61379098054,
"totalMs": 5048.070915974677,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 564.9661250063218,
"durationMs": 564.9661250063218,
"imagesPerSecond": 1.7700176271432384,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 543.0552500183694,
"loadMs": 4447.61379098054,
"totalMs": 5012.579915986862,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 561.1772499978542,
"durationMs": 561.1772499978542,
"imagesPerSecond": 1.7819681749461933,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 537.5133749912493,
"loadMs": 4447.61379098054,
"totalMs": 5008.791040978394,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 559.8217499791645,
"durationMs": 559.8217499791645,
"imagesPerSecond": 1.786282865996575,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 537.4562080251053,
"loadMs": 4447.61379098054,
"totalMs": 5007.435540959705,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 960.1375840138644,
"durationMs": 960.1375840138644,
"imagesPerSecond": 1.0415173998496032,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 934.2488329857588,
"loadMs": 4278.678665985353,
"totalMs": 5238.816249999218,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 656.3794169924222,
"durationMs": 656.3794169924222,
"imagesPerSecond": 1.5235090773901352,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 634.9291669903323,
"loadMs": 4278.678665985353,
"totalMs": 4935.0580829777755,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 673.9035000209697,
"durationMs": 673.9035000209697,
"imagesPerSecond": 1.48389198152092,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 652.1925420383923,
"loadMs": 4278.678665985353,
"totalMs": 4952.582166006323,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 659.9140830221586,
"durationMs": 659.9140830221586,
"imagesPerSecond": 1.5153487790719296,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 641.3908749818802,
"loadMs": 4278.678665985353,
"totalMs": 4938.592749007512,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9929432618183642,
"alphaMAE": 0.003306849826314125,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 698.3517920016311,
"durationMs": 698.3517920016311,
"imagesPerSecond": 1.431943057142845,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 634.7039170213975,
"loadMs": 4278.678665985353,
"totalMs": 4977.030457986984,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 661.0064579872414,
"durationMs": 661.0064579872414,
"imagesPerSecond": 1.5128445235542642,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 639.3264170037583,
"loadMs": 4278.678665985353,
"totalMs": 4939.685123972595,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 658.0733330338262,
"durationMs": 658.0733330338262,
"imagesPerSecond": 1.5195874833429819,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 637.1711249812506,
"loadMs": 4278.678665985353,
"totalMs": 4936.7519990191795,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 657.9811249976046,
"durationMs": 657.9811249976046,
"imagesPerSecond": 1.5198004350104124,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 637.1504580019973,
"loadMs": 4278.678665985353,
"totalMs": 4936.659790982958,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 991.2441250053234,
"durationMs": 991.2441250053234,
"imagesPerSecond": 1.0088332175432864,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 960.4621669859625,
"loadMs": 4363.87029197067,
"totalMs": 5355.114416975994,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 669.3484589923173,
"durationMs": 669.3484589923173,
"imagesPerSecond": 1.4939901430496576,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 645.6215410144068,
"loadMs": 4363.87029197067,
"totalMs": 5033.2187509629875,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 659.1559160151519,
"durationMs": 659.1559160151519,
"imagesPerSecond": 1.5170917467378282,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 636.983959004283,
"loadMs": 4363.87029197067,
"totalMs": 5023.026207985822,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 651.5605000313371,
"durationMs": 651.5605000313371,
"imagesPerSecond": 1.5347768932461445,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 633.0803329474293,
"loadMs": 4363.87029197067,
"totalMs": 5015.430792002007,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9929432618183642,
"alphaMAE": 0.003306849826314125,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 699.8622919782065,
"durationMs": 699.8622919782065,
"imagesPerSecond": 1.4288525206486475,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 632.5987909804098,
"loadMs": 4363.87029197067,
"totalMs": 5063.732583948877,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 659.1244589653797,
"durationMs": 659.1244589653797,
"imagesPerSecond": 1.5171641507124296,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 637.725375010632,
"loadMs": 4363.87029197067,
"totalMs": 5022.99475093605,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 650.3064999706112,
"durationMs": 650.3064999706112,
"imagesPerSecond": 1.537736436657472,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 629.1400830377825,
"loadMs": 4363.87029197067,
"totalMs": 5014.176791941281,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 648.4216669923626,
"durationMs": 648.4216669923626,
"imagesPerSecond": 1.5422063310104943,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 627.6729590026662,
"loadMs": 4363.87029197067,
"totalMs": 5012.291958963033,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 892.5220419769175,
"durationMs": 892.5220419769175,
"imagesPerSecond": 1.1204205083664052,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 867.367375001777,
"loadMs": 4270.260083023459,
"totalMs": 5162.782125000376,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 647.2920840024017,
"durationMs": 647.2920840024017,
"imagesPerSecond": 1.5448976199688695,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 627.536624961067,
"loadMs": 4270.260083023459,
"totalMs": 4917.55216702586,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 648.4730420052074,
"durationMs": 648.4730420052074,
"imagesPerSecond": 1.5420841503415492,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 627.3347079986706,
"loadMs": 4270.260083023459,
"totalMs": 4918.733125028666,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 648.6068340018392,
"durationMs": 648.6068340018392,
"imagesPerSecond": 1.5417660554547354,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 630.6864999933168,
"loadMs": 4270.260083023459,
"totalMs": 4918.866917025298,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9929432618183642,
"alphaMAE": 0.003306849826314125,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 696.3374170009047,
"durationMs": 696.3374170009047,
"imagesPerSecond": 1.4360854028309393,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 630.853875016328,
"loadMs": 4270.260083023459,
"totalMs": 4966.597500024363,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 658.1561249913648,
"durationMs": 658.1561249913648,
"imagesPerSecond": 1.519396328664601,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 637.0202910038643,
"loadMs": 4270.260083023459,
"totalMs": 4928.4162080148235,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 648.9065829664469,
"durationMs": 648.9065829664469,
"imagesPerSecond": 1.5410538685376647,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 627.5874169659801,
"loadMs": 4270.260083023459,
"totalMs": 4919.166665989906,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 650.7865419844165,
"durationMs": 650.7865419844165,
"imagesPerSecond": 1.5366021506080032,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 629.0584170492366,
"loadMs": 4270.260083023459,
"totalMs": 4921.046625007875,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "074df545be87034e74a96bf71566ecbbc4c15f0a",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 8
}
}
]BiRefNet High Resolution Desktop
49 configurations testedQuality criteria
{ "file": "research/birefnet-family-expansion/quality-gates.json", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "description": "Frozen complete PNG/dimensions/source-alpha, person/background interior, blank negative, and original reference IoU>=.7/MAE<=.16/boundaryF1>=.6. First forward<=20s, steady<=10s." }
| Precision | Device | Result | Platform | Inference / load | |
|---|---|---|---|---|---|
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3122 ms / 4142 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3260 ms / 4195 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3274 ms / 4525 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3332 ms / 4142 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3347 ms / 4195 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3367 ms / 4195 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3376 ms / 4195 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3389 ms / 4525 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3409 ms / 4525 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3454 ms / 4525 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3461 ms / 4142 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3479 ms / 4142 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3524 ms / 4195 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3524 ms / 4195 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3535 ms / 4525 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3581 ms / 4195 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3602 ms / 4525 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3668 ms / 4142 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3677 ms / 4142 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3701 ms / 4525 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3723 ms / 4142 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3732 ms / 4142 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3740 ms / 4525 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3862 ms / 4195 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4064 ms / 4215 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4195 ms / 4215 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4236 ms / 4201 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4248 ms / 4215 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4304 ms / 4201 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4320 ms / 4215 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4322 ms / 4166 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4334 ms / 4166 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4363 ms / 4201 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4427 ms / 4201 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4509 ms / 4215 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4513 ms / 4201 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4531 ms / 4215 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4564 ms / 4215 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4578 ms / 4201 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4593 ms / 4166 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4604 ms / 4166 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4665 ms / 4201 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4713 ms / 4201 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4724 ms / 4166 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4727 ms / 4166 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4744 ms / 4215 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4899 ms / 4166 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4913 ms / 4166 ms |
BF16 | mps | Failed | — | Not recorded | — / 4157 ms |
Test setup & sample details
- Quality gate
- { "file": "research/birefnet-family-expansion/quality-gates.json", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "description": "Frozen complete PNG/dimensions/source-alpha, person/background interior, blank negative, and original reference IoU>=.7/MAE<=.16/boundaryF1>=.6. First forward<=20s, steady<=10s." }
- Tested
- 2026-11-13T05:48:11.367645+00:00
- Environment
- { "os": "macos", "osVersion": "27.2", "architecture": "aarch64", "hardware": "Apple M3 Max;Mac15,11;96GiB RAM", "cpu": "Apple M3 Max", "gpu": "Apple M3 Max", "driver": "OS-managed Metal/MPS macOS27.2 build26B118", "runtime": "App-owned CPython3.13.18;Torch2.10.0;Torchvision0.25.0;Transformers5.22.1;Timm1.0.22;Kornia0.8.2;Einops0.8.1", "timingScope": "Three fresh helper/model loads per pair. Five quality fixtures and three warm portrait calls each load. Full task duration in inferenceMs; synchronized forward retained in modelForwardMs. Local snapshot loads; no network-transfer or fully cold OS/shader claim.", "concurrentUploadActivity": "none; uploads excluded" }
- Runtime
- pytorch 2.10.0
- Artifact revision
- a7a562f6fd16021180f2f4348f4de003a2d3d1e1
- Fixture
{ "file": "research/birefnet-family-expansion/quality-gates.json", "size": 4905, "sha1": "8bf1bfccd9061a4a4a696da3efcec57d86666ccb", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "url": "https://assets.localai.tools/samples/v1/files/585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897/quality-gates.json" }- Rerun when
- artifact revision change; runtime or reviewed architecture change; fixture or quality gate change; pre/postprocessing or backend behavior change
Per-case quality & failure details
[
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3739.857624983415,
"durationMs": 3739.857624983415,
"imagesPerSecond": 0.2673898581913087,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 8578646016,
"modelForwardMs": 3657.532750046812,
"loadMs": 4524.718665983528,
"totalMs": 8264.576290966943,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3409.2698749736883,
"durationMs": 3409.2698749736883,
"imagesPerSecond": 0.29331793512172977,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3344.999958004337,
"loadMs": 4524.718665983528,
"totalMs": 7933.988540957216,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3701.2234160210937,
"durationMs": 3701.2234160210937,
"imagesPerSecond": 0.2701809341396161,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3633.4508329746313,
"loadMs": 4524.718665983528,
"totalMs": 8225.942082004622,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3535.2487500058487,
"durationMs": 3535.2487500058487,
"imagesPerSecond": 0.28286552678884214,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3473.9153750124387,
"loadMs": 4524.718665983528,
"totalMs": 8059.967415989377,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9941480014504477,
"alphaMAE": 0.0033021510672350905,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3388.839041988831,
"durationMs": 3388.839041988831,
"imagesPerSecond": 0.2950863076143986,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3275.5771669908427,
"loadMs": 4524.718665983528,
"totalMs": 7913.557707972359,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 3273.806457989849,
"durationMs": 3273.806457989849,
"imagesPerSecond": 0.3054548315033902,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3207.961250038352,
"loadMs": 4524.718665983528,
"totalMs": 7798.525123973377,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 3454.3197919847444,
"durationMs": 3454.3197919847444,
"imagesPerSecond": 0.28949259484323286,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3390.0882080197334,
"loadMs": 4524.718665983528,
"totalMs": 7979.038457968272,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 3601.936375023797,
"durationMs": 3601.936375023797,
"imagesPerSecond": 0.27762844644733436,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3537.514541996643,
"loadMs": 4524.718665983528,
"totalMs": 8126.655041007325,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3668.0300420266576,
"durationMs": 3668.0300420266576,
"imagesPerSecond": 0.2726259023351621,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 8578646016,
"modelForwardMs": 3590.090291982051,
"loadMs": 4142.384874983691,
"totalMs": 7810.414917010348,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3732.3500830098055,
"durationMs": 3732.3500830098055,
"imagesPerSecond": 0.2679277071441245,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3668.2622500229627,
"loadMs": 4142.384874983691,
"totalMs": 7874.734957993496,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3479.031207971275,
"durationMs": 3479.031207971275,
"imagesPerSecond": 0.28743634081486996,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3413.68604201125,
"loadMs": 4142.384874983691,
"totalMs": 7621.4160829549655,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3331.5929169766605,
"durationMs": 3331.5929169766605,
"imagesPerSecond": 0.30015671929915005,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3271.0403330274858,
"loadMs": 4142.384874983691,
"totalMs": 7473.977791960351,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9941480014504477,
"alphaMAE": 0.0033021510672350905,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3723.2201250153594,
"durationMs": 3723.2201250153594,
"imagesPerSecond": 0.26858471065980144,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3609.126625000499,
"loadMs": 4142.384874983691,
"totalMs": 7865.60499999905,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 3122.4767090170644,
"durationMs": 3122.4767090170644,
"imagesPerSecond": 0.320258593799021,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3056.4701670082286,
"loadMs": 4142.384874983691,
"totalMs": 7264.861584000755,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 3461.0752500011586,
"durationMs": 3461.0752500011586,
"imagesPerSecond": 0.2889275522107372,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3396.0675410344265,
"loadMs": 4142.384874983691,
"totalMs": 7603.460124984849,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 3677.0337499910966,
"durationMs": 3677.0337499910966,
"imagesPerSecond": 0.2719583414219196,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3608.330042043235,
"loadMs": 4142.384874983691,
"totalMs": 7819.418624974787,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3862.2665000148118,
"durationMs": 3862.2665000148118,
"imagesPerSecond": 0.25891532860204364,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 8578646016,
"modelForwardMs": 3781.513583031483,
"loadMs": 4195.355833042413,
"totalMs": 8057.622333057225,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3259.9871670245193,
"durationMs": 3259.9871670245193,
"imagesPerSecond": 0.30674967377639334,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3195.483833027538,
"loadMs": 4195.355833042413,
"totalMs": 7455.343000066932,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3366.6777500184253,
"durationMs": 3366.6777500184253,
"imagesPerSecond": 0.2970287251265813,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3302.3446669685654,
"loadMs": 4195.355833042413,
"totalMs": 7562.033583060838,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3580.815416004043,
"durationMs": 3580.815416004043,
"imagesPerSecond": 0.27926600056808704,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3519.8823750251904,
"loadMs": 4195.355833042413,
"totalMs": 7776.171249046456,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9941480014504477,
"alphaMAE": 0.0033021510672350905,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3523.686542001087,
"durationMs": 3523.686542001087,
"imagesPerSecond": 0.2837936882524471,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3409.782250004355,
"loadMs": 4195.355833042413,
"totalMs": 7719.0423750435,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 3347.116915974766,
"durationMs": 3347.116915974766,
"imagesPerSecond": 0.2987645860911836,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3271.6736670117825,
"loadMs": 4195.355833042413,
"totalMs": 7542.472749017179,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 3523.802625015378,
"durationMs": 3523.802625015378,
"imagesPerSecond": 0.28378433936708813,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3459.1839580098167,
"loadMs": 4195.355833042413,
"totalMs": 7719.158458057791,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 3375.552083947696,
"durationMs": 3375.552083947696,
"imagesPerSecond": 0.2962478359482173,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3310.490292031318,
"loadMs": 4195.355833042413,
"totalMs": 7570.907916990109,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 4898.645874985959,
"durationMs": 4898.645874985959,
"imagesPerSecond": 0.2041380466194377,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 17379360768,
"modelForwardMs": 4818.696625006851,
"loadMs": 4165.711250039749,
"totalMs": 9064.357125025708,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 4593.414375034627,
"durationMs": 4593.414375034627,
"imagesPerSecond": 0.21770298047461953,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 21405892608,
"modelForwardMs": 4528.820374980569,
"loadMs": 4165.711250039749,
"totalMs": 8759.125625074375,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 4727.039291989058,
"durationMs": 4727.039291989058,
"imagesPerSecond": 0.21154890793793613,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 21405892608,
"modelForwardMs": 4661.602000007406,
"loadMs": 4165.711250039749,
"totalMs": 8892.750542028807,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 4603.559125040192,
"durationMs": 4603.559125040192,
"imagesPerSecond": 0.2172232337716026,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 21405892608,
"modelForwardMs": 4541.126666008495,
"loadMs": 4165.711250039749,
"totalMs": 8769.270375079941,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9941365497695904,
"alphaMAE": 0.003308946885855364,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 4913.105374958832,
"durationMs": 4913.105374958832,
"imagesPerSecond": 0.20353725875630732,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 25432424448,
"modelForwardMs": 4798.062707995996,
"loadMs": 4165.711250039749,
"totalMs": 9078.81662499858,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 4334.068749973085,
"durationMs": 4334.068749973085,
"imagesPerSecond": 0.23073007321496922,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 25432424448,
"modelForwardMs": 4259.226916998159,
"loadMs": 4165.711250039749,
"totalMs": 8499.780000012834,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 4723.907083040103,
"durationMs": 4723.907083040103,
"imagesPerSecond": 0.21168917644257368,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 25432424448,
"modelForwardMs": 4655.472209036816,
"loadMs": 4165.711250039749,
"totalMs": 8889.618333079852,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 4322.050541988574,
"durationMs": 4322.050541988574,
"imagesPerSecond": 0.2313716580324626,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 25432424448,
"modelForwardMs": 4255.3037499892525,
"loadMs": 4165.711250039749,
"totalMs": 8487.761792028323,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 4363.254625000991,
"durationMs": 4363.254625000991,
"imagesPerSecond": 0.22918671632641033,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 17379360768,
"modelForwardMs": 4283.4859160357155,
"loadMs": 4201.3299579848535,
"totalMs": 8564.584582985844,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 4665.071499999613,
"durationMs": 4665.071499999613,
"imagesPerSecond": 0.21435898678082063,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 21405892608,
"modelForwardMs": 4600.064166996162,
"loadMs": 4201.3299579848535,
"totalMs": 8866.401457984466,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 4427.453499985859,
"durationMs": 4427.453499985859,
"imagesPerSecond": 0.2258634675673486,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 21405892608,
"modelForwardMs": 4359.433000034187,
"loadMs": 4201.3299579848535,
"totalMs": 8628.783457970712,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 4512.918958964292,
"durationMs": 4512.918958964292,
"imagesPerSecond": 0.22158607524153248,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 21405892608,
"modelForwardMs": 4450.182333006524,
"loadMs": 4201.3299579848535,
"totalMs": 8714.248916949145,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9941365497695904,
"alphaMAE": 0.003308946885855364,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 4712.704625038896,
"durationMs": 4712.704625038896,
"imagesPerSecond": 0.21219237774566588,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 25432424448,
"modelForwardMs": 4597.028792020865,
"loadMs": 4201.3299579848535,
"totalMs": 8914.03458302375,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 4235.92429200653,
"durationMs": 4235.92429200653,
"imagesPerSecond": 0.2360759850895037,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 25432424448,
"modelForwardMs": 4170.035750023089,
"loadMs": 4201.3299579848535,
"totalMs": 8437.254249991383,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 4577.827291970607,
"durationMs": 4577.827291970607,
"imagesPerSecond": 0.21844423920360095,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 25432424448,
"modelForwardMs": 4509.791249991395,
"loadMs": 4201.3299579848535,
"totalMs": 8779.15724995546,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 4304.152500000782,
"durationMs": 4304.152500000782,
"imagesPerSecond": 0.23233377534829872,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 25432424448,
"modelForwardMs": 4237.620499974582,
"loadMs": 4201.3299579848535,
"totalMs": 8505.482457985636,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 4743.866375007201,
"durationMs": 4743.866375007201,
"imagesPerSecond": 0.21079851769612334,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 17379360768,
"modelForwardMs": 4665.926542016678,
"loadMs": 4215.486540982965,
"totalMs": 8959.352915990166,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 4509.308332984801,
"durationMs": 4509.308332984801,
"imagesPerSecond": 0.22176350033222944,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 21405892608,
"modelForwardMs": 4445.074124960229,
"loadMs": 4215.486540982965,
"totalMs": 8724.794873967767,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 4247.642000031192,
"durationMs": 4247.642000031192,
"imagesPerSecond": 0.23542473682872914,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 21405892608,
"modelForwardMs": 4181.081416958477,
"loadMs": 4215.486540982965,
"totalMs": 8463.128541014157,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 4320.022416999564,
"durationMs": 4320.022416999564,
"imagesPerSecond": 0.231480280302467,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 21405892608,
"modelForwardMs": 4258.242334006354,
"loadMs": 4215.486540982965,
"totalMs": 8535.508957982529,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9941365497695904,
"alphaMAE": 0.003308946885855364,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 4563.905375020113,
"durationMs": 4563.905375020113,
"imagesPerSecond": 0.21911059012602624,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 25432424448,
"modelForwardMs": 4442.612416984048,
"loadMs": 4215.486540982965,
"totalMs": 8779.391916003078,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 4063.6477500083856,
"durationMs": 4063.6477500083856,
"imagesPerSecond": 0.24608432165360208,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 25432424448,
"modelForwardMs": 3986.0222910065204,
"loadMs": 4215.486540982965,
"totalMs": 8279.134290991351,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 4531.345958006568,
"durationMs": 4531.345958006568,
"imagesPerSecond": 0.22068498173993328,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 25432424448,
"modelForwardMs": 4463.268374965992,
"loadMs": 4215.486540982965,
"totalMs": 8746.832498989534,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 4194.603374984581,
"durationMs": 4194.603374984581,
"imagesPerSecond": 0.23840156281848124,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 25432424448,
"modelForwardMs": 4121.855375007726,
"loadMs": 4215.486540982965,
"totalMs": 8410.089915967546,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "bf16",
"device": "mps",
"status": "fail",
"quality": {
"passed": false,
"error": "{'ok': False, 'code': 'runtime_error', 'error': 'Failed to create function state object for: deformable_im2col_bfloat', 'traceback': 'Traceback (most recent call last):\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 49, in <module>\\n with contextlib.redirect_stdout(sys.stderr):v=init(r)if r[\\'type\\']==\\'init\\'else {\\'healthy\\':net is not None}if r[\\'type\\']==\\'health\\'else generate(r)\\n ~~~~~~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 36, in generate\\n with torch.inference_mode():logits=net(x)[-1];matte=logits.float().sigmoid()\\n ~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2063, in forward\\n scaled_preds, class_preds = self.forward_ori(x)\\n ~~~~~~~~~~~~~~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2054, in forward_ori\\n x4 = self.squeeze_module(x4)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/container.py\", line 253, in forward\\n input = module(input)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1436, in forward\\n x = self.dec_att(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1612, in forward\\n x1 = self.aspp1(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1583, in forward\\n x = self.atrous_conv(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1290, in forward\\n x = deform_conv2d(\\n input=x,\\n ...<5 lines>...\\n stride=self.stride,\\n )\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torchvision/ops/deform_conv.py\", line 92, in deform_conv2d\\n return torch.ops.torchvision.deform_conv2d(\\n ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^\\n input,\\n ^^^^^^\\n ...<12 lines>...\\n use_mask,\\n ^^^^^^^^^\\n )\\n ^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/_ops.py\", line 1209, in __call__\\n return self._op(*args, **kwargs)\\n ~~~~~~~~^^^^^^^^^^^^^^^^^\\nRuntimeError: Failed to create function state object for: deformable_im2col_bfloat\\n'}",
"individualFixturePassedBeforeConfigurationGate": false
},
"runtime": {
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "a7a562f6fd16021180f2f4348f4de003a2d3d1e1",
"requestedDevice": "mps",
"requestedPrecision": "bf16",
"cpuThreads": 4,
"fallback": false,
"loadMs": 4157.062665966805
},
"failure": "{'ok': False, 'code': 'runtime_error', 'error': 'Failed to create function state object for: deformable_im2col_bfloat', 'traceback': 'Traceback (most recent call last):\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 49, in <module>\\n with contextlib.redirect_stdout(sys.stderr):v=init(r)if r[\\'type\\']==\\'init\\'else {\\'healthy\\':net is not None}if r[\\'type\\']==\\'health\\'else generate(r)\\n ~~~~~~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 36, in generate\\n with torch.inference_mode():logits=net(x)[-1];matte=logits.float().sigmoid()\\n ~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2063, in forward\\n scaled_preds, class_preds = self.forward_ori(x)\\n ~~~~~~~~~~~~~~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2054, in forward_ori\\n x4 = self.squeeze_module(x4)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/container.py\", line 253, in forward\\n input = module(input)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1436, in forward\\n x = self.dec_att(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1612, in forward\\n x1 = self.aspp1(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1583, in forward\\n x = self.atrous_conv(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1290, in forward\\n x = deform_conv2d(\\n input=x,\\n ...<5 lines>...\\n stride=self.stride,\\n )\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torchvision/ops/deform_conv.py\", line 92, in deform_conv2d\\n return torch.ops.torchvision.deform_conv2d(\\n ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^\\n input,\\n ^^^^^^\\n ...<12 lines>...\\n use_mask,\\n ^^^^^^^^^\\n )\\n ^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/_ops.py\", line 1209, in __call__\\n return self._op(*args, **kwargs)\\n ~~~~~~~~^^^^^^^^^^^^^^^^^\\nRuntimeError: Failed to create function state object for: deformable_im2col_bfloat\\n'}"
}
]BiRefNet High Resolution Matting Desktop
49 configurations testedQuality criteria
{ "file": "research/birefnet-family-expansion/quality-gates.json", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "description": "Frozen complete PNG/dimensions/source-alpha, person/background interior, blank negative, and original reference IoU>=.7/MAE<=.16/boundaryF1>=.6. First forward<=20s, steady<=10s." }
| Precision | Device | Result | Platform | Inference / load | |
|---|---|---|---|---|---|
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 2878 ms / 4237 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3031 ms / 4211 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3035 ms / 4211 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3085 ms / 4237 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3107 ms / 4211 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3139 ms / 4211 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3159 ms / 4523 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3186 ms / 4211 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3186 ms / 4523 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3197 ms / 4211 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3202 ms / 4523 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3222 ms / 4211 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3223 ms / 4523 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3260 ms / 4237 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3269 ms / 4237 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3271 ms / 4211 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3274 ms / 4523 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3353 ms / 4237 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3356 ms / 4523 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3362 ms / 4237 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3381 ms / 4237 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3428 ms / 4523 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3446 ms / 4523 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3451 ms / 4237 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3834 ms / 4189 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3838 ms / 4245 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3886 ms / 4189 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3899 ms / 4194 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3941 ms / 4189 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3973 ms / 4194 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3984 ms / 4245 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3991 ms / 4189 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 3996 ms / 4194 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4003 ms / 4194 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4087 ms / 4189 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4104 ms / 4245 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4115 ms / 4245 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4136 ms / 4194 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4139 ms / 4189 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4157 ms / 4194 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4191 ms / 4245 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4203 ms / 4194 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4260 ms / 4189 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4285 ms / 4245 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4334 ms / 4194 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4367 ms / 4245 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4418 ms / 4189 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 4433 ms / 4245 ms |
BF16 | mps | Failed | — | Not recorded | — / 4265 ms |
Test setup & sample details
- Quality gate
- { "file": "research/birefnet-family-expansion/quality-gates.json", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "description": "Frozen complete PNG/dimensions/source-alpha, person/background interior, blank negative, and original reference IoU>=.7/MAE<=.16/boundaryF1>=.6. First forward<=20s, steady<=10s." }
- Tested
- 2026-11-13T05:48:11.367645+00:00
- Environment
- { "os": "macos", "osVersion": "27.2", "architecture": "aarch64", "hardware": "Apple M3 Max;Mac15,11;96GiB RAM", "cpu": "Apple M3 Max", "gpu": "Apple M3 Max", "driver": "OS-managed Metal/MPS macOS27.2 build26B118", "runtime": "App-owned CPython3.13.18;Torch2.10.0;Torchvision0.25.0;Transformers5.22.1;Timm1.0.22;Kornia0.8.2;Einops0.8.1", "timingScope": "Three fresh helper/model loads per pair. Five quality fixtures and three warm portrait calls each load. Full task duration in inferenceMs; synchronized forward retained in modelForwardMs. Local snapshot loads; no network-transfer or fully cold OS/shader claim.", "concurrentUploadActivity": "none; uploads excluded" }
- Runtime
- pytorch 2.10.0
- Artifact revision
- 5d6b6f8adcb5b417c871b1d84ceaae9871355b7f
- Fixture
{ "file": "research/birefnet-family-expansion/quality-gates.json", "size": 4905, "sha1": "8bf1bfccd9061a4a4a696da3efcec57d86666ccb", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "url": "https://assets.localai.tools/samples/v1/files/585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897/quality-gates.json" }- Rerun when
- artifact revision change; runtime or reviewed architecture change; fixture or quality gate change; pre/postprocessing or backend behavior change
Per-case quality & failure details
[
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3445.671457971912,
"durationMs": 3445.671457971912,
"imagesPerSecond": 0.2902191959382541,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 8578646016,
"modelForwardMs": 3366.02362501435,
"loadMs": 4522.958375047892,
"totalMs": 7968.629833019804,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3158.6959160049446,
"durationMs": 3158.6959160049446,
"imagesPerSecond": 0.31658634657836265,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3094.7231670143083,
"loadMs": 4522.958375047892,
"totalMs": 7681.654291052837,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3428.3137079910375,
"durationMs": 3428.3137079910375,
"imagesPerSecond": 0.2916885924613916,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3363.5450419969857,
"loadMs": 4522.958375047892,
"totalMs": 7951.27208303893,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3222.789334016852,
"durationMs": 3222.789334016852,
"imagesPerSecond": 0.31029021644229227,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3161.730332998559,
"loadMs": 4522.958375047892,
"totalMs": 7745.747709064744,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9942291930348869,
"alphaMAE": 0.0032210049557890477,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3356.1892089783214,
"durationMs": 3356.1892089783214,
"imagesPerSecond": 0.29795697969734436,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3242.435624997597,
"loadMs": 4522.958375047892,
"totalMs": 7879.147584026214,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 3185.9824169659987,
"durationMs": 3185.9824169659987,
"imagesPerSecond": 0.3138749274555937,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3121.2177500128746,
"loadMs": 4522.958375047892,
"totalMs": 7708.940792013891,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 3201.910499949008,
"durationMs": 3201.910499949008,
"imagesPerSecond": 0.31231353906235837,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3136.768124997616,
"loadMs": 4522.958375047892,
"totalMs": 7724.868874996901,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 3274.288666958455,
"durationMs": 3274.288666958455,
"imagesPerSecond": 0.3054098467527354,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3209.445584041532,
"loadMs": 4522.958375047892,
"totalMs": 7797.247042006347,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3361.5013750386424,
"durationMs": 3361.5013750386424,
"imagesPerSecond": 0.29748611957313403,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 8578646016,
"modelForwardMs": 3282.2089580004103,
"loadMs": 4237.277082982473,
"totalMs": 7598.7784580211155,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3380.629916966427,
"durationMs": 3380.629916966427,
"imagesPerSecond": 0.29580286057970506,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3316.1099160206504,
"loadMs": 4237.277082982473,
"totalMs": 7617.9069999489,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3450.6303750094958,
"durationMs": 3450.6303750094958,
"imagesPerSecond": 0.2898021205755044,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3384.5502919866703,
"loadMs": 4237.277082982473,
"totalMs": 7687.907457991969,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3353.3877920126542,
"durationMs": 3353.3877920126542,
"imagesPerSecond": 0.29820589267423037,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3292.675083037466,
"loadMs": 4237.277082982473,
"totalMs": 7590.664874995127,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9942291930348869,
"alphaMAE": 0.0032210049557890477,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3260.230457992293,
"durationMs": 3260.230457992293,
"imagesPerSecond": 0.3067267829329518,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3145.999833010137,
"loadMs": 4237.277082982473,
"totalMs": 7497.507540974766,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 2878.096624976024,
"durationMs": 2878.096624976024,
"imagesPerSecond": 0.34745185110257737,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 2812.1722909854725,
"loadMs": 4237.277082982473,
"totalMs": 7115.373707958497,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 3269.001708016731,
"durationMs": 3269.001708016731,
"imagesPerSecond": 0.3059037863295243,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3204.5732919941656,
"loadMs": 4237.277082982473,
"totalMs": 7506.278790999204,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 3085.294749995228,
"durationMs": 3085.294749995228,
"imagesPerSecond": 0.3241181413871549,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3020.1751249842346,
"loadMs": 4237.277082982473,
"totalMs": 7322.571832977701,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3196.9815000193194,
"durationMs": 3196.9815000193194,
"imagesPerSecond": 0.3127950537073665,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 8578646016,
"modelForwardMs": 3113.456082995981,
"loadMs": 4211.2095830379985,
"totalMs": 7408.191083057318,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3221.5377090033144,
"durationMs": 3221.5377090033144,
"imagesPerSecond": 0.31041076974057275,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3155.057583004236,
"loadMs": 4211.2095830379985,
"totalMs": 7432.747292041313,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3270.7075829966925,
"durationMs": 3270.7075829966925,
"imagesPerSecond": 0.30574423870805917,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3202.9288330231793,
"loadMs": 4211.2095830379985,
"totalMs": 7481.917166034691,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3185.5726669891737,
"durationMs": 3185.5726669891737,
"imagesPerSecond": 0.31391530017902386,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3124.2352499975823,
"loadMs": 4211.2095830379985,
"totalMs": 7396.782250027172,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9942291930348869,
"alphaMAE": 0.0032210049557890477,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3139.0768340206705,
"durationMs": 3139.0768340206705,
"imagesPerSecond": 0.31856499629515445,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3025.117125012912,
"loadMs": 4211.2095830379985,
"totalMs": 7350.286417058669,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 3031.0132919694297,
"durationMs": 3031.0132919694297,
"imagesPerSecond": 0.329922670629478,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 2949.160666030366,
"loadMs": 4211.2095830379985,
"totalMs": 7242.222875007428,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 3106.5301669877954,
"durationMs": 3106.5301669877954,
"imagesPerSecond": 0.3219025556637798,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 3042.4571670009755,
"loadMs": 4211.2095830379985,
"totalMs": 7317.739750025794,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 3034.746332967188,
"durationMs": 3034.746332967188,
"imagesPerSecond": 0.32951683280304406,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 11128782848,
"modelForwardMs": 2969.6445419685915,
"loadMs": 4211.2095830379985,
"totalMs": 7245.955916005187,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 4366.546334000304,
"durationMs": 4366.546334000304,
"imagesPerSecond": 0.22901394454776677,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 17379360768,
"modelForwardMs": 4291.005041974131,
"loadMs": 4244.90649998188,
"totalMs": 8611.452833982185,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 4433.044916018844,
"durationMs": 4433.044916018844,
"imagesPerSecond": 0.22557858513602963,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 21405892608,
"modelForwardMs": 4367.620624951087,
"loadMs": 4244.90649998188,
"totalMs": 8677.951416000724,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3837.7941249636933,
"durationMs": 3837.7941249636933,
"imagesPerSecond": 0.2605663481256854,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 21405892608,
"modelForwardMs": 3771.6443330282345,
"loadMs": 4244.90649998188,
"totalMs": 8082.7006249455735,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 4104.099124961067,
"durationMs": 4104.099124961067,
"imagesPerSecond": 0.24365883219486964,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 21405892608,
"modelForwardMs": 4042.425249994267,
"loadMs": 4244.90649998188,
"totalMs": 8349.005624942947,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.994267743230584,
"alphaMAE": 0.003219345250911489,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 4190.7087080180645,
"durationMs": 4190.7087080180645,
"imagesPerSecond": 0.2386231231215628,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 25432424448,
"modelForwardMs": 4075.8705000043847,
"loadMs": 4244.90649998188,
"totalMs": 8435.615207999945,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 4115.441625006497,
"durationMs": 4115.441625006497,
"imagesPerSecond": 0.24298728815001022,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 25432424448,
"modelForwardMs": 4032.81074995175,
"loadMs": 4244.90649998188,
"totalMs": 8360.348124988377,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 4284.669791988563,
"durationMs": 4284.669791988563,
"imagesPerSecond": 0.23339021407665791,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 25432424448,
"modelForwardMs": 4216.193583037239,
"loadMs": 4244.90649998188,
"totalMs": 8529.576291970443,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 3983.6874580360018,
"durationMs": 3983.6874580360018,
"imagesPerSecond": 0.2510237086955135,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 25432424448,
"modelForwardMs": 3918.059500050731,
"loadMs": 4244.90649998188,
"totalMs": 8228.593958017882,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 4334.021707996726,
"durationMs": 4334.021707996726,
"imagesPerSecond": 0.23073257758605473,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 17379360768,
"modelForwardMs": 4254.356874967925,
"loadMs": 4193.5805000248365,
"totalMs": 8527.602208021563,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3996.2219999870285,
"durationMs": 3996.2219999870285,
"imagesPerSecond": 0.25023634823171637,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 21405892608,
"modelForwardMs": 3931.7675420315936,
"loadMs": 4193.5805000248365,
"totalMs": 8189.802500011865,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 4135.608417040203,
"durationMs": 4135.608417040203,
"imagesPerSecond": 0.2418023901585165,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 21405892608,
"modelForwardMs": 4067.882666015066,
"loadMs": 4193.5805000248365,
"totalMs": 8329.18891706504,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3898.8012080080807,
"durationMs": 3898.8012080080807,
"imagesPerSecond": 0.2564890966859286,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 21405892608,
"modelForwardMs": 3836.618000001181,
"loadMs": 4193.5805000248365,
"totalMs": 8092.381708032917,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.994267743230584,
"alphaMAE": 0.003219345250911489,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 4202.602125005797,
"durationMs": 4202.602125005797,
"imagesPerSecond": 0.2379478166752749,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 25432424448,
"modelForwardMs": 4087.7610839670524,
"loadMs": 4193.5805000248365,
"totalMs": 8396.182625030633,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 3973.4087089891545,
"durationMs": 3973.4087089891545,
"imagesPerSecond": 0.25167307801426814,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 25432424448,
"modelForwardMs": 3907.9014169983566,
"loadMs": 4193.5805000248365,
"totalMs": 8166.989209013991,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 4156.658750027418,
"durationMs": 4156.658750027418,
"imagesPerSecond": 0.2405778439217325,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 25432424448,
"modelForwardMs": 4088.512207963504,
"loadMs": 4193.5805000248365,
"totalMs": 8350.239250052255,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 4003.093582985457,
"durationMs": 4003.093582985457,
"imagesPerSecond": 0.2498068004830935,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 25432424448,
"modelForwardMs": 3936.2184169585817,
"loadMs": 4193.5805000248365,
"totalMs": 8196.674083010294,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 4417.629250034224,
"durationMs": 4417.629250034224,
"imagesPerSecond": 0.22636575941547218,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 17379360768,
"modelForwardMs": 4340.760540973861,
"loadMs": 4188.805292011239,
"totalMs": 8606.434542045463,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3990.923083969392,
"durationMs": 3990.923083969392,
"imagesPerSecond": 0.2505685975299216,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 21405892608,
"modelForwardMs": 3925.9643749683164,
"loadMs": 4188.805292011239,
"totalMs": 8179.7283759806305,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 4260.160582954995,
"durationMs": 4260.160582954995,
"imagesPerSecond": 0.23473293565529524,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 21405892608,
"modelForwardMs": 4194.770292029716,
"loadMs": 4188.805292011239,
"totalMs": 8448.965874966234,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3885.6149169732817,
"durationMs": 3885.6149169732817,
"imagesPerSecond": 0.25735952258978734,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 21405892608,
"modelForwardMs": 3823.747332964558,
"loadMs": 4188.805292011239,
"totalMs": 8074.42020898452,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.994267743230584,
"alphaMAE": 0.003219345250911489,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 3940.5082919984125,
"durationMs": 3940.5082919984125,
"imagesPerSecond": 0.25377436764454925,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 25432424448,
"modelForwardMs": 3820.9580829716288,
"loadMs": 4188.805292011239,
"totalMs": 8129.313584009651,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 4139.336207997985,
"durationMs": 4139.336207997985,
"imagesPerSecond": 0.24158462848893736,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 25432424448,
"modelForwardMs": 4070.721458992921,
"loadMs": 4188.805292011239,
"totalMs": 8328.141500009224,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 3834.236833965406,
"durationMs": 3834.236833965406,
"imagesPerSecond": 0.26080809384061704,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 25432424448,
"modelForwardMs": 3766.0067910328507,
"loadMs": 4188.805292011239,
"totalMs": 8023.0421259766445,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 4087.1054580202326,
"durationMs": 4087.1054580202326,
"imagesPerSecond": 0.24467193476441235,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 25432424448,
"modelForwardMs": 4021.845250041224,
"loadMs": 4188.805292011239,
"totalMs": 8275.910750031471,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "bf16",
"device": "mps",
"status": "fail",
"quality": {
"passed": false,
"error": "{'ok': False, 'code': 'runtime_error', 'error': 'Failed to create function state object for: deformable_im2col_bfloat', 'traceback': 'Traceback (most recent call last):\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 49, in <module>\\n with contextlib.redirect_stdout(sys.stderr):v=init(r)if r[\\'type\\']==\\'init\\'else {\\'healthy\\':net is not None}if r[\\'type\\']==\\'health\\'else generate(r)\\n ~~~~~~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 36, in generate\\n with torch.inference_mode():logits=net(x)[-1];matte=logits.float().sigmoid()\\n ~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2063, in forward\\n scaled_preds, class_preds = self.forward_ori(x)\\n ~~~~~~~~~~~~~~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2054, in forward_ori\\n x4 = self.squeeze_module(x4)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/container.py\", line 253, in forward\\n input = module(input)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1436, in forward\\n x = self.dec_att(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1612, in forward\\n x1 = self.aspp1(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1583, in forward\\n x = self.atrous_conv(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1290, in forward\\n x = deform_conv2d(\\n input=x,\\n ...<5 lines>...\\n stride=self.stride,\\n )\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torchvision/ops/deform_conv.py\", line 92, in deform_conv2d\\n return torch.ops.torchvision.deform_conv2d(\\n ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^\\n input,\\n ^^^^^^\\n ...<12 lines>...\\n use_mask,\\n ^^^^^^^^^\\n )\\n ^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/_ops.py\", line 1209, in __call__\\n return self._op(*args, **kwargs)\\n ~~~~~~~~^^^^^^^^^^^^^^^^^\\nRuntimeError: Failed to create function state object for: deformable_im2col_bfloat\\n'}",
"individualFixturePassedBeforeConfigurationGate": false
},
"runtime": {
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "5d6b6f8adcb5b417c871b1d84ceaae9871355b7f",
"requestedDevice": "mps",
"requestedPrecision": "bf16",
"cpuThreads": 4,
"fallback": false,
"loadMs": 4265.32608398702
},
"failure": "{'ok': False, 'code': 'runtime_error', 'error': 'Failed to create function state object for: deformable_im2col_bfloat', 'traceback': 'Traceback (most recent call last):\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 49, in <module>\\n with contextlib.redirect_stdout(sys.stderr):v=init(r)if r[\\'type\\']==\\'init\\'else {\\'healthy\\':net is not None}if r[\\'type\\']==\\'health\\'else generate(r)\\n ~~~~~~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 36, in generate\\n with torch.inference_mode():logits=net(x)[-1];matte=logits.float().sigmoid()\\n ~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2063, in forward\\n scaled_preds, class_preds = self.forward_ori(x)\\n ~~~~~~~~~~~~~~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2054, in forward_ori\\n x4 = self.squeeze_module(x4)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/container.py\", line 253, in forward\\n input = module(input)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1436, in forward\\n x = self.dec_att(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1612, in forward\\n x1 = self.aspp1(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1583, in forward\\n x = self.atrous_conv(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1290, in forward\\n x = deform_conv2d(\\n input=x,\\n ...<5 lines>...\\n stride=self.stride,\\n )\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torchvision/ops/deform_conv.py\", line 92, in deform_conv2d\\n return torch.ops.torchvision.deform_conv2d(\\n ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^\\n input,\\n ^^^^^^\\n ...<12 lines>...\\n use_mask,\\n ^^^^^^^^^\\n )\\n ^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/_ops.py\", line 1209, in __call__\\n return self._op(*args, **kwargs)\\n ~~~~~~~~^^^^^^^^^^^^^^^^^\\nRuntimeError: Failed to create function state object for: deformable_im2col_bfloat\\n'}"
}
]BiRefNet Lite · Background removal Desktop
31 configurations testedQuality criteria
{ "version": 1, "scope": "Small portrait compatibility/robustness suite, not broad segmentation accuracy", "fixtures": [ { "id": "portrait", "file": "model-samples/modnet-portrait-pexels-5965592.jpg", "reference": "test-app/public/test-images/modnet-portrait-pexels-5965592-mask.png", "minIoU": 0.7, "maxMeanAbsoluteAlphaError": 0.16 }, { "id": "portrait-mirrored", "derivedFrom": "portrait", "transform": "horizontal flip of input and retained reference", "minIoU": 0.7, "maxMeanAbsoluteAlphaError": 0.16 } ], "negativeInputs": [ "empty encoded bytes", "corrupt image", "unknown fields", "threshold out of range", "image above pixel/byte limit" ], "requirements": [ "finite mask", "nonempty foreground and background", "exact original dimensions", "valid RGBA PNG and grayscale mask" ] }
| Precision | Device | Result | Platform | Inference / load | Task metric | |
|---|---|---|---|---|---|---|
FP32 | cpu | Passed | Moderate | macos · aarch64 | 3651 ms / 0 ms | 0.192 MP/s |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 3657 ms / 0 ms | 0.191 MP/s |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 3681 ms / 0 ms | 0.190 MP/s |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 3690 ms / 0 ms | 0.190 MP/s |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 3828 ms / 0 ms | 0.183 MP/s |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 3846 ms / 0 ms | 0.182 MP/s |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 4021 ms / 817 ms | 0.174 MP/s |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 4048 ms / 829 ms | 0.173 MP/s |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 4066 ms / 0 ms | 0.172 MP/s |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 4117 ms / 756 ms | 0.170 MP/s |
FP16 | coreml | Passed | Moderate | macos · aarch64 | 8644 ms / 0 ms | 0.081 MP/s |
FP16 | coreml | Passed | Moderate | macos · aarch64 | 8644 ms / 0 ms | 0.081 MP/s |
FP16 | coreml | Passed | Moderate | macos · aarch64 | 8794 ms / 0 ms | 0.080 MP/s |
FP16 | coreml | Passed | Moderate | macos · aarch64 | 8879 ms / 0 ms | 0.079 MP/s |
FP16 | coreml | Passed | Moderate | macos · aarch64 | 8927 ms / 0 ms | 0.078 MP/s |
FP16 | coreml | Passed | Moderate | macos · aarch64 | 9018 ms / 0 ms | 0.078 MP/s |
FP16 | coreml | Passed | Moderate | macos · aarch64 | 9063 ms / 0 ms | 0.077 MP/s |
FP16 | coreml | Passed | Moderate | macos · aarch64 | 9255 ms / 6709 ms | 0.076 MP/s |
FP16 | coreml | Passed | Moderate | macos · aarch64 | 9318 ms / 6702 ms | 0.075 MP/s |
FP16 | coreml | Passed | Moderate | macos · aarch64 | 9772 ms / 6446 ms | 0.072 MP/s |
FP32 | cpu | Passed | Slow | macos · aarch64 | 10029 ms / 0 ms | 0.070 MP/s |
FP32 | cpu | Passed | Slow | macos · aarch64 | 10091 ms / 0 ms | 0.069 MP/s |
FP32 | cpu | Passed | Slow | macos · aarch64 | 10103 ms / 0 ms | 0.069 MP/s |
FP32 | cpu | Passed | Slow | macos · aarch64 | 10210 ms / 0 ms | 0.068 MP/s |
FP32 | cpu | Passed | Slow | macos · aarch64 | 10388 ms / 0 ms | 0.067 MP/s |
FP32 | cpu | Passed | Slow | macos · aarch64 | 10488 ms / 0 ms | 0.067 MP/s |
FP32 | cpu | Passed | Slow | macos · aarch64 | 10497 ms / 756 ms | 0.067 MP/s |
FP32 | cpu | Passed | Slow | macos · aarch64 | 10507 ms / 801 ms | 0.067 MP/s |
FP32 | cpu | Passed | Slow | macos · aarch64 | 10533 ms / 0 ms | 0.066 MP/s |
FP32 | cpu | Passed | Slow | macos · aarch64 | 10571 ms / 761 ms | 0.066 MP/s |
FP32 | coreml | Failed | — | macos · aarch64 | — / — | — |
Test setup & sample details
- Quality gate
- { "version": 1, "scope": "Small portrait compatibility/robustness suite, not broad segmentation accuracy", "fixtures": [ { "id": "portrait", "file": "model-samples/modnet-portrait-pexels-5965592.jpg", "reference": "test-app/public/test-images/modnet-portrait-pexels-5965592-mask.png", "minIoU": 0.7, "maxMeanAbsoluteAlphaError": 0.16 }, { "id": "portrait-mirrored", "derivedFrom": "portrait", "transform": "horizontal flip of input and retained reference", "minIoU": 0.7, "maxMeanAbsoluteAlphaError": 0.16 } ], "negativeInputs": [ "empty encoded bytes", "corrupt image", "unknown fields", "threshold out of range", "image above pixel/byte limit" ], "requirements": [ "finite mask", "nonempty foreground and background", "exact original dimensions", "valid RGBA PNG and grayscale mask" ] }
- Tested
- 2026-11-01T23:22:07.116243+00:00
- Environment
- { "os": "macos", "arch": "aarch64", "hardware": "Apple M3 Max", "osVersion": "27.2" }
- Runtime
- onnxruntime 1.23.2
- Artifact revision
- de15b22ba131738a16dff04aab8bdf8dc32e3ac1
- Fixture
{ "file": "model-samples/desktop/restoration-variants/birefnet-lite-portrait.png", "size": 577501, "sha1": "ca577ea142b1eb0f339735fd7c402f66ee6b0724", "sha256": "13862bac57ea6c661399643ec87753fd7f0b3fb15bf54f9273686c1053d3348b", "url": "https://assets.localai.tools/samples/v1/files/13862bac57ea6c661399643ec87753fd7f0b3fb15bf54f9273686c1053d3348b/birefnet-lite-portrait.png" }- Rerun when
- ONNX artifact revision or runtime build/version change; Preprocessing, alpha postprocessing, fixture/reference or quality gate change; Host OS/hardware/provider compatibility change
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9941213544310151,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.0034127291291952133,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CPUExecutionProvider"
],
"loadMs": 800.5859999975655,
"acceleration": "cpu",
"placementVerified": false,
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"durationMs": 10596.61779099406,
"inferenceMs": 10506.63958399673,
"provider": "CPUExecutionProvider",
"placement": {
"CPUExecutionProvider": 3785
},
"coremlComputeUnits": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 11397.203790991625,
"megapixelsPerSecond": 0.06656666904852093,
"fallback": false,
"grade": "slow"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9939310775684148,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.0033688924740999937,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CPUExecutionProvider"
],
"loadMs": 0,
"acceleration": "cpu",
"placementVerified": false,
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"durationMs": 10557.101042002614,
"inferenceMs": 10488.128833996598,
"provider": "CPUExecutionProvider",
"placement": {
"CPUExecutionProvider": 3785
},
"coremlComputeUnits": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 10557.101042002614,
"megapixelsPerSecond": 0.06668415415845824,
"fallback": false,
"grade": "slow"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9941213544310151,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.0034127291291952133,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CPUExecutionProvider"
],
"loadMs": 0,
"acceleration": "cpu",
"placementVerified": false,
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"durationMs": 10163.088624998636,
"inferenceMs": 10091.295374993933,
"provider": "CPUExecutionProvider",
"placement": {
"CPUExecutionProvider": 3785
},
"coremlComputeUnits": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 10163.088624998636,
"megapixelsPerSecond": 0.06930646403761821,
"fallback": false,
"grade": "slow"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9941213544310151,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.0034127291291952133,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CPUExecutionProvider"
],
"loadMs": 0,
"acceleration": "cpu",
"placementVerified": false,
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"durationMs": 10280.303082996397,
"inferenceMs": 10210.224667003786,
"provider": "CPUExecutionProvider",
"placement": {
"CPUExecutionProvider": 3785
},
"coremlComputeUnits": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 10280.303082996397,
"megapixelsPerSecond": 0.0684991783050782,
"fallback": false,
"grade": "slow"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9941213544310151,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.0034127291291952133,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CPUExecutionProvider"
],
"loadMs": 761.448167002527,
"acceleration": "cpu",
"placementVerified": false,
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"durationMs": 10659.20954199828,
"inferenceMs": 10571.063041003072,
"provider": "CPUExecutionProvider",
"placement": {
"CPUExecutionProvider": 3785
},
"coremlComputeUnits": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 11420.657709000807,
"megapixelsPerSecond": 0.06616099036465833,
"fallback": false,
"grade": "slow"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9941213544310151,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.0034127291291952133,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CPUExecutionProvider"
],
"loadMs": 0,
"acceleration": "cpu",
"placementVerified": false,
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"durationMs": 10455.434415998752,
"inferenceMs": 10388.011499999266,
"provider": "CPUExecutionProvider",
"placement": {
"CPUExecutionProvider": 3785
},
"coremlComputeUnits": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 10455.434415998752,
"megapixelsPerSecond": 0.06732684113798386,
"fallback": false,
"grade": "slow"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9941213544310151,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.0034127291291952133,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CPUExecutionProvider"
],
"loadMs": 0,
"acceleration": "cpu",
"placementVerified": false,
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"durationMs": 10171.742416998313,
"inferenceMs": 10103.323040995747,
"provider": "CPUExecutionProvider",
"placement": {
"CPUExecutionProvider": 3785
},
"coremlComputeUnits": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 10171.742416998313,
"megapixelsPerSecond": 0.06922395702504139,
"fallback": false,
"grade": "slow"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9941213544310151,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.0034127291291952133,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CPUExecutionProvider"
],
"loadMs": 755.9057920007035,
"acceleration": "cpu",
"placementVerified": false,
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"durationMs": 10589.58229199925,
"inferenceMs": 10497.437375001027,
"provider": "CPUExecutionProvider",
"placement": {
"CPUExecutionProvider": 3785
},
"coremlComputeUnits": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 11345.488083999953,
"megapixelsPerSecond": 0.06662502237599027,
"fallback": false,
"grade": "slow"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9941213544310151,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.0034127291291952133,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CPUExecutionProvider"
],
"loadMs": 0,
"acceleration": "cpu",
"placementVerified": false,
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"durationMs": 10603.735374999815,
"inferenceMs": 10533.20966699539,
"provider": "CPUExecutionProvider",
"placement": {
"CPUExecutionProvider": 3785
},
"coremlComputeUnits": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 10603.735374999815,
"megapixelsPerSecond": 0.0663987542364665,
"fallback": false,
"grade": "slow"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9941213544310151,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.0034127291291952133,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CPUExecutionProvider"
],
"loadMs": 0,
"acceleration": "cpu",
"placementVerified": false,
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"durationMs": 10101.211249995686,
"inferenceMs": 10029.33583399863,
"provider": "CPUExecutionProvider",
"placement": {
"CPUExecutionProvider": 3785
},
"coremlComputeUnits": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 1,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 10101.211249995686,
"megapixelsPerSecond": 0.06973462765391884,
"fallback": false,
"grade": "slow"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9941213544310151,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.0034127291291952133,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CPUExecutionProvider"
],
"loadMs": 829.3018749973271,
"acceleration": "cpu",
"placementVerified": false,
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"durationMs": 4148.999208002351,
"inferenceMs": 4047.8482079997775,
"provider": "CPUExecutionProvider",
"placement": {
"CPUExecutionProvider": 3785
},
"coremlComputeUnits": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 4978.301082999678,
"megapixelsPerSecond": 0.1727811825102011,
"fallback": false,
"grade": "moderate"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9939310775684148,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.0033688924740999937,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CPUExecutionProvider"
],
"loadMs": 0,
"acceleration": "cpu",
"placementVerified": false,
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"durationMs": 3896.2853330012877,
"inferenceMs": 3828.124542000296,
"provider": "CPUExecutionProvider",
"placement": {
"CPUExecutionProvider": 3785
},
"coremlComputeUnits": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 3896.2853330012877,
"megapixelsPerSecond": 0.18269834022551137,
"fallback": false,
"grade": "moderate"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9941213544310151,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.0034127291291952133,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CPUExecutionProvider"
],
"loadMs": 0,
"acceleration": "cpu",
"placementVerified": false,
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"durationMs": 3758.3014169940725,
"inferenceMs": 3690.1569170004223,
"provider": "CPUExecutionProvider",
"placement": {
"CPUExecutionProvider": 3785
},
"coremlComputeUnits": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 3758.3014169940725,
"megapixelsPerSecond": 0.1895290676604905,
"fallback": false,
"grade": "moderate"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9941213544310151,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.0034127291291952133,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CPUExecutionProvider"
],
"loadMs": 0,
"acceleration": "cpu",
"placementVerified": false,
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"durationMs": 3724.6950000044308,
"inferenceMs": 3656.947791998391,
"provider": "CPUExecutionProvider",
"placement": {
"CPUExecutionProvider": 3785
},
"coremlComputeUnits": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 3724.6950000044308,
"megapixelsPerSecond": 0.1912502009272075,
"fallback": false,
"grade": "moderate"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9941213544310151,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.0034127291291952133,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CPUExecutionProvider"
],
"loadMs": 755.9178329975111,
"acceleration": "cpu",
"placementVerified": false,
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"durationMs": 4214.968667001813,
"inferenceMs": 4116.548917001637,
"provider": "CPUExecutionProvider",
"placement": {
"CPUExecutionProvider": 3785
},
"coremlComputeUnits": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 4970.886499999324,
"megapixelsPerSecond": 0.1698976531315981,
"fallback": false,
"grade": "moderate"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9941213544310151,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.0034127291291952133,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CPUExecutionProvider"
],
"loadMs": 0,
"acceleration": "cpu",
"placementVerified": false,
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"durationMs": 3914.108541997848,
"inferenceMs": 3845.9412080046604,
"provider": "CPUExecutionProvider",
"placement": {
"CPUExecutionProvider": 3785
},
"coremlComputeUnits": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 3914.108541997848,
"megapixelsPerSecond": 0.18185197385345794,
"fallback": false,
"grade": "moderate"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9941213544310151,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.0034127291291952133,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CPUExecutionProvider"
],
"loadMs": 0,
"acceleration": "cpu",
"placementVerified": false,
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"durationMs": 3748.7109169960604,
"inferenceMs": 3681.035374997009,
"provider": "CPUExecutionProvider",
"placement": {
"CPUExecutionProvider": 3785
},
"coremlComputeUnits": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 3748.7109169960604,
"megapixelsPerSecond": 0.18999871741264326,
"fallback": false,
"grade": "moderate"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9941213544310151,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.0034127291291952133,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CPUExecutionProvider"
],
"loadMs": 816.588417001185,
"acceleration": "cpu",
"placementVerified": false,
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"durationMs": 4121.43791699782,
"inferenceMs": 4020.677207998233,
"provider": "CPUExecutionProvider",
"placement": {
"CPUExecutionProvider": 3785
},
"coremlComputeUnits": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 4938.026333999005,
"megapixelsPerSecond": 0.17394880608886407,
"fallback": false,
"grade": "moderate"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9941213544310151,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.0034127291291952133,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CPUExecutionProvider"
],
"loadMs": 0,
"acceleration": "cpu",
"placementVerified": false,
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"durationMs": 4133.243708005466,
"inferenceMs": 4066.1570000011125,
"provider": "CPUExecutionProvider",
"placement": {
"CPUExecutionProvider": 3785
},
"coremlComputeUnits": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 4133.243708005466,
"megapixelsPerSecond": 0.17200319613822307,
"fallback": false,
"grade": "moderate"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9941213544310151,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.0034127291291952133,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CPUExecutionProvider"
],
"loadMs": 0,
"acceleration": "cpu",
"placementVerified": false,
"gpuPlanOperations": 0,
"gpuPlanSamples": [],
"durationMs": 3718.5582499951124,
"inferenceMs": 3651.4125839967164,
"provider": "CPUExecutionProvider",
"placement": {
"CPUExecutionProvider": 3785
},
"coremlComputeUnits": null,
"device": "cpu",
"precision": "fp32",
"cpuThreads": 4,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 3718.5582499951124,
"megapixelsPerSecond": 0.19154011876534327,
"fallback": false,
"grade": "moderate"
}
},
{
"precision": "fp16",
"device": "coreml",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.994126899136604,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.0034119493793696165,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CoreMLExecutionProvider",
"CPUExecutionProvider"
],
"loadMs": 6445.599917002255,
"acceleration": "partial",
"placementVerified": false,
"gpuPlanOperations": 23,
"gpuPlanSamples": [
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.062257",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.062257"
],
"durationMs": 9875.475415996334,
"inferenceMs": 9771.890208001423,
"provider": "CoreMLExecutionProvider",
"placement": {
"CPUExecutionProvider": 4538,
"CoreMLExecutionProvider": 79
},
"coremlComputeUnits": "CPUAndGPU",
"device": "coreml",
"precision": "fp16",
"cpuThreads": 4,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 16321.07533299859,
"megapixelsPerSecond": 0.07157182337428675,
"fallback": false,
"grade": "moderate"
}
},
{
"precision": "fp16",
"device": "coreml",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.9939421998850915,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.003368903649970889,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CoreMLExecutionProvider",
"CPUExecutionProvider"
],
"loadMs": 0,
"acceleration": "partial",
"placementVerified": false,
"gpuPlanOperations": 23,
"gpuPlanSamples": [
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.062257",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.062257"
],
"durationMs": 9132.533042000432,
"inferenceMs": 9062.554457996157,
"provider": "CoreMLExecutionProvider",
"placement": {
"CPUExecutionProvider": 4538,
"CoreMLExecutionProvider": 79
},
"coremlComputeUnits": "CPUAndGPU",
"device": "coreml",
"precision": "fp16",
"cpuThreads": 4,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 9132.533042000432,
"megapixelsPerSecond": 0.07717382590544392,
"fallback": false,
"grade": "moderate"
}
},
{
"precision": "fp16",
"device": "coreml",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.994126899136604,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.0034119493793696165,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CoreMLExecutionProvider",
"CPUExecutionProvider"
],
"loadMs": 0,
"acceleration": "partial",
"placementVerified": false,
"gpuPlanOperations": 23,
"gpuPlanSamples": [
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.062257",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.062257"
],
"durationMs": 8946.505167004943,
"inferenceMs": 8878.772916003072,
"provider": "CoreMLExecutionProvider",
"placement": {
"CPUExecutionProvider": 4538,
"CoreMLExecutionProvider": 79
},
"coremlComputeUnits": "CPUAndGPU",
"device": "coreml",
"precision": "fp16",
"cpuThreads": 4,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 8946.505167004943,
"megapixelsPerSecond": 0.07877124537552009,
"fallback": false,
"grade": "moderate"
}
},
{
"precision": "fp16",
"device": "coreml",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.994126899136604,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.0034119493793696165,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CoreMLExecutionProvider",
"CPUExecutionProvider"
],
"loadMs": 0,
"acceleration": "partial",
"placementVerified": false,
"gpuPlanOperations": 23,
"gpuPlanSamples": [
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.062257",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7ca5268b30> Apple M3 Max, Estimated Cost: 0.062257"
],
"durationMs": 8863.966249999066,
"inferenceMs": 8794.275000000198,
"provider": "CoreMLExecutionProvider",
"placement": {
"CPUExecutionProvider": 4538,
"CoreMLExecutionProvider": 79
},
"coremlComputeUnits": "CPUAndGPU",
"device": "coreml",
"precision": "fp16",
"cpuThreads": 4,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 8863.966249999066,
"megapixelsPerSecond": 0.07952810208914143,
"fallback": false,
"grade": "moderate"
}
},
{
"precision": "fp16",
"device": "coreml",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.994126899136604,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.0034119493793696165,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CoreMLExecutionProvider",
"CPUExecutionProvider"
],
"loadMs": 6709.003791998839,
"acceleration": "partial",
"placementVerified": false,
"gpuPlanOperations": 23,
"gpuPlanSamples": [
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.062257",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.062257"
],
"durationMs": 9358.475207998708,
"inferenceMs": 9254.921250001644,
"provider": "CoreMLExecutionProvider",
"placement": {
"CPUExecutionProvider": 4538,
"CoreMLExecutionProvider": 79
},
"coremlComputeUnits": "CPUAndGPU",
"device": "coreml",
"precision": "fp16",
"cpuThreads": 4,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 16067.478999997547,
"megapixelsPerSecond": 0.07556974080140075,
"fallback": false,
"grade": "moderate"
}
},
{
"precision": "fp16",
"device": "coreml",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.994126899136604,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.0034119493793696165,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CoreMLExecutionProvider",
"CPUExecutionProvider"
],
"loadMs": 0,
"acceleration": "partial",
"placementVerified": false,
"gpuPlanOperations": 23,
"gpuPlanSamples": [
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.062257",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.062257"
],
"durationMs": 9086.968625000736,
"inferenceMs": 9018.349750003836,
"provider": "CoreMLExecutionProvider",
"placement": {
"CPUExecutionProvider": 4538,
"CoreMLExecutionProvider": 79
},
"coremlComputeUnits": "CPUAndGPU",
"device": "coreml",
"precision": "fp16",
"cpuThreads": 4,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 9086.968625000736,
"megapixelsPerSecond": 0.07755210425274342,
"fallback": false,
"grade": "moderate"
}
},
{
"precision": "fp16",
"device": "coreml",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.994126899136604,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.0034119493793696165,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CoreMLExecutionProvider",
"CPUExecutionProvider"
],
"loadMs": 0,
"acceleration": "partial",
"placementVerified": false,
"gpuPlanOperations": 23,
"gpuPlanSamples": [
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.062257",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7824018b30> Apple M3 Max, Estimated Cost: 0.062257"
],
"durationMs": 8712.19837499666,
"inferenceMs": 8644.10633299849,
"provider": "CoreMLExecutionProvider",
"placement": {
"CPUExecutionProvider": 4538,
"CoreMLExecutionProvider": 79
},
"coremlComputeUnits": "CPUAndGPU",
"device": "coreml",
"precision": "fp16",
"cpuThreads": 4,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 8712.19837499666,
"megapixelsPerSecond": 0.08090969419592889,
"fallback": false,
"grade": "moderate"
}
},
{
"precision": "fp16",
"device": "coreml",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.994126899136604,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.0034119493793696165,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CoreMLExecutionProvider",
"CPUExecutionProvider"
],
"loadMs": 6701.549208999495,
"acceleration": "partial",
"placementVerified": false,
"gpuPlanOperations": 23,
"gpuPlanSamples": [
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.062257",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.062257"
],
"durationMs": 9421.282999996038,
"inferenceMs": 9318.32916699932,
"provider": "CoreMLExecutionProvider",
"placement": {
"CPUExecutionProvider": 4538,
"CoreMLExecutionProvider": 79
},
"coremlComputeUnits": "CPUAndGPU",
"device": "coreml",
"precision": "fp16",
"cpuThreads": 4,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 16122.832208995533,
"megapixelsPerSecond": 0.07505551558286684,
"fallback": false,
"grade": "moderate"
}
},
{
"precision": "fp16",
"device": "coreml",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.994126899136604,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.0034119493793696165,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CoreMLExecutionProvider",
"CPUExecutionProvider"
],
"loadMs": 0,
"acceleration": "partial",
"placementVerified": false,
"gpuPlanOperations": 23,
"gpuPlanSamples": [
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.062257",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.062257"
],
"durationMs": 8996.00216599356,
"inferenceMs": 8926.818624997395,
"provider": "CoreMLExecutionProvider",
"placement": {
"CPUExecutionProvider": 4538,
"CoreMLExecutionProvider": 79
},
"coremlComputeUnits": "CPUAndGPU",
"device": "coreml",
"precision": "fp16",
"cpuThreads": 4,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 8996.00216599356,
"megapixelsPerSecond": 0.07834728466886534,
"fallback": false,
"grade": "moderate"
}
},
{
"precision": "fp16",
"device": "coreml",
"status": "pass",
"quality": {
"passed": true,
"intersectionOverUnion": 0.994126899136604,
"minimumIoU": 0.7,
"meanAbsoluteAlphaError": 0.0034119493793696165,
"maximumMeanAbsoluteAlphaError": 0.16,
"validRgbaAndMask": true
},
"runtime": {
"engine": "onnxruntime",
"version": "1.23.2",
"providers": [
"CoreMLExecutionProvider",
"CPUExecutionProvider"
],
"loadMs": 0,
"acceleration": "partial",
"placementVerified": false,
"gpuPlanOperations": 23,
"gpuPlanSamples": [
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.062257",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios18.cast, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.046693",
"ios16.resize_bilinear, Device Usage: <MLGPUComputeDevice: 0x7ae3844b30> Apple M3 Max, Estimated Cost: 0.062257"
],
"durationMs": 8712.29024999775,
"inferenceMs": 8644.211207996705,
"provider": "CoreMLExecutionProvider",
"placement": {
"CPUExecutionProvider": 4538,
"CoreMLExecutionProvider": 79
},
"coremlComputeUnits": "CPUAndGPU",
"device": "coreml",
"precision": "fp16",
"cpuThreads": 4,
"artifactRevision": "de15b22ba131738a16dff04aab8bdf8dc32e3ac1",
"totalMs": 8712.29024999775,
"megapixelsPerSecond": 0.08090871256743437,
"fallback": false,
"grade": "moderate"
}
},
{
"precision": "fp32",
"device": "coreml",
"status": "fail",
"quality": "Not embedded",
"runtime": "Not embedded",
"failure": "[ONNXRuntimeError] : 1 : FAIL : Error compiling model: Failed to parse the model specification. Error: Unable to parse ML Program: in operation /squeeze_module/squeeze_module.0/dec_att/aspp_deforms.2/atrous_conv/Conv: Required param 'pad' is missing"
}
]BiRefNet Lite · 2K Desktop
49 configurations testedQuality criteria
{ "file": "research/birefnet-family-expansion/quality-gates.json", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "description": "Frozen complete PNG/dimensions/source-alpha, person/background interior, blank negative, and original reference IoU>=.7/MAE<=.16/boundaryF1>=.6. First forward<=20s, steady<=10s." }
| Precision | Device | Result | Platform | Inference / load | |
|---|---|---|---|---|---|
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 877 ms / 2321 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 908 ms / 2309 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 950 ms / 2395 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1035 ms / 2395 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1038 ms / 2321 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1041 ms / 2309 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1048 ms / 2395 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1058 ms / 2309 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1090 ms / 2309 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1091 ms / 2309 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1106 ms / 2321 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1118 ms / 2321 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1137 ms / 2321 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1150 ms / 2395 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1151 ms / 2395 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1156 ms / 2321 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1156 ms / 2321 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1169 ms / 2395 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1169 ms / 2309 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1187 ms / 2321 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1224 ms / 2309 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1232 ms / 2284 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1282 ms / 2268 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1314 ms / 2249 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1322 ms / 2268 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1390 ms / 2284 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1417 ms / 2284 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1420 ms / 2249 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1430 ms / 2268 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1434 ms / 2268 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1443 ms / 2249 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1443 ms / 2268 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1453 ms / 2249 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1469 ms / 2309 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1472 ms / 2284 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1475 ms / 2395 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1476 ms / 2249 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1498 ms / 2395 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1500 ms / 2268 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1511 ms / 2284 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1537 ms / 2249 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1557 ms / 2284 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1695 ms / 2268 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1695 ms / 2284 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1734 ms / 2268 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1736 ms / 2249 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1785 ms / 2249 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1991 ms / 2284 ms |
BF16 | mps | Failed | — | Not recorded | — / 2231 ms |
Test setup & sample details
- Quality gate
- { "file": "research/birefnet-family-expansion/quality-gates.json", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "description": "Frozen complete PNG/dimensions/source-alpha, person/background interior, blank negative, and original reference IoU>=.7/MAE<=.16/boundaryF1>=.6. First forward<=20s, steady<=10s." }
- Tested
- 2026-11-13T05:48:11.367645+00:00
- Environment
- { "os": "macos", "osVersion": "27.2", "architecture": "aarch64", "hardware": "Apple M3 Max;Mac15,11;96GiB RAM", "cpu": "Apple M3 Max", "gpu": "Apple M3 Max", "driver": "OS-managed Metal/MPS macOS27.2 build26B118", "runtime": "App-owned CPython3.13.18;Torch2.10.0;Torchvision0.25.0;Transformers5.22.1;Timm1.0.22;Kornia0.8.2;Einops0.8.1", "timingScope": "Three fresh helper/model loads per pair. Five quality fixtures and three warm portrait calls each load. Full task duration in inferenceMs; synchronized forward retained in modelForwardMs. Local snapshot loads; no network-transfer or fully cold OS/shader claim.", "concurrentUploadActivity": "none; uploads excluded" }
- Runtime
- pytorch 2.10.0
- Artifact revision
- 3f789d2ba403e2ee59ce08ee9250d4c1c590b418
- Fixture
{ "file": "research/birefnet-family-expansion/quality-gates.json", "size": 4905, "sha1": "8bf1bfccd9061a4a4a696da3efcec57d86666ccb", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "url": "https://assets.localai.tools/samples/v1/files/585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897/quality-gates.json" }- Rerun when
- artifact revision change; runtime or reviewed architecture change; fixture or quality gate change; pre/postprocessing or backend behavior change
Per-case quality & failure details
[
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1475.3095000050962,
"durationMs": 1475.3095000050962,
"imagesPerSecond": 0.6778238735645271,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 6775095296,
"modelForwardMs": 1374.3811669992283,
"loadMs": 2395.289166015573,
"totalMs": 3870.598666020669,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 0.9996596985901799,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1497.8151670075022,
"durationMs": 1497.8151670075022,
"imagesPerSecond": 0.6676391199842826,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 7781728256,
"modelForwardMs": 1434.542250004597,
"loadMs": 2395.289166015573,
"totalMs": 3893.104333023075,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1048.1954170390964,
"durationMs": 1048.1954170390964,
"imagesPerSecond": 0.9540205802700064,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 7781728256,
"modelForwardMs": 983.0330419936217,
"loadMs": 2395.289166015573,
"totalMs": 3443.484583054669,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1150.3253750270233,
"durationMs": 1150.3253750270233,
"imagesPerSecond": 0.8693192567159602,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 7781728256,
"modelForwardMs": 1088.2758750231005,
"loadMs": 2395.289166015573,
"totalMs": 3545.614541042596,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9933979585572614,
"alphaMAE": 0.0034247898006200986,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1168.663208023645,
"durationMs": 1168.663208023645,
"imagesPerSecond": 0.85567851638893,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 7781728256,
"modelForwardMs": 1054.9885830259882,
"loadMs": 2395.289166015573,
"totalMs": 3563.952374039218,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 949.7734589967877,
"durationMs": 949.7734589967877,
"imagesPerSecond": 1.0528826537817395,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 7781728256,
"modelForwardMs": 884.8739169770852,
"loadMs": 2395.289166015573,
"totalMs": 3345.0626250123605,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 1034.7766249906272,
"durationMs": 1034.7766249906272,
"imagesPerSecond": 0.9663921428540753,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 7781728256,
"modelForwardMs": 970.0599170173518,
"loadMs": 2395.289166015573,
"totalMs": 3430.0657910062,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 1150.5272919894196,
"durationMs": 1150.5272919894196,
"imagesPerSecond": 0.8691666916226409,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 7781728256,
"modelForwardMs": 1085.076667019166,
"loadMs": 2395.289166015573,
"totalMs": 3545.8164580049925,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1037.8201249986887,
"durationMs": 1037.8201249986887,
"imagesPerSecond": 0.9635581117693816,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 6775095296,
"modelForwardMs": 928.0472079990432,
"loadMs": 2321.237459022086,
"totalMs": 3359.057584020775,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 0.9996596985901799,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1187.1621669852175,
"durationMs": 1187.1621669852175,
"imagesPerSecond": 0.8423449026677515,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 7781728256,
"modelForwardMs": 1123.189750011079,
"loadMs": 2321.237459022086,
"totalMs": 3508.3996260073036,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1137.0677500381134,
"durationMs": 1137.0677500381134,
"imagesPerSecond": 0.8794550720187789,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 7781728256,
"modelForwardMs": 1072.5710830301978,
"loadMs": 2321.237459022086,
"totalMs": 3458.3052090601996,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1106.1700000427663,
"durationMs": 1106.1700000427663,
"imagesPerSecond": 0.9040201776954161,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 7781728256,
"modelForwardMs": 1045.5998749821447,
"loadMs": 2321.237459022086,
"totalMs": 3427.4074590648524,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9933979585572614,
"alphaMAE": 0.0034247898006200986,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1155.5273749982007,
"durationMs": 1155.5273749982007,
"imagesPerSecond": 0.8654057200519002,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 7781728256,
"modelForwardMs": 1041.9526670011692,
"loadMs": 2321.237459022086,
"totalMs": 3476.764834020287,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 876.7335420125164,
"durationMs": 876.7335420125164,
"imagesPerSecond": 1.1405974016969045,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 7781728256,
"modelForwardMs": 811.4788340171799,
"loadMs": 2321.237459022086,
"totalMs": 3197.9710010346025,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 1155.750000034459,
"durationMs": 1155.750000034459,
"imagesPerSecond": 0.8652390222541075,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 7781728256,
"modelForwardMs": 1091.6143750073388,
"loadMs": 2321.237459022086,
"totalMs": 3476.987459056545,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 1117.580333026126,
"durationMs": 1117.580333026126,
"imagesPerSecond": 0.8947902628997165,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 7781728256,
"modelForwardMs": 1052.3519160342403,
"loadMs": 2321.237459022086,
"totalMs": 3438.817792048212,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1041.462832945399,
"durationMs": 1041.462832945399,
"imagesPerSecond": 0.9601878899238906,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 6775095296,
"modelForwardMs": 939.480957982596,
"loadMs": 2308.862542035058,
"totalMs": 3350.325374980457,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 0.9996596985901799,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1169.1893329843879,
"durationMs": 1169.1893329843879,
"imagesPerSecond": 0.8552934685501044,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 7781728256,
"modelForwardMs": 1106.1228750040755,
"loadMs": 2308.862542035058,
"totalMs": 3478.051875019446,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1089.9382089846767,
"durationMs": 1089.9382089846767,
"imagesPerSecond": 0.9174832038703754,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 7781728256,
"modelForwardMs": 1025.0069169560447,
"loadMs": 2308.862542035058,
"totalMs": 3398.800751019735,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1090.8230420318432,
"durationMs": 1090.8230420318432,
"imagesPerSecond": 0.9167389773297511,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 7781728256,
"modelForwardMs": 1029.9959169933572,
"loadMs": 2308.862542035058,
"totalMs": 3399.6855840669014,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9933979585572614,
"alphaMAE": 0.0034247898006200986,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1224.255541979801,
"durationMs": 1224.255541979801,
"imagesPerSecond": 0.816822930924089,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 7781728256,
"modelForwardMs": 1110.829040990211,
"loadMs": 2308.862542035058,
"totalMs": 3533.118084014859,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 907.6083750114776,
"durationMs": 907.6083750114776,
"imagesPerSecond": 1.1017967964292463,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 7781728256,
"modelForwardMs": 841.0210000001825,
"loadMs": 2308.862542035058,
"totalMs": 3216.4709170465358,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 1469.2361250054091,
"durationMs": 1469.2361250054091,
"imagesPerSecond": 0.6806257911718026,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 7781728256,
"modelForwardMs": 1400.1822500140406,
"loadMs": 2308.862542035058,
"totalMs": 3778.0986670404673,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 1058.047832979355,
"durationMs": 1058.047832979355,
"imagesPerSecond": 0.945136853769741,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 7781728256,
"modelForwardMs": 993.789249972906,
"loadMs": 2308.862542035058,
"totalMs": 3366.910375014413,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1784.8527919850312,
"durationMs": 1784.8527919850312,
"imagesPerSecond": 0.5602702948335846,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 12202524672,
"modelForwardMs": 1681.3543749740347,
"loadMs": 2249.4864159962162,
"totalMs": 4034.3392079812475,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 0.9996434937611408,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1452.9392090043984,
"durationMs": 1452.9392090043984,
"imagesPerSecond": 0.6882600413029205,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 14215790592,
"modelForwardMs": 1388.0548330489546,
"loadMs": 2249.4864159962162,
"totalMs": 3702.4256250006147,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1443.3019169955514,
"durationMs": 1443.3019169955514,
"imagesPerSecond": 0.6928557277064035,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 14215790592,
"modelForwardMs": 1377.8368750354275,
"loadMs": 2249.4864159962162,
"totalMs": 3692.7883329917677,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1735.800124995876,
"durationMs": 1735.800124995876,
"imagesPerSecond": 0.5761031962147,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 14215790592,
"modelForwardMs": 1673.7642079824582,
"loadMs": 2249.4864159962162,
"totalMs": 3985.2865409920923,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9934258623672476,
"alphaMAE": 0.0034182126593316656,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1536.5738750551827,
"durationMs": 1536.5738750551827,
"imagesPerSecond": 0.6507985175552247,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 14215790592,
"modelForwardMs": 1422.3834160366096,
"loadMs": 2249.4864159962162,
"totalMs": 3786.060291051399,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 1314.3941250164062,
"durationMs": 1314.3941250164062,
"imagesPerSecond": 0.7608068089832021,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 14215790592,
"modelForwardMs": 1237.7633749856614,
"loadMs": 2249.4864159962162,
"totalMs": 3563.8805410126224,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 1420.3191249980591,
"durationMs": 1420.3191249980591,
"imagesPerSecond": 0.704067122944195,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 14215790592,
"modelForwardMs": 1352.9512920067646,
"loadMs": 2249.4864159962162,
"totalMs": 3669.8055409942754,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 1476.3166250195354,
"durationMs": 1476.3166250195354,
"imagesPerSecond": 0.6773614704682794,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 14215790592,
"modelForwardMs": 1410.8843749854714,
"loadMs": 2249.4864159962162,
"totalMs": 3725.8030410157517,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1990.8007089979947,
"durationMs": 1990.8007089979947,
"imagesPerSecond": 0.5023104500014558,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 12202524672,
"modelForwardMs": 1883.8970420183614,
"loadMs": 2284.042707993649,
"totalMs": 4274.843416991644,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 0.9996434937611408,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1511.1444999929518,
"durationMs": 1511.1444999929518,
"imagesPerSecond": 0.661750084128066,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 14215790592,
"modelForwardMs": 1446.2688749772497,
"loadMs": 2284.042707993649,
"totalMs": 3795.1872079866007,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1390.4652089695446,
"durationMs": 1390.4652089695446,
"imagesPerSecond": 0.7191837620598122,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 14215790592,
"modelForwardMs": 1324.6304159983993,
"loadMs": 2284.042707993649,
"totalMs": 3674.5079169631936,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1556.679792003706,
"durationMs": 1556.679792003706,
"imagesPerSecond": 0.6423928704777708,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 14215790592,
"modelForwardMs": 1494.622124999296,
"loadMs": 2284.042707993649,
"totalMs": 3840.722499997355,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9934258623672476,
"alphaMAE": 0.0034182126593316656,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1471.6833750135265,
"durationMs": 1471.6833750135265,
"imagesPerSecond": 0.6794939842211704,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 14215790592,
"modelForwardMs": 1356.475209002383,
"loadMs": 2284.042707993649,
"totalMs": 3755.7260830071755,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 1232.4258330045268,
"durationMs": 1232.4258330045268,
"imagesPerSecond": 0.8114078536978597,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 14215790592,
"modelForwardMs": 1167.9494170239195,
"loadMs": 2284.042707993649,
"totalMs": 3516.4685409981757,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 1695.4029580228962,
"durationMs": 1695.4029580228962,
"imagesPerSecond": 0.5898302791485959,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 14215790592,
"modelForwardMs": 1630.165999988094,
"loadMs": 2284.042707993649,
"totalMs": 3979.445666016545,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 1416.9141669990495,
"durationMs": 1416.9141669990495,
"imagesPerSecond": 0.7057590525175904,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 14215790592,
"modelForwardMs": 1350.1059169648215,
"loadMs": 2284.042707993649,
"totalMs": 3700.9568749926984,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1694.590583036188,
"durationMs": 1694.590583036188,
"imagesPerSecond": 0.5901130396985365,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 12202524672,
"modelForwardMs": 1594.8450419818982,
"loadMs": 2267.645000014454,
"totalMs": 3962.235583050642,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 0.9996434937611408,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1434.4687080010772,
"durationMs": 1434.4687080010772,
"imagesPerSecond": 0.6971222128599052,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 14215790592,
"modelForwardMs": 1370.3180409502238,
"loadMs": 2267.645000014454,
"totalMs": 3702.1137080155313,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1429.9537079641595,
"durationMs": 1429.9537079641595,
"imagesPerSecond": 0.6993233378328805,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 14215790592,
"modelForwardMs": 1364.5840419922024,
"loadMs": 2267.645000014454,
"totalMs": 3697.5987079786137,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1733.6562919663265,
"durationMs": 1733.6562919663265,
"imagesPerSecond": 0.5768156033199592,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 14215790592,
"modelForwardMs": 1671.7704590409994,
"loadMs": 2267.645000014454,
"totalMs": 4001.3012919807807,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9934258623672476,
"alphaMAE": 0.0034182126593316656,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1499.5460829813965,
"durationMs": 1499.5460829813965,
"imagesPerSecond": 0.6668684686313879,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 14215790592,
"modelForwardMs": 1382.2347500245087,
"loadMs": 2267.645000014454,
"totalMs": 3767.1910829958506,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 1281.7042500246316,
"durationMs": 1281.7042500246316,
"imagesPerSecond": 0.7802111914513681,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 14215790592,
"modelForwardMs": 1217.1745829982683,
"loadMs": 2267.645000014454,
"totalMs": 3549.3492500390857,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 1322.0552499988116,
"durationMs": 1322.0552499988116,
"imagesPerSecond": 0.7563980400977182,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 14215790592,
"modelForwardMs": 1256.7933339742012,
"loadMs": 2267.645000014454,
"totalMs": 3589.7002500132658,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 1443.3906250051223,
"durationMs": 1443.3906250051223,
"imagesPerSecond": 0.6928131461269892,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 14215790592,
"modelForwardMs": 1376.749666989781,
"loadMs": 2267.645000014454,
"totalMs": 3711.0356250195764,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "bf16",
"device": "mps",
"status": "fail",
"quality": {
"passed": false,
"error": "{'ok': False, 'code': 'runtime_error', 'error': 'Failed to create function state object for: deformable_im2col_bfloat', 'traceback': 'Traceback (most recent call last):\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 49, in <module>\\n with contextlib.redirect_stdout(sys.stderr):v=init(r)if r[\\'type\\']==\\'init\\'else {\\'healthy\\':net is not None}if r[\\'type\\']==\\'health\\'else generate(r)\\n ~~~~~~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 36, in generate\\n with torch.inference_mode():logits=net(x)[-1];matte=logits.float().sigmoid()\\n ~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_lite.py\", line 2063, in forward\\n scaled_preds, class_preds = self.forward_ori(x)\\n ~~~~~~~~~~~~~~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_lite.py\", line 2054, in forward_ori\\n x4 = self.squeeze_module(x4)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/container.py\", line 253, in forward\\n input = module(input)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_lite.py\", line 1436, in forward\\n x = self.dec_att(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_lite.py\", line 1612, in forward\\n x1 = self.aspp1(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_lite.py\", line 1583, in forward\\n x = self.atrous_conv(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_lite.py\", line 1290, in forward\\n x = deform_conv2d(\\n input=x,\\n ...<5 lines>...\\n stride=self.stride,\\n )\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torchvision/ops/deform_conv.py\", line 92, in deform_conv2d\\n return torch.ops.torchvision.deform_conv2d(\\n ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^\\n input,\\n ^^^^^^\\n ...<12 lines>...\\n use_mask,\\n ^^^^^^^^^\\n )\\n ^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/_ops.py\", line 1209, in __call__\\n return self._op(*args, **kwargs)\\n ~~~~~~~~^^^^^^^^^^^^^^^^^\\nRuntimeError: Failed to create function state object for: deformable_im2col_bfloat\\n'}",
"individualFixturePassedBeforeConfigurationGate": false
},
"runtime": {
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "3f789d2ba403e2ee59ce08ee9250d4c1c590b418",
"requestedDevice": "mps",
"requestedPrecision": "bf16",
"cpuThreads": 4,
"fallback": false,
"loadMs": 2231.328374997247
},
"failure": "{'ok': False, 'code': 'runtime_error', 'error': 'Failed to create function state object for: deformable_im2col_bfloat', 'traceback': 'Traceback (most recent call last):\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 49, in <module>\\n with contextlib.redirect_stdout(sys.stderr):v=init(r)if r[\\'type\\']==\\'init\\'else {\\'healthy\\':net is not None}if r[\\'type\\']==\\'health\\'else generate(r)\\n ~~~~~~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 36, in generate\\n with torch.inference_mode():logits=net(x)[-1];matte=logits.float().sigmoid()\\n ~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_lite.py\", line 2063, in forward\\n scaled_preds, class_preds = self.forward_ori(x)\\n ~~~~~~~~~~~~~~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_lite.py\", line 2054, in forward_ori\\n x4 = self.squeeze_module(x4)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/container.py\", line 253, in forward\\n input = module(input)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_lite.py\", line 1436, in forward\\n x = self.dec_att(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_lite.py\", line 1612, in forward\\n x1 = self.aspp1(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_lite.py\", line 1583, in forward\\n x = self.atrous_conv(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_lite.py\", line 1290, in forward\\n x = deform_conv2d(\\n input=x,\\n ...<5 lines>...\\n stride=self.stride,\\n )\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torchvision/ops/deform_conv.py\", line 92, in deform_conv2d\\n return torch.ops.torchvision.deform_conv2d(\\n ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^\\n input,\\n ^^^^^^\\n ...<12 lines>...\\n use_mask,\\n ^^^^^^^^^\\n )\\n ^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/_ops.py\", line 1209, in __call__\\n return self._op(*args, **kwargs)\\n ~~~~~~~~^^^^^^^^^^^^^^^^^\\nRuntimeError: Failed to create function state object for: deformable_im2col_bfloat\\n'}"
}
]BiRefNet Portrait Desktop
52 configurations testedQuality criteria
{ "file": "research/birefnet-family-expansion/quality-gates.json", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "description": "Frozen complete PNG/dimensions/source-alpha, person/background interior, blank negative, and original reference IoU>=.7/MAE<=.16/boundaryF1>=.6. First forward<=20s, steady<=10s." }
| Precision | Device | Result | Platform | Inference / load | |
|---|---|---|---|---|---|
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 611 ms / 4227 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 623 ms / 4227 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 652 ms / 4155 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 653 ms / 4271 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 653 ms / 4227 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 654 ms / 4155 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 655 ms / 4155 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 656 ms / 4155 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 657 ms / 4271 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 662 ms / 4227 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 662 ms / 4271 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 679 ms / 4227 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 679 ms / 4271 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 683 ms / 4271 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 687 ms / 4155 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 696 ms / 4271 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 697 ms / 4155 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 701 ms / 4227 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 704 ms / 4227 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 706 ms / 4155 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 735 ms / 4680 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 738 ms / 4271 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 743 ms / 4503 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 762 ms / 4595 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 765 ms / 4503 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 766 ms / 4503 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 769 ms / 4595 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 772 ms / 4680 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 773 ms / 4503 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 774 ms / 4595 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 778 ms / 4595 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 782 ms / 4595 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 783 ms / 4680 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 787 ms / 4680 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 792 ms / 4503 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 798 ms / 4680 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 800 ms / 4503 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 820 ms / 4680 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 826 ms / 4503 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 837 ms / 4680 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 845 ms / 4595 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 904 ms / 4595 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 916 ms / 4271 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 937 ms / 4227 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1009 ms / 4680 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1012 ms / 4595 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1043 ms / 4503 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 1121 ms / 4155 ms |
BF16 | mps | Failed | — | Not recorded | — / 4269 ms |
FP32 | cpu | Failed | — | Not recorded | 8324 ms / 5230 ms |
FP32 | cpu | Failed | — | Not recorded | 7961 ms / 5230 ms |
FP32 | cpu | Failed | — | Not recorded | 10352 ms / 5230 ms |
Test setup & sample details
- Quality gate
- { "file": "research/birefnet-family-expansion/quality-gates.json", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "description": "Frozen complete PNG/dimensions/source-alpha, person/background interior, blank negative, and original reference IoU>=.7/MAE<=.16/boundaryF1>=.6. First forward<=20s, steady<=10s." }
- Tested
- 2026-11-13T05:48:11.367645+00:00
- Environment
- { "os": "macos", "osVersion": "27.2", "architecture": "aarch64", "hardware": "Apple M3 Max;Mac15,11;96GiB RAM", "cpu": "Apple M3 Max", "gpu": "Apple M3 Max", "driver": "OS-managed Metal/MPS macOS27.2 build26B118", "runtime": "App-owned CPython3.13.18;Torch2.10.0;Torchvision0.25.0;Transformers5.22.1;Timm1.0.22;Kornia0.8.2;Einops0.8.1", "timingScope": "Three fresh helper/model loads per pair. Five quality fixtures and three warm portrait calls each load. Full task duration in inferenceMs; synchronized forward retained in modelForwardMs. Local snapshot loads; no network-transfer or fully cold OS/shader claim.", "concurrentUploadActivity": "none; uploads excluded" }
- Runtime
- pytorch 2.10.0
- Artifact revision
- b6561965a70070d9143fd9e558f6ca3c481510db
- Fixture
{ "file": "research/birefnet-family-expansion/quality-gates.json", "size": 4905, "sha1": "8bf1bfccd9061a4a4a696da3efcec57d86666ccb", "sha256": "585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897", "url": "https://assets.localai.tools/samples/v1/files/585261f04263688c12910f8b38c01bf9b092e6a01ede59f58b6923c7965c9897/quality-gates.json" }- Rerun when
- artifact revision change; runtime or reviewed architecture change; fixture or quality gate change; pre/postprocessing or backend behavior change
Per-case quality & failure details
[
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1120.889125042595,
"durationMs": 1120.889125042595,
"imagesPerSecond": 0.8921489000635981,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 1094.689958030358,
"loadMs": 4155.396541988011,
"totalMs": 5276.285667030606,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 655.8363750227727,
"durationMs": 655.8363750227727,
"imagesPerSecond": 1.5247705648612078,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 636.0622079810128,
"loadMs": 4155.396541988011,
"totalMs": 4811.232917010784,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 687.277749995701,
"durationMs": 687.277749995701,
"imagesPerSecond": 1.45501582148739,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 666.4045840152539,
"loadMs": 4155.396541988011,
"totalMs": 4842.6742919837125,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 706.3681249856018,
"durationMs": 706.3681249856018,
"imagesPerSecond": 1.4156924196153153,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 689.3360420363024,
"loadMs": 4155.396541988011,
"totalMs": 4861.764666973613,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9927361990571564,
"alphaMAE": 0.0036986298911951283,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 696.7470000381581,
"durationMs": 696.7470000381581,
"imagesPerSecond": 1.4352411993811727,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 634.4311659922823,
"loadMs": 4155.396541988011,
"totalMs": 4852.14354202617,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 654.8350409721024,
"durationMs": 654.8350409721024,
"imagesPerSecond": 1.5271021515823286,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 633.1552500487305,
"loadMs": 4155.396541988011,
"totalMs": 4810.231582960114,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 651.968999998644,
"durationMs": 651.968999998644,
"imagesPerSecond": 1.5338152580906146,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 630.4231669637375,
"loadMs": 4155.396541988011,
"totalMs": 4807.365541986655,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 653.7441249820404,
"durationMs": 653.7441249820404,
"imagesPerSecond": 1.5296504577038792,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 632.7912499546073,
"loadMs": 4155.396541988011,
"totalMs": 4809.140666970052,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 937.1302080107853,
"durationMs": 937.1302080107853,
"imagesPerSecond": 1.0670875737990202,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 911.0048749716952,
"loadMs": 4227.310749993194,
"totalMs": 5164.440958003979,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 704.4124999665655,
"durationMs": 704.4124999665655,
"imagesPerSecond": 1.4196227353254867,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 684.9117090459913,
"loadMs": 4227.310749993194,
"totalMs": 4931.723249959759,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 611.1600419972092,
"durationMs": 611.1600419972092,
"imagesPerSecond": 1.6362326253072783,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 589.6069589653052,
"loadMs": 4227.310749993194,
"totalMs": 4838.470791990403,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 623.3026249683462,
"durationMs": 623.3026249683462,
"imagesPerSecond": 1.6043571131290904,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 605.6082499562763,
"loadMs": 4227.310749993194,
"totalMs": 4850.61337496154,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9927361990571564,
"alphaMAE": 0.0036986298911951283,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 700.6471669883467,
"durationMs": 700.6471669883467,
"imagesPerSecond": 1.427251899552221,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 637.3582079540938,
"loadMs": 4227.310749993194,
"totalMs": 4927.957916981541,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 661.8846249766648,
"durationMs": 661.8846249766648,
"imagesPerSecond": 1.5108373306529908,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 640.0230409926735,
"loadMs": 4227.310749993194,
"totalMs": 4889.195374969859,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 678.9492500247434,
"durationMs": 678.9492500247434,
"imagesPerSecond": 1.4728641352259486,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 656.9729580078274,
"loadMs": 4227.310749993194,
"totalMs": 4906.260000017937,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 653.292250004597,
"durationMs": 653.292250004597,
"imagesPerSecond": 1.5307084998987257,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 631.6815000027418,
"loadMs": 4227.310749993194,
"totalMs": 4880.602999997791,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 916.1853329860605,
"durationMs": 916.1853329860605,
"imagesPerSecond": 1.091482218713072,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 889.9674160056747,
"loadMs": 4270.781708997674,
"totalMs": 5186.967041983735,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 683.2597909960896,
"durationMs": 683.2597909960896,
"imagesPerSecond": 1.4635721480729182,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 662.8712079836987,
"loadMs": 4270.781708997674,
"totalMs": 4954.041499993764,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 656.625708041247,
"durationMs": 656.625708041247,
"imagesPerSecond": 1.52293763060703,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 633.8894170476124,
"loadMs": 4270.781708997674,
"totalMs": 4927.407417038921,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 652.6740840054117,
"durationMs": 652.6740840054117,
"imagesPerSecond": 1.5321582770118207,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 635.3105830494314,
"loadMs": 4270.781708997674,
"totalMs": 4923.455793003086,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9927361990571564,
"alphaMAE": 0.0036986298911951283,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 738.0380830145441,
"durationMs": 738.0380830145441,
"imagesPerSecond": 1.354943630978313,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 675.7624169695191,
"loadMs": 4270.781708997674,
"totalMs": 5008.819792012218,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 679.4781670323573,
"durationMs": 679.4781670323573,
"imagesPerSecond": 1.471717633500326,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 657.8237499925308,
"loadMs": 4270.781708997674,
"totalMs": 4950.259876030032,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 662.3080410063267,
"durationMs": 662.3080410063267,
"imagesPerSecond": 1.5098714466467538,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 639.2512079910375,
"loadMs": 4270.781708997674,
"totalMs": 4933.089750004001,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 695.6062500248663,
"durationMs": 695.6062500248663,
"imagesPerSecond": 1.4375949036746756,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 3681796096,
"modelForwardMs": 671.7277080169879,
"loadMs": 4270.781708997674,
"totalMs": 4966.387959022541,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp16",
"actualPrecision": "fp16",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1043.3020000346005,
"durationMs": 1043.3020000346005,
"imagesPerSecond": 0.9584952391223592,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 1017.4104170291685,
"loadMs": 4502.6455000042915,
"totalMs": 5545.947500038892,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 765.3659170027822,
"durationMs": 765.3659170027822,
"imagesPerSecond": 1.3065645827502466,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 743.3151250006631,
"loadMs": 4502.6455000042915,
"totalMs": 5268.011417007074,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 766.2040829891339,
"durationMs": 766.2040829891339,
"imagesPerSecond": 1.3051353055947912,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 745.5540830269456,
"loadMs": 4502.6455000042915,
"totalMs": 5268.849582993425,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 772.9746249970049,
"durationMs": 772.9746249970049,
"imagesPerSecond": 1.2937035287592717,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 754.0331670315936,
"loadMs": 4502.6455000042915,
"totalMs": 5275.620125001296,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9927302956420828,
"alphaMAE": 0.003696504796098524,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 826.2182080070488,
"durationMs": 826.2182080070488,
"imagesPerSecond": 1.2103340138341137,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 761.4825409837067,
"loadMs": 4502.6455000042915,
"totalMs": 5328.86370801134,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 742.5603750161827,
"durationMs": 742.5603750161827,
"imagesPerSecond": 1.3466918430413244,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 717.6350409863517,
"loadMs": 4502.6455000042915,
"totalMs": 5245.205875020474,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 799.6798329986632,
"durationMs": 799.6798329986632,
"imagesPerSecond": 1.2505004612285524,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 776.7993750167079,
"loadMs": 4502.6455000042915,
"totalMs": 5302.325333002955,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 792.4912919988856,
"durationMs": 792.4912919988856,
"imagesPerSecond": 1.2618435181511196,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 766.2846670136787,
"loadMs": 4502.6455000042915,
"totalMs": 5295.136792003177,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1009.0817910386249,
"durationMs": 1009.0817910386249,
"imagesPerSecond": 0.9909999455749992,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 983.4377500228584,
"loadMs": 4679.871624975931,
"totalMs": 5688.953416014556,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 771.7518330318853,
"durationMs": 771.7518330318853,
"imagesPerSecond": 1.2957533201721394,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 748.4757500351407,
"loadMs": 4679.871624975931,
"totalMs": 5451.623458007816,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 819.968499999959,
"durationMs": 819.968499999959,
"imagesPerSecond": 1.2195590440365087,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 795.8695419947617,
"loadMs": 4679.871624975931,
"totalMs": 5499.84012497589,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 783.4260829840787,
"durationMs": 783.4260829840787,
"imagesPerSecond": 1.2764446087766046,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 763.9480829820968,
"loadMs": 4679.871624975931,
"totalMs": 5463.29770796001,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9927302956420828,
"alphaMAE": 0.003696504796098524,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 837.1554999612272,
"durationMs": 837.1554999612272,
"imagesPerSecond": 1.1945212090780206,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 770.893957989756,
"loadMs": 4679.871624975931,
"totalMs": 5517.027124937158,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 735.2553329546936,
"durationMs": 735.2553329546936,
"imagesPerSecond": 1.3600717399510789,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 712.8836250049062,
"loadMs": 4679.871624975931,
"totalMs": 5415.1269579306245,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 786.9681669981219,
"durationMs": 786.9681669981219,
"imagesPerSecond": 1.270699428433662,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 764.2574170022272,
"loadMs": 4679.871624975931,
"totalMs": 5466.839791974053,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 798.1832919758745,
"durationMs": 798.1832919758745,
"imagesPerSecond": 1.2528450671080016,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 776.0327500291169,
"loadMs": 4679.871624975931,
"totalMs": 5478.054916951805,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 1012.3289999901317,
"durationMs": 1012.3289999901317,
"imagesPerSecond": 0.9878211530142356,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 986.0957499477081,
"loadMs": 4595.023499976378,
"totalMs": 5607.35249996651,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 761.8123749853112,
"durationMs": 761.8123749853112,
"imagesPerSecond": 1.312659170204844,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 742.4576249904931,
"loadMs": 4595.023499976378,
"totalMs": 5356.835874961689,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 773.7157919909805,
"durationMs": 773.7157919909805,
"imagesPerSecond": 1.2924642489546825,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 751.0321249719709,
"loadMs": 4595.023499976378,
"totalMs": 5368.739291967358,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": true,
"speedPassed": true
},
"runtime": {
"inferenceMs": 781.9577089976519,
"durationMs": 781.9577089976519,
"imagesPerSecond": 1.2788415389904453,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 764.2173750209622,
"loadMs": 4595.023499976378,
"totalMs": 5376.98120897403,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true,
"iou": 0.9927302956420828,
"alphaMAE": 0.003696504796098524,
"boundaryF1": 0.9698420296792724,
"speedPassed": true
},
"runtime": {
"inferenceMs": 844.946124998387,
"durationMs": 844.946124998387,
"imagesPerSecond": 1.1835074100161227,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 774.0900000208057,
"loadMs": 4595.023499976378,
"totalMs": 5439.969624974765,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 768.98379198974,
"durationMs": 768.98379198974,
"imagesPerSecond": 1.300417525592454,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 747.0207079895772,
"loadMs": 4595.023499976378,
"totalMs": 5364.007291966118,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 777.5200409814715,
"durationMs": 777.5200409814715,
"imagesPerSecond": 1.2861404816494373,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 753.4645000123419,
"loadMs": 4595.023499976378,
"totalMs": 5372.5435409578495,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": true
},
"runtime": {
"inferenceMs": 904.2491670115851,
"durationMs": 904.2491670115851,
"imagesPerSecond": 1.1058898769073326,
"predictionDevice": "mps:0",
"implicitMpsFallback": false,
"provider": "PyTorch MPS",
"acceleration": "partial",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": 5885919232,
"modelForwardMs": 882.968207995873,
"loadMs": 4595.023499976378,
"totalMs": 5499.272666987963,
"grade": "good",
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"actualDevice": "mps",
"requestedPrecision": "fp32",
"actualPrecision": "fp32",
"fallback": false,
"cpuThreads": 4
}
},
{
"precision": "bf16",
"device": "mps",
"status": "fail",
"quality": {
"passed": false,
"error": "{'ok': False, 'code': 'runtime_error', 'error': 'Failed to create function state object for: deformable_im2col_bfloat', 'traceback': 'Traceback (most recent call last):\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 49, in <module>\\n with contextlib.redirect_stdout(sys.stderr):v=init(r)if r[\\'type\\']==\\'init\\'else {\\'healthy\\':net is not None}if r[\\'type\\']==\\'health\\'else generate(r)\\n ~~~~~~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 36, in generate\\n with torch.inference_mode():logits=net(x)[-1];matte=logits.float().sigmoid()\\n ~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2063, in forward\\n scaled_preds, class_preds = self.forward_ori(x)\\n ~~~~~~~~~~~~~~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2054, in forward_ori\\n x4 = self.squeeze_module(x4)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/container.py\", line 253, in forward\\n input = module(input)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1436, in forward\\n x = self.dec_att(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1612, in forward\\n x1 = self.aspp1(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1583, in forward\\n x = self.atrous_conv(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1290, in forward\\n x = deform_conv2d(\\n input=x,\\n ...<5 lines>...\\n stride=self.stride,\\n )\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torchvision/ops/deform_conv.py\", line 92, in deform_conv2d\\n return torch.ops.torchvision.deform_conv2d(\\n ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^\\n input,\\n ^^^^^^\\n ...<12 lines>...\\n use_mask,\\n ^^^^^^^^^\\n )\\n ^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/_ops.py\", line 1209, in __call__\\n return self._op(*args, **kwargs)\\n ~~~~~~~~^^^^^^^^^^^^^^^^^\\nRuntimeError: Failed to create function state object for: deformable_im2col_bfloat\\n'}",
"individualFixturePassedBeforeConfigurationGate": false
},
"runtime": {
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "mps",
"requestedPrecision": "bf16",
"cpuThreads": 4,
"fallback": false,
"loadMs": 4269.43562499946
},
"failure": "{'ok': False, 'code': 'runtime_error', 'error': 'Failed to create function state object for: deformable_im2col_bfloat', 'traceback': 'Traceback (most recent call last):\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 49, in <module>\\n with contextlib.redirect_stdout(sys.stderr):v=init(r)if r[\\'type\\']==\\'init\\'else {\\'healthy\\':net is not None}if r[\\'type\\']==\\'health\\'else generate(r)\\n ~~~~~~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/research/birefnet-family-expansion/native-runtime.py\", line 36, in generate\\n with torch.inference_mode():logits=net(x)[-1];matte=logits.float().sigmoid()\\n ~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2063, in forward\\n scaled_preds, class_preds = self.forward_ori(x)\\n ~~~~~~~~~~~~~~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 2054, in forward_ori\\n x4 = self.squeeze_module(x4)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/container.py\", line 253, in forward\\n input = module(input)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1436, in forward\\n x = self.dec_att(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1612, in forward\\n x1 = self.aspp1(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1583, in forward\\n x = self.atrous_conv(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1776, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1787, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/architecture_large.py\", line 1290, in forward\\n x = deform_conv2d(\\n input=x,\\n ...<5 lines>...\\n stride=self.stride,\\n )\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torchvision/ops/deform_conv.py\", line 92, in deform_conv2d\\n return torch.ops.torchvision.deform_conv2d(\\n ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^\\n input,\\n ^^^^^^\\n ...<12 lines>...\\n use_mask,\\n ^^^^^^^^^\\n )\\n ^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/.cache/birefnet-family/runtime/venv/lib/python3.13/site-packages/torch/_ops.py\", line 1209, in __call__\\n return self._op(*args, **kwargs)\\n ~~~~~~~~^^^^^^^^^^^^^^^^^\\nRuntimeError: Failed to create function state object for: deformable_im2col_bfloat\\n'}"
},
{
"precision": "fp32",
"device": "cpu",
"status": "fail",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": false,
"speedPassed": true,
"individualFixturePassedBeforeConfigurationGate": true
},
"runtime": {
"inferenceMs": 8324.208707956132,
"durationMs": 8358.356459008064,
"imagesPerSecond": 0.120131538634323,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"cpuThreads": 4,
"fallback": false,
"loadMs": 5229.836667014752,
"totalMs": 13554.045374970883
},
"failure": null
},
{
"precision": "fp32",
"device": "cpu",
"status": "fail",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"personMean": 1,
"backgroundMean": 0,
"passed": false,
"iou": 0.9927302956420828,
"alphaMAE": 0.003696504796098524,
"boundaryF1": 0.9698420296792724,
"speedPassed": true,
"individualFixturePassedBeforeConfigurationGate": true
},
"runtime": {
"inferenceMs": 7960.779500019271,
"durationMs": 8024.108332989272,
"imagesPerSecond": 0.12561583950385502,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"cpuThreads": 4,
"fallback": false,
"loadMs": 5229.836667014752,
"totalMs": 13190.616167034023
},
"failure": null
},
{
"precision": "fp32",
"device": "cpu",
"status": "fail",
"quality": {
"dimensions": true,
"completeAlphaMultiplication": true,
"finite": true,
"foregroundFraction": 0,
"passed": false,
"speedPassed": false,
"individualFixturePassedBeforeConfigurationGate": false
},
"runtime": {
"inferenceMs": 10351.713707961608,
"durationMs": 10368.304207979236,
"imagesPerSecond": 0.09660236248911036,
"predictionDevice": "cpu",
"implicitMpsFallback": false,
"provider": "PyTorch CPU",
"acceleration": "cpu",
"visualizationMs": 0,
"driverAllocatedMemoryBytes": null,
"engine": "pytorch",
"version": "2.10.0",
"artifactRevision": "b6561965a70070d9143fd9e558f6ca3c481510db",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"cpuThreads": 4,
"fallback": false,
"loadMs": 5229.836667014752,
"totalMs": 15581.55037497636
},
"failure": null
}
]