Stable Diffusion 1.5 Inpainting
Fill masked image regions from an English prompt using native Stable Diffusion v1.5 Inpainting. White removes, black keeps; returns a same-size PNG with unmasked pixels preserved.
Desktop app
Run Stable Diffusion 1.5 Inpainting on your computer
Download the desktop app to load this model, provide input and view results locally.
Public desktop downloads are coming soon.Device requirements
If your device falls short
MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.
GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.
PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.
Benchmark evidence
Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.
Stable Diffusion v1.5 — Prompt-guided Inpainting
27 configurations testedQuality criteria
No explicit quality gate recorded. Review per-case evidence; full certification is pending.
| Precision | Device | Result | Platform | Inference / load | Task metric | |
|---|---|---|---|---|---|---|
FP32 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 3860 ms / 1121 ms | 0.017 MP/s |
FP32 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 8800 ms / 0 ms | 0.030 MP/s |
FP32 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 9173 ms / 0 ms | 0.029 MP/s |
FP32 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 9768 ms / 1213 ms | 0.027 MP/s |
FP32 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 9954 ms / 0 ms | 0.010 MP/s |
FP32 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 10223 ms / 0 ms | 0.026 MP/s |
FP32 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 10272 ms / 0 ms | 0.026 MP/s |
FP32 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 10688 ms / 0 ms | 0.025 MP/s |
FP32 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 10725 ms / 1068 ms | 0.024 MP/s |
FP32 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 10745 ms / 0 ms | 0.024 MP/s |
FP32 | mpsAccelerated | Passed | Moderate | macos · aarch64 | 11171 ms / 1116 ms | 0.023 MP/s |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 9763 ms / 510 ms | 0.007 MP/s |
FP32 | cpu | Passed | Moderate | macos · aarch64 | 15064 ms / 0 ms | 0.007 MP/s |
FP32 | cpu | Passed | Slow | macos · aarch64 | 44025 ms / 0 ms | 0.006 MP/s |
FP32 | cpu | Passed | Slow | macos · aarch64 | 44080 ms / 0 ms | 0.006 MP/s |
FP32 | cpu | Passed | Slow | macos · aarch64 | 44110 ms / 0 ms | 0.006 MP/s |
FP32 | cpu | Passed | Slow | macos · aarch64 | 44129 ms / 0 ms | 0.006 MP/s |
FP32 | cpu | Passed | Slow | macos · aarch64 | 44267 ms / 538 ms | 0.006 MP/s |
FP32 | cpu | Passed | Slow | macos · aarch64 | 44358 ms / 473 ms | 0.006 MP/s |
FP32 | cpu | Passed | Slow | macos · aarch64 | 44653 ms / 549 ms | 0.006 MP/s |
FP32 | cpu | Passed | Slow | macos · aarch64 | 45052 ms / 0 ms | 0.006 MP/s |
FP32 | cpu | Passed | Slow | macos · aarch64 | 45080 ms / 0 ms | 0.006 MP/s |
FP32 | cpu | Passed | Slow | macos · aarch64 | 86598 ms / 758 ms | 0.003 MP/s |
FP32 | cpu | Failed | — | macos · aarch64 | 9752 ms / 0 ms | 0.007 MP/s |
FP32 | mps | Failed | — | macos · aarch64 | 4899 ms / 0 ms | 0.013 MP/s |
FP16 | mps | Failed | — | Not recorded | — / — | — |
FP16 | mps | Failed | — | macos · aarch64 | 9786 ms / 897 ms | 0.027 MP/s |
Test setup & sample details
- Quality gate
- No explicit quality gate recorded. Review the per-case quality evidence; full certification is pending.
- Tested
- 2026-11-01T19:04:27.728743+00:00
- Environment
- { "hardware": "Apple M3 Max", "os": "macOS-27.2-arm64-arm-64bit-Mach-O", "python": "3.13.1", "runtime": "Diffusers0.32.2/Transformers4.51.3/Torch2.6.0" }
- Runtime
- diffusers 0.32.2
- Artifact revision
- 8a4288a76071f7280aedbdb3253bdb9e9d5d84bb
- Fixture
{ "file": "model-samples/desktop/sd-inpainting/apple-input.png", "size": 1973, "sha1": "487d764f617fc722991378183f76fec4f55c2370", "sha256": "6495fc916e21c21cf147ced19cba84b0ae33804c3e023c3131c64574fe4c4f76", "url": "https://assets.localai.tools/samples/v1/files/6495fc916e21c21cf147ced19cba84b0ae33804c3e023c3131c64574fe4c4f76/apple-input.png" }- Rerun when
- artifact revision/checksums; Diffusers/Transformers/Torch/NumPy/Pillow/driver/device; scheduler/mask/padding/compositing/VAE tiling/attention implementation; fixtures/prompt/config/CLIP evaluator/quality gates
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"maskedClipCosine": 0.29475101828575134,
"maskedPixelStd": 0.2180727869272232,
"outsideMaskExact": true,
"emptyMaskIdentity": true,
"dimensionsExact": true,
"safetyFlag": false,
"gates": {
"minimumMaskedClipCosine": 0.22,
"minimumMaskedStd": 0.03,
"outsideMaskExact": true,
"dimensionsExact": true,
"emptyMaskIdentity": true,
"nsfwFlagFalse": true
},
"evaluatorRevision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268",
"method": "Independent prompt vs masked-region OpenAI CLIP ViT-B/32 cosine, nonflat RGB, exact unmasked pixels/dimensions/no-mask identity; not aesthetic/safety/broad semantic certification"
},
"runtime": {
"engine": "diffusers",
"version": "0.32.2",
"transformersVersion": "4.51.3",
"torchVersion": "2.6.0",
"loadMs": 757.9325410006277,
"device": "cpu",
"placement": {
"unet": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae": {
"device": "cpu",
"dtype": "torch.float32"
},
"text_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"safety_checker": {
"device": "cpu",
"dtype": "torch.float32"
}
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "UNet/VAE/CLIP/safety checker on selected device; tokenize/decode/padding/mask composite/PNG and seeded RNG CPU",
"observedPlacement": {
"text_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"unet": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae_decoder": {
"device": "cpu",
"dtype": "torch.float32"
}
},
"inferenceMs": 86598.29704200092,
"durationMs": 86615.38366700188,
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"promptTokens": 13,
"promptTruncated": false,
"negativePromptTokens": 2,
"safetyCheckerAvailable": true,
"maskedPixels": 147456,
"paddedWidth": 512,
"paddedHeight": 512,
"megapixelsPerSecond": 0.003027126501954858,
"precision": "fp32",
"cpuThreads": 1,
"totalMs": 87373.3162080025,
"artifactRevision": "8a4288a76071f7280aedbdb3253bdb9e9d5d84bb",
"fallback": false,
"imagesPerSecond": 0.011547571189708169,
"grade": "slow"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"maskedClipCosine": 0.2952187955379486,
"maskedPixelStd": 0.21843436360359192,
"outsideMaskExact": true,
"emptyMaskIdentity": true,
"dimensionsExact": true,
"safetyFlag": false,
"gates": {
"minimumMaskedClipCosine": 0.22,
"minimumMaskedStd": 0.03,
"outsideMaskExact": true,
"dimensionsExact": true,
"emptyMaskIdentity": true,
"nsfwFlagFalse": true
},
"evaluatorRevision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268",
"method": "Independent prompt vs masked-region OpenAI CLIP ViT-B/32 cosine, nonflat RGB, exact unmasked pixels/dimensions/no-mask identity; not aesthetic/safety/broad semantic certification"
},
"runtime": {
"engine": "diffusers",
"version": "0.32.2",
"transformersVersion": "4.51.3",
"torchVersion": "2.6.0",
"loadMs": 549.3014580024465,
"device": "cpu",
"placement": {
"unet": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae": {
"device": "cpu",
"dtype": "torch.float32"
},
"text_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"safety_checker": {
"device": "cpu",
"dtype": "torch.float32"
}
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "UNet/VAE/CLIP/safety checker on selected device; tokenize/decode/padding/mask composite/PNG and seeded RNG CPU",
"observedPlacement": {
"text_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"unet": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae_decoder": {
"device": "cpu",
"dtype": "torch.float32"
}
},
"inferenceMs": 44652.617166997516,
"durationMs": 44670.46225000013,
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"promptTokens": 13,
"promptTruncated": false,
"negativePromptTokens": 2,
"safetyCheckerAvailable": true,
"maskedPixels": 147456,
"paddedWidth": 512,
"paddedHeight": 512,
"megapixelsPerSecond": 0.005870742111702,
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 45219.763708002574,
"artifactRevision": "8a4288a76071f7280aedbdb3253bdb9e9d5d84bb",
"fallback": false,
"imagesPerSecond": 0.02239510388069916,
"grade": "slow"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"maskedClipCosine": 0.33861473202705383,
"maskedPixelStd": 0.21379728615283966,
"outsideMaskExact": true,
"emptyMaskIdentity": true,
"dimensionsExact": true,
"safetyFlag": false,
"gates": {
"minimumMaskedClipCosine": 0.22,
"minimumMaskedStd": 0.03,
"outsideMaskExact": true,
"dimensionsExact": true,
"emptyMaskIdentity": true,
"nsfwFlagFalse": true
},
"evaluatorRevision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268",
"method": "Independent prompt vs masked-region OpenAI CLIP ViT-B/32 cosine, nonflat RGB, exact unmasked pixels/dimensions/no-mask identity; not aesthetic/safety/broad semantic certification"
},
"runtime": {
"engine": "diffusers",
"version": "0.32.2",
"transformersVersion": "4.51.3",
"torchVersion": "2.6.0",
"loadMs": 0,
"device": "cpu",
"placement": {
"unet": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae": {
"device": "cpu",
"dtype": "torch.float32"
},
"text_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"safety_checker": {
"device": "cpu",
"dtype": "torch.float32"
}
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "UNet/VAE/CLIP/safety checker on selected device; tokenize/decode/padding/mask composite/PNG and seeded RNG CPU",
"observedPlacement": {
"text_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"unet": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae_decoder": {
"device": "cpu",
"dtype": "torch.float32"
}
},
"inferenceMs": 44128.78854200244,
"durationMs": 44141.6772090015,
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"promptTokens": 13,
"promptTruncated": false,
"negativePromptTokens": 2,
"safetyCheckerAvailable": true,
"maskedPixels": 147456,
"paddedWidth": 512,
"paddedHeight": 512,
"megapixelsPerSecond": 0.0059404304686607795,
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 44141.6772090015,
"artifactRevision": "8a4288a76071f7280aedbdb3253bdb9e9d5d84bb",
"fallback": false,
"imagesPerSecond": 0.022660943865435716,
"grade": "slow"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"maskedClipCosine": 0.28740450739860535,
"maskedPixelStd": 0.1608732044696808,
"outsideMaskExact": true,
"emptyMaskIdentity": true,
"dimensionsExact": true,
"safetyFlag": false,
"gates": {
"minimumMaskedClipCosine": 0.22,
"minimumMaskedStd": 0.03,
"outsideMaskExact": true,
"dimensionsExact": true,
"emptyMaskIdentity": true,
"nsfwFlagFalse": true
},
"evaluatorRevision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268",
"method": "Independent prompt vs masked-region OpenAI CLIP ViT-B/32 cosine, nonflat RGB, exact unmasked pixels/dimensions/no-mask identity; not aesthetic/safety/broad semantic certification"
},
"runtime": {
"engine": "diffusers",
"version": "0.32.2",
"transformersVersion": "4.51.3",
"torchVersion": "2.6.0",
"loadMs": 0,
"device": "cpu",
"placement": {
"unet": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae": {
"device": "cpu",
"dtype": "torch.float32"
},
"text_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"safety_checker": {
"device": "cpu",
"dtype": "torch.float32"
}
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "UNet/VAE/CLIP/safety checker on selected device; tokenize/decode/padding/mask composite/PNG and seeded RNG CPU",
"observedPlacement": {
"text_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"unet": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae_decoder": {
"device": "cpu",
"dtype": "torch.float32"
}
},
"inferenceMs": 15064.416958000947,
"durationMs": 15070.087083000544,
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"promptTokens": 14,
"promptTruncated": false,
"negativePromptTokens": 2,
"safetyCheckerAvailable": true,
"maskedPixels": 56260,
"paddedWidth": 392,
"paddedHeight": 264,
"megapixelsPerSecond": 0.006653626242518778,
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 15070.087083000544,
"artifactRevision": "8a4288a76071f7280aedbdb3253bdb9e9d5d84bb",
"fallback": false,
"imagesPerSecond": 0.06638159331276902,
"grade": "moderate"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "fail",
"quality": {
"passed": false,
"maskedClipCosine": null,
"maskedPixelStd": null,
"outsideMaskExact": true,
"emptyMaskIdentity": true,
"dimensionsExact": true,
"safetyFlag": true,
"gates": {
"minimumMaskedClipCosine": 0.22,
"minimumMaskedStd": 0.03,
"outsideMaskExact": true,
"dimensionsExact": true,
"emptyMaskIdentity": true,
"nsfwFlagFalse": true
},
"evaluatorRevision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268",
"method": "Independent prompt vs masked-region OpenAI CLIP ViT-B/32 cosine, nonflat RGB, exact unmasked pixels/dimensions/no-mask identity; not aesthetic/safety/broad semantic certification"
},
"runtime": {
"engine": "diffusers",
"version": "0.32.2",
"transformersVersion": "4.51.3",
"torchVersion": "2.6.0",
"loadMs": 0,
"device": "cpu",
"placement": {
"unet": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae": {
"device": "cpu",
"dtype": "torch.float32"
},
"text_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"safety_checker": {
"device": "cpu",
"dtype": "torch.float32"
}
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "UNet/VAE/CLIP/safety checker on selected device; tokenize/decode/padding/mask composite/PNG and seeded RNG CPU",
"observedPlacement": {
"text_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"unet": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae_decoder": {
"device": "cpu",
"dtype": "torch.float32"
}
},
"inferenceMs": 9751.824457998737,
"durationMs": 9753.523458999553,
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"promptTokens": 12,
"promptTruncated": false,
"negativePromptTokens": 2,
"safetyCheckerAvailable": true,
"maskedPixels": 0,
"paddedWidth": 256,
"paddedHeight": 256,
"megapixelsPerSecond": 0.0067203834812926124,
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 9753.523458999553,
"artifactRevision": "8a4288a76071f7280aedbdb3253bdb9e9d5d84bb",
"fallback": false,
"imagesPerSecond": 0.1025449139601534,
"grade": "moderate"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"maskedClipCosine": 0.2952187955379486,
"maskedPixelStd": 0.21843436360359192,
"outsideMaskExact": true,
"emptyMaskIdentity": true,
"dimensionsExact": true,
"safetyFlag": false,
"gates": {
"minimumMaskedClipCosine": 0.22,
"minimumMaskedStd": 0.03,
"outsideMaskExact": true,
"dimensionsExact": true,
"emptyMaskIdentity": true,
"nsfwFlagFalse": true
},
"evaluatorRevision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268",
"method": "Independent prompt vs masked-region OpenAI CLIP ViT-B/32 cosine, nonflat RGB, exact unmasked pixels/dimensions/no-mask identity; not aesthetic/safety/broad semantic certification"
},
"runtime": {
"engine": "diffusers",
"version": "0.32.2",
"transformersVersion": "4.51.3",
"torchVersion": "2.6.0",
"loadMs": 538.2766670009005,
"device": "cpu",
"placement": {
"unet": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae": {
"device": "cpu",
"dtype": "torch.float32"
},
"text_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"safety_checker": {
"device": "cpu",
"dtype": "torch.float32"
}
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "UNet/VAE/CLIP/safety checker on selected device; tokenize/decode/padding/mask composite/PNG and seeded RNG CPU",
"observedPlacement": {
"text_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"unet": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae_decoder": {
"device": "cpu",
"dtype": "torch.float32"
}
},
"inferenceMs": 44266.969625001366,
"durationMs": 44284.9376669983,
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"promptTokens": 13,
"promptTruncated": false,
"negativePromptTokens": 2,
"safetyCheckerAvailable": true,
"maskedPixels": 147456,
"paddedWidth": 512,
"paddedHeight": 512,
"megapixelsPerSecond": 0.005921887181812977,
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 44823.2143339992,
"artifactRevision": "8a4288a76071f7280aedbdb3253bdb9e9d5d84bb",
"fallback": false,
"imagesPerSecond": 0.022590206839801702,
"grade": "slow"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"maskedClipCosine": 0.2952187955379486,
"maskedPixelStd": 0.21843436360359192,
"outsideMaskExact": true,
"emptyMaskIdentity": true,
"dimensionsExact": true,
"safetyFlag": false,
"gates": {
"minimumMaskedClipCosine": 0.22,
"minimumMaskedStd": 0.03,
"outsideMaskExact": true,
"dimensionsExact": true,
"emptyMaskIdentity": true,
"nsfwFlagFalse": true
},
"evaluatorRevision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268",
"method": "Independent prompt vs masked-region OpenAI CLIP ViT-B/32 cosine, nonflat RGB, exact unmasked pixels/dimensions/no-mask identity; not aesthetic/safety/broad semantic certification"
},
"runtime": {
"engine": "diffusers",
"version": "0.32.2",
"transformersVersion": "4.51.3",
"torchVersion": "2.6.0",
"loadMs": 0,
"device": "cpu",
"placement": {
"unet": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae": {
"device": "cpu",
"dtype": "torch.float32"
},
"text_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"safety_checker": {
"device": "cpu",
"dtype": "torch.float32"
}
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "UNet/VAE/CLIP/safety checker on selected device; tokenize/decode/padding/mask composite/PNG and seeded RNG CPU",
"observedPlacement": {
"text_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"unet": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae_decoder": {
"device": "cpu",
"dtype": "torch.float32"
}
},
"inferenceMs": 44024.62170799845,
"durationMs": 44037.33033300159,
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"promptTokens": 13,
"promptTruncated": false,
"negativePromptTokens": 2,
"safetyCheckerAvailable": true,
"maskedPixels": 147456,
"paddedWidth": 512,
"paddedHeight": 512,
"megapixelsPerSecond": 0.005954486145019466,
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 44037.33033300159,
"artifactRevision": "8a4288a76071f7280aedbdb3253bdb9e9d5d84bb",
"fallback": false,
"imagesPerSecond": 0.022714562015607707,
"grade": "slow"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"maskedClipCosine": 0.2952187955379486,
"maskedPixelStd": 0.21843436360359192,
"outsideMaskExact": true,
"emptyMaskIdentity": true,
"dimensionsExact": true,
"safetyFlag": false,
"gates": {
"minimumMaskedClipCosine": 0.22,
"minimumMaskedStd": 0.03,
"outsideMaskExact": true,
"dimensionsExact": true,
"emptyMaskIdentity": true,
"nsfwFlagFalse": true
},
"evaluatorRevision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268",
"method": "Independent prompt vs masked-region OpenAI CLIP ViT-B/32 cosine, nonflat RGB, exact unmasked pixels/dimensions/no-mask identity; not aesthetic/safety/broad semantic certification"
},
"runtime": {
"engine": "diffusers",
"version": "0.32.2",
"transformersVersion": "4.51.3",
"torchVersion": "2.6.0",
"loadMs": 0,
"device": "cpu",
"placement": {
"unet": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae": {
"device": "cpu",
"dtype": "torch.float32"
},
"text_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"safety_checker": {
"device": "cpu",
"dtype": "torch.float32"
}
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "UNet/VAE/CLIP/safety checker on selected device; tokenize/decode/padding/mask composite/PNG and seeded RNG CPU",
"observedPlacement": {
"text_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"unet": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae_decoder": {
"device": "cpu",
"dtype": "torch.float32"
}
},
"inferenceMs": 44079.58345899897,
"durationMs": 44092.18666599918,
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"promptTokens": 13,
"promptTruncated": false,
"negativePromptTokens": 2,
"safetyCheckerAvailable": true,
"maskedPixels": 147456,
"paddedWidth": 512,
"paddedHeight": 512,
"megapixelsPerSecond": 0.005947061642355029,
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 44092.18666599918,
"artifactRevision": "8a4288a76071f7280aedbdb3253bdb9e9d5d84bb",
"fallback": false,
"imagesPerSecond": 0.022686239785595055,
"grade": "slow"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"maskedClipCosine": 0.2952187955379486,
"maskedPixelStd": 0.21843436360359192,
"outsideMaskExact": true,
"emptyMaskIdentity": true,
"dimensionsExact": true,
"safetyFlag": false,
"gates": {
"minimumMaskedClipCosine": 0.22,
"minimumMaskedStd": 0.03,
"outsideMaskExact": true,
"dimensionsExact": true,
"emptyMaskIdentity": true,
"nsfwFlagFalse": true
},
"evaluatorRevision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268",
"method": "Independent prompt vs masked-region OpenAI CLIP ViT-B/32 cosine, nonflat RGB, exact unmasked pixels/dimensions/no-mask identity; not aesthetic/safety/broad semantic certification"
},
"runtime": {
"engine": "diffusers",
"version": "0.32.2",
"transformersVersion": "4.51.3",
"torchVersion": "2.6.0",
"loadMs": 473.4560419965419,
"device": "cpu",
"placement": {
"unet": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae": {
"device": "cpu",
"dtype": "torch.float32"
},
"text_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"safety_checker": {
"device": "cpu",
"dtype": "torch.float32"
}
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "UNet/VAE/CLIP/safety checker on selected device; tokenize/decode/padding/mask composite/PNG and seeded RNG CPU",
"observedPlacement": {
"text_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"unet": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae_decoder": {
"device": "cpu",
"dtype": "torch.float32"
}
},
"inferenceMs": 44357.61354200076,
"durationMs": 44375.478875001136,
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"promptTokens": 13,
"promptTruncated": false,
"negativePromptTokens": 2,
"safetyCheckerAvailable": true,
"maskedPixels": 147456,
"paddedWidth": 512,
"paddedHeight": 512,
"megapixelsPerSecond": 0.005909785921007325,
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 44848.93491699768,
"artifactRevision": "8a4288a76071f7280aedbdb3253bdb9e9d5d84bb",
"fallback": false,
"imagesPerSecond": 0.022544044193295767,
"grade": "slow"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"maskedClipCosine": 0.2952187955379486,
"maskedPixelStd": 0.21843436360359192,
"outsideMaskExact": true,
"emptyMaskIdentity": true,
"dimensionsExact": true,
"safetyFlag": false,
"gates": {
"minimumMaskedClipCosine": 0.22,
"minimumMaskedStd": 0.03,
"outsideMaskExact": true,
"dimensionsExact": true,
"emptyMaskIdentity": true,
"nsfwFlagFalse": true
},
"evaluatorRevision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268",
"method": "Independent prompt vs masked-region OpenAI CLIP ViT-B/32 cosine, nonflat RGB, exact unmasked pixels/dimensions/no-mask identity; not aesthetic/safety/broad semantic certification"
},
"runtime": {
"engine": "diffusers",
"version": "0.32.2",
"transformersVersion": "4.51.3",
"torchVersion": "2.6.0",
"loadMs": 0,
"device": "cpu",
"placement": {
"unet": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae": {
"device": "cpu",
"dtype": "torch.float32"
},
"text_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"safety_checker": {
"device": "cpu",
"dtype": "torch.float32"
}
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "UNet/VAE/CLIP/safety checker on selected device; tokenize/decode/padding/mask composite/PNG and seeded RNG CPU",
"observedPlacement": {
"text_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"unet": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae_decoder": {
"device": "cpu",
"dtype": "torch.float32"
}
},
"inferenceMs": 45051.95174999972,
"durationMs": 45064.840625000215,
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"promptTokens": 13,
"promptTruncated": false,
"negativePromptTokens": 2,
"safetyCheckerAvailable": true,
"maskedPixels": 147456,
"paddedWidth": 512,
"paddedHeight": 512,
"megapixelsPerSecond": 0.00581870462471144,
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 45064.840625000215,
"artifactRevision": "8a4288a76071f7280aedbdb3253bdb9e9d5d84bb",
"fallback": false,
"imagesPerSecond": 0.022196596621366273,
"grade": "slow"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"maskedClipCosine": 0.2952187955379486,
"maskedPixelStd": 0.21843436360359192,
"outsideMaskExact": true,
"emptyMaskIdentity": true,
"dimensionsExact": true,
"safetyFlag": false,
"gates": {
"minimumMaskedClipCosine": 0.22,
"minimumMaskedStd": 0.03,
"outsideMaskExact": true,
"dimensionsExact": true,
"emptyMaskIdentity": true,
"nsfwFlagFalse": true
},
"evaluatorRevision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268",
"method": "Independent prompt vs masked-region OpenAI CLIP ViT-B/32 cosine, nonflat RGB, exact unmasked pixels/dimensions/no-mask identity; not aesthetic/safety/broad semantic certification"
},
"runtime": {
"engine": "diffusers",
"version": "0.32.2",
"transformersVersion": "4.51.3",
"torchVersion": "2.6.0",
"loadMs": 0,
"device": "cpu",
"placement": {
"unet": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae": {
"device": "cpu",
"dtype": "torch.float32"
},
"text_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"safety_checker": {
"device": "cpu",
"dtype": "torch.float32"
}
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "UNet/VAE/CLIP/safety checker on selected device; tokenize/decode/padding/mask composite/PNG and seeded RNG CPU",
"observedPlacement": {
"text_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"unet": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae_decoder": {
"device": "cpu",
"dtype": "torch.float32"
}
},
"inferenceMs": 45079.80262499768,
"durationMs": 45092.33145800317,
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"promptTokens": 13,
"promptTruncated": false,
"negativePromptTokens": 2,
"safetyCheckerAvailable": true,
"maskedPixels": 147456,
"paddedWidth": 512,
"paddedHeight": 512,
"megapixelsPerSecond": 0.005815109755042178,
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 45092.33145800317,
"artifactRevision": "8a4288a76071f7280aedbdb3253bdb9e9d5d84bb",
"fallback": false,
"imagesPerSecond": 0.02218288328186866,
"grade": "slow"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"maskedClipCosine": 0.29660657048225403,
"maskedPixelStd": 0.2182992845773697,
"outsideMaskExact": true,
"emptyMaskIdentity": true,
"dimensionsExact": true,
"safetyFlag": false,
"gates": {
"minimumMaskedClipCosine": 0.22,
"minimumMaskedStd": 0.03,
"outsideMaskExact": true,
"dimensionsExact": true,
"emptyMaskIdentity": true,
"nsfwFlagFalse": true
},
"evaluatorRevision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268",
"method": "Independent prompt vs masked-region OpenAI CLIP ViT-B/32 cosine, nonflat RGB, exact unmasked pixels/dimensions/no-mask identity; not aesthetic/safety/broad semantic certification"
},
"runtime": {
"engine": "diffusers",
"version": "0.32.2",
"transformersVersion": "4.51.3",
"torchVersion": "2.6.0",
"loadMs": 1213.3081249994575,
"device": "mps",
"placement": {
"unet": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae": {
"device": "mps:0",
"dtype": "torch.float32"
},
"text_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"safety_checker": {
"device": "mps:0",
"dtype": "torch.float32"
}
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "UNet/VAE/CLIP/safety checker on selected device; tokenize/decode/padding/mask composite/PNG and seeded RNG CPU",
"observedPlacement": {
"text_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"unet": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae_decoder": {
"device": "mps:0",
"dtype": "torch.float32"
}
},
"inferenceMs": 9767.668624997896,
"durationMs": 9785.939290999522,
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"promptTokens": 13,
"promptTruncated": false,
"negativePromptTokens": 2,
"safetyCheckerAvailable": true,
"maskedPixels": 147456,
"paddedWidth": 512,
"paddedHeight": 512,
"megapixelsPerSecond": 0.02683792930168702,
"driverAllocatedMemoryBytes": 9022373888,
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 10999.24741599898,
"artifactRevision": "8a4288a76071f7280aedbdb3253bdb9e9d5d84bb",
"fallback": false,
"imagesPerSecond": 0.10237857552218255,
"grade": "moderate"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"maskedClipCosine": 0.33834004402160645,
"maskedPixelStd": 0.2136726826429367,
"outsideMaskExact": true,
"emptyMaskIdentity": true,
"dimensionsExact": true,
"safetyFlag": false,
"gates": {
"minimumMaskedClipCosine": 0.22,
"minimumMaskedStd": 0.03,
"outsideMaskExact": true,
"dimensionsExact": true,
"emptyMaskIdentity": true,
"nsfwFlagFalse": true
},
"evaluatorRevision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268",
"method": "Independent prompt vs masked-region OpenAI CLIP ViT-B/32 cosine, nonflat RGB, exact unmasked pixels/dimensions/no-mask identity; not aesthetic/safety/broad semantic certification"
},
"runtime": {
"engine": "diffusers",
"version": "0.32.2",
"transformersVersion": "4.51.3",
"torchVersion": "2.6.0",
"loadMs": 0,
"device": "mps",
"placement": {
"unet": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae": {
"device": "mps:0",
"dtype": "torch.float32"
},
"text_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"safety_checker": {
"device": "mps:0",
"dtype": "torch.float32"
}
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "UNet/VAE/CLIP/safety checker on selected device; tokenize/decode/padding/mask composite/PNG and seeded RNG CPU",
"observedPlacement": {
"text_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"unet": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae_decoder": {
"device": "mps:0",
"dtype": "torch.float32"
}
},
"inferenceMs": 8800.189333000162,
"durationMs": 8813.021750000189,
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"promptTokens": 13,
"promptTruncated": false,
"negativePromptTokens": 2,
"safetyCheckerAvailable": true,
"maskedPixels": 147456,
"paddedWidth": 512,
"paddedHeight": 512,
"megapixelsPerSecond": 0.029788450007203402,
"driverAllocatedMemoryBytes": 9022373888,
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 8813.021750000189,
"artifactRevision": "8a4288a76071f7280aedbdb3253bdb9e9d5d84bb",
"fallback": false,
"imagesPerSecond": 0.11363391878968583,
"grade": "moderate"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"maskedClipCosine": 0.2868315577507019,
"maskedPixelStd": 0.16071823239326477,
"outsideMaskExact": true,
"emptyMaskIdentity": true,
"dimensionsExact": true,
"safetyFlag": false,
"gates": {
"minimumMaskedClipCosine": 0.22,
"minimumMaskedStd": 0.03,
"outsideMaskExact": true,
"dimensionsExact": true,
"emptyMaskIdentity": true,
"nsfwFlagFalse": true
},
"evaluatorRevision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268",
"method": "Independent prompt vs masked-region OpenAI CLIP ViT-B/32 cosine, nonflat RGB, exact unmasked pixels/dimensions/no-mask identity; not aesthetic/safety/broad semantic certification"
},
"runtime": {
"engine": "diffusers",
"version": "0.32.2",
"transformersVersion": "4.51.3",
"torchVersion": "2.6.0",
"loadMs": 0,
"device": "mps",
"placement": {
"unet": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae": {
"device": "mps:0",
"dtype": "torch.float32"
},
"text_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"safety_checker": {
"device": "mps:0",
"dtype": "torch.float32"
}
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "UNet/VAE/CLIP/safety checker on selected device; tokenize/decode/padding/mask composite/PNG and seeded RNG CPU",
"observedPlacement": {
"text_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"unet": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae_decoder": {
"device": "mps:0",
"dtype": "torch.float32"
}
},
"inferenceMs": 9954.194874997484,
"durationMs": 9959.815624999464,
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"promptTokens": 14,
"promptTruncated": false,
"negativePromptTokens": 2,
"safetyCheckerAvailable": true,
"maskedPixels": 56260,
"paddedWidth": 392,
"paddedHeight": 264,
"megapixelsPerSecond": 0.01006942311846445,
"driverAllocatedMemoryBytes": 9051242496,
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 9959.815624999464,
"artifactRevision": "8a4288a76071f7280aedbdb3253bdb9e9d5d84bb",
"fallback": false,
"imagesPerSecond": 0.10046015901414154,
"grade": "moderate"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "fail",
"quality": {
"passed": false,
"maskedClipCosine": null,
"maskedPixelStd": null,
"outsideMaskExact": true,
"emptyMaskIdentity": true,
"dimensionsExact": true,
"safetyFlag": true,
"gates": {
"minimumMaskedClipCosine": 0.22,
"minimumMaskedStd": 0.03,
"outsideMaskExact": true,
"dimensionsExact": true,
"emptyMaskIdentity": true,
"nsfwFlagFalse": true
},
"evaluatorRevision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268",
"method": "Independent prompt vs masked-region OpenAI CLIP ViT-B/32 cosine, nonflat RGB, exact unmasked pixels/dimensions/no-mask identity; not aesthetic/safety/broad semantic certification"
},
"runtime": {
"engine": "diffusers",
"version": "0.32.2",
"transformersVersion": "4.51.3",
"torchVersion": "2.6.0",
"loadMs": 0,
"device": "mps",
"placement": {
"unet": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae": {
"device": "mps:0",
"dtype": "torch.float32"
},
"text_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"safety_checker": {
"device": "mps:0",
"dtype": "torch.float32"
}
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "UNet/VAE/CLIP/safety checker on selected device; tokenize/decode/padding/mask composite/PNG and seeded RNG CPU",
"observedPlacement": {
"text_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"unet": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae_decoder": {
"device": "mps:0",
"dtype": "torch.float32"
}
},
"inferenceMs": 4899.128083998221,
"durationMs": 4900.778167000681,
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"promptTokens": 12,
"promptTruncated": false,
"negativePromptTokens": 2,
"safetyCheckerAvailable": true,
"maskedPixels": 0,
"paddedWidth": 256,
"paddedHeight": 256,
"megapixelsPerSecond": 0.013377074221442992,
"driverAllocatedMemoryBytes": 9064726528,
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 4900.778167000681,
"artifactRevision": "8a4288a76071f7280aedbdb3253bdb9e9d5d84bb",
"fallback": false,
"imagesPerSecond": 0.20411795381840503,
"grade": "moderate"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"maskedClipCosine": 0.29660657048225403,
"maskedPixelStd": 0.2182992845773697,
"outsideMaskExact": true,
"emptyMaskIdentity": true,
"dimensionsExact": true,
"safetyFlag": false,
"gates": {
"minimumMaskedClipCosine": 0.22,
"minimumMaskedStd": 0.03,
"outsideMaskExact": true,
"dimensionsExact": true,
"emptyMaskIdentity": true,
"nsfwFlagFalse": true
},
"evaluatorRevision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268",
"method": "Independent prompt vs masked-region OpenAI CLIP ViT-B/32 cosine, nonflat RGB, exact unmasked pixels/dimensions/no-mask identity; not aesthetic/safety/broad semantic certification"
},
"runtime": {
"engine": "diffusers",
"version": "0.32.2",
"transformersVersion": "4.51.3",
"torchVersion": "2.6.0",
"loadMs": 1068.3385000011185,
"device": "mps",
"placement": {
"unet": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae": {
"device": "mps:0",
"dtype": "torch.float32"
},
"text_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"safety_checker": {
"device": "mps:0",
"dtype": "torch.float32"
}
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "UNet/VAE/CLIP/safety checker on selected device; tokenize/decode/padding/mask composite/PNG and seeded RNG CPU",
"observedPlacement": {
"text_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"unet": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae_decoder": {
"device": "mps:0",
"dtype": "torch.float32"
}
},
"inferenceMs": 10725.089374998788,
"durationMs": 10742.419958001847,
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"promptTokens": 13,
"promptTruncated": false,
"negativePromptTokens": 2,
"safetyCheckerAvailable": true,
"maskedPixels": 147456,
"paddedWidth": 512,
"paddedHeight": 512,
"megapixelsPerSecond": 0.024442127317939447,
"driverAllocatedMemoryBytes": 9290809344,
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 11810.758458002965,
"artifactRevision": "8a4288a76071f7280aedbdb3253bdb9e9d5d84bb",
"fallback": false,
"imagesPerSecond": 0.09323931624580173,
"grade": "moderate"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"maskedClipCosine": 0.29660657048225403,
"maskedPixelStd": 0.2182992845773697,
"outsideMaskExact": true,
"emptyMaskIdentity": true,
"dimensionsExact": true,
"safetyFlag": false,
"gates": {
"minimumMaskedClipCosine": 0.22,
"minimumMaskedStd": 0.03,
"outsideMaskExact": true,
"dimensionsExact": true,
"emptyMaskIdentity": true,
"nsfwFlagFalse": true
},
"evaluatorRevision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268",
"method": "Independent prompt vs masked-region OpenAI CLIP ViT-B/32 cosine, nonflat RGB, exact unmasked pixels/dimensions/no-mask identity; not aesthetic/safety/broad semantic certification"
},
"runtime": {
"engine": "diffusers",
"version": "0.32.2",
"transformersVersion": "4.51.3",
"torchVersion": "2.6.0",
"loadMs": 0,
"device": "mps",
"placement": {
"unet": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae": {
"device": "mps:0",
"dtype": "torch.float32"
},
"text_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"safety_checker": {
"device": "mps:0",
"dtype": "torch.float32"
}
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "UNet/VAE/CLIP/safety checker on selected device; tokenize/decode/padding/mask composite/PNG and seeded RNG CPU",
"observedPlacement": {
"text_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"unet": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae_decoder": {
"device": "mps:0",
"dtype": "torch.float32"
}
},
"inferenceMs": 10223.466499999631,
"durationMs": 10236.004665999644,
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"promptTokens": 13,
"promptTruncated": false,
"negativePromptTokens": 2,
"safetyCheckerAvailable": true,
"maskedPixels": 147456,
"paddedWidth": 512,
"paddedHeight": 512,
"megapixelsPerSecond": 0.02564140059538606,
"driverAllocatedMemoryBytes": 9290809344,
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 10236.004665999644,
"artifactRevision": "8a4288a76071f7280aedbdb3253bdb9e9d5d84bb",
"fallback": false,
"imagesPerSecond": 0.09781418073801446,
"grade": "moderate"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"maskedClipCosine": 0.29660657048225403,
"maskedPixelStd": 0.2182992845773697,
"outsideMaskExact": true,
"emptyMaskIdentity": true,
"dimensionsExact": true,
"safetyFlag": false,
"gates": {
"minimumMaskedClipCosine": 0.22,
"minimumMaskedStd": 0.03,
"outsideMaskExact": true,
"dimensionsExact": true,
"emptyMaskIdentity": true,
"nsfwFlagFalse": true
},
"evaluatorRevision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268",
"method": "Independent prompt vs masked-region OpenAI CLIP ViT-B/32 cosine, nonflat RGB, exact unmasked pixels/dimensions/no-mask identity; not aesthetic/safety/broad semantic certification"
},
"runtime": {
"engine": "diffusers",
"version": "0.32.2",
"transformersVersion": "4.51.3",
"torchVersion": "2.6.0",
"loadMs": 0,
"device": "mps",
"placement": {
"unet": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae": {
"device": "mps:0",
"dtype": "torch.float32"
},
"text_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"safety_checker": {
"device": "mps:0",
"dtype": "torch.float32"
}
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "UNet/VAE/CLIP/safety checker on selected device; tokenize/decode/padding/mask composite/PNG and seeded RNG CPU",
"observedPlacement": {
"text_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"unet": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae_decoder": {
"device": "mps:0",
"dtype": "torch.float32"
}
},
"inferenceMs": 10272.49545900122,
"durationMs": 10284.847416001867,
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"promptTokens": 13,
"promptTruncated": false,
"negativePromptTokens": 2,
"safetyCheckerAvailable": true,
"maskedPixels": 147456,
"paddedWidth": 512,
"paddedHeight": 512,
"megapixelsPerSecond": 0.025519018338460077,
"driverAllocatedMemoryBytes": 9290809344,
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 10284.847416001867,
"artifactRevision": "8a4288a76071f7280aedbdb3253bdb9e9d5d84bb",
"fallback": false,
"imagesPerSecond": 0.09734732947715788,
"grade": "moderate"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"maskedClipCosine": 0.29660657048225403,
"maskedPixelStd": 0.2182992845773697,
"outsideMaskExact": true,
"emptyMaskIdentity": true,
"dimensionsExact": true,
"safetyFlag": false,
"gates": {
"minimumMaskedClipCosine": 0.22,
"minimumMaskedStd": 0.03,
"outsideMaskExact": true,
"dimensionsExact": true,
"emptyMaskIdentity": true,
"nsfwFlagFalse": true
},
"evaluatorRevision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268",
"method": "Independent prompt vs masked-region OpenAI CLIP ViT-B/32 cosine, nonflat RGB, exact unmasked pixels/dimensions/no-mask identity; not aesthetic/safety/broad semantic certification"
},
"runtime": {
"engine": "diffusers",
"version": "0.32.2",
"transformersVersion": "4.51.3",
"torchVersion": "2.6.0",
"loadMs": 1115.8849579987873,
"device": "mps",
"placement": {
"unet": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae": {
"device": "mps:0",
"dtype": "torch.float32"
},
"text_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"safety_checker": {
"device": "mps:0",
"dtype": "torch.float32"
}
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "UNet/VAE/CLIP/safety checker on selected device; tokenize/decode/padding/mask composite/PNG and seeded RNG CPU",
"observedPlacement": {
"text_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"unet": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae_decoder": {
"device": "mps:0",
"dtype": "torch.float32"
}
},
"inferenceMs": 11170.764957998472,
"durationMs": 11188.922666002327,
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"promptTokens": 13,
"promptTruncated": false,
"negativePromptTokens": 2,
"safetyCheckerAvailable": true,
"maskedPixels": 147456,
"paddedWidth": 512,
"paddedHeight": 512,
"megapixelsPerSecond": 0.02346696944977793,
"driverAllocatedMemoryBytes": 9022373888,
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 12304.807624001114,
"artifactRevision": "8a4288a76071f7280aedbdb3253bdb9e9d5d84bb",
"fallback": false,
"imagesPerSecond": 0.08951938419257328,
"grade": "moderate"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"maskedClipCosine": 0.29660657048225403,
"maskedPixelStd": 0.2182992845773697,
"outsideMaskExact": true,
"emptyMaskIdentity": true,
"dimensionsExact": true,
"safetyFlag": false,
"gates": {
"minimumMaskedClipCosine": 0.22,
"minimumMaskedStd": 0.03,
"outsideMaskExact": true,
"dimensionsExact": true,
"emptyMaskIdentity": true,
"nsfwFlagFalse": true
},
"evaluatorRevision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268",
"method": "Independent prompt vs masked-region OpenAI CLIP ViT-B/32 cosine, nonflat RGB, exact unmasked pixels/dimensions/no-mask identity; not aesthetic/safety/broad semantic certification"
},
"runtime": {
"engine": "diffusers",
"version": "0.32.2",
"transformersVersion": "4.51.3",
"torchVersion": "2.6.0",
"loadMs": 0,
"device": "mps",
"placement": {
"unet": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae": {
"device": "mps:0",
"dtype": "torch.float32"
},
"text_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"safety_checker": {
"device": "mps:0",
"dtype": "torch.float32"
}
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "UNet/VAE/CLIP/safety checker on selected device; tokenize/decode/padding/mask composite/PNG and seeded RNG CPU",
"observedPlacement": {
"text_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"unet": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae_decoder": {
"device": "mps:0",
"dtype": "torch.float32"
}
},
"inferenceMs": 10687.888874999771,
"durationMs": 10700.890209001955,
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"promptTokens": 13,
"promptTruncated": false,
"negativePromptTokens": 2,
"safetyCheckerAvailable": true,
"maskedPixels": 147456,
"paddedWidth": 512,
"paddedHeight": 512,
"megapixelsPerSecond": 0.024527201121372588,
"driverAllocatedMemoryBytes": 9022373888,
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 10700.890209001955,
"artifactRevision": "8a4288a76071f7280aedbdb3253bdb9e9d5d84bb",
"fallback": false,
"imagesPerSecond": 0.09356384705113445,
"grade": "moderate"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"maskedClipCosine": 0.29660657048225403,
"maskedPixelStd": 0.2182992845773697,
"outsideMaskExact": true,
"emptyMaskIdentity": true,
"dimensionsExact": true,
"safetyFlag": false,
"gates": {
"minimumMaskedClipCosine": 0.22,
"minimumMaskedStd": 0.03,
"outsideMaskExact": true,
"dimensionsExact": true,
"emptyMaskIdentity": true,
"nsfwFlagFalse": true
},
"evaluatorRevision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268",
"method": "Independent prompt vs masked-region OpenAI CLIP ViT-B/32 cosine, nonflat RGB, exact unmasked pixels/dimensions/no-mask identity; not aesthetic/safety/broad semantic certification"
},
"runtime": {
"engine": "diffusers",
"version": "0.32.2",
"transformersVersion": "4.51.3",
"torchVersion": "2.6.0",
"loadMs": 0,
"device": "mps",
"placement": {
"unet": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae": {
"device": "mps:0",
"dtype": "torch.float32"
},
"text_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"safety_checker": {
"device": "mps:0",
"dtype": "torch.float32"
}
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "UNet/VAE/CLIP/safety checker on selected device; tokenize/decode/padding/mask composite/PNG and seeded RNG CPU",
"observedPlacement": {
"text_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"unet": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae_decoder": {
"device": "mps:0",
"dtype": "torch.float32"
}
},
"inferenceMs": 10744.970083000226,
"durationMs": 10757.988500001375,
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"promptTokens": 13,
"promptTruncated": false,
"negativePromptTokens": 2,
"safetyCheckerAvailable": true,
"maskedPixels": 147456,
"paddedWidth": 512,
"paddedHeight": 512,
"megapixelsPerSecond": 0.024396903665161604,
"driverAllocatedMemoryBytes": 9022373888,
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 10757.988500001375,
"artifactRevision": "8a4288a76071f7280aedbdb3253bdb9e9d5d84bb",
"fallback": false,
"imagesPerSecond": 0.09306680170120851,
"grade": "moderate"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"maskedClipCosine": null,
"maskedPixelStd": null,
"outsideMaskExact": true,
"emptyMaskIdentity": true,
"dimensionsExact": true,
"safetyFlag": true,
"safetyAssessment": "Original checker flag preserved; with an empty mask its unused generated pixels are not part of the unchanged final output",
"gates": {
"minimumMaskedClipCosine": 0.22,
"minimumMaskedStd": 0.03,
"outsideMaskExact": true,
"dimensionsExact": true,
"emptyMaskIdentity": true,
"nsfwFlagFalseForGeneratedPixels": true
},
"evaluatorRevision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268",
"method": "Independent prompt vs masked-region OpenAI CLIP ViT-B/32 cosine, nonflat RGB, exact unmasked pixels/dimensions/no-mask identity; not aesthetic/safety/broad semantic certification"
},
"runtime": {
"engine": "diffusers",
"version": "0.32.2",
"transformersVersion": "4.51.3",
"torchVersion": "2.6.0",
"loadMs": 510.3264579993265,
"device": "cpu",
"placement": {
"unet": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae": {
"device": "cpu",
"dtype": "torch.float32"
},
"text_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"safety_checker": {
"device": "cpu",
"dtype": "torch.float32"
}
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "UNet/VAE/CLIP/safety checker on selected device; tokenize/decode/padding/mask composite/PNG and seeded RNG CPU",
"observedPlacement": {
"text_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"unet": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae_decoder": {
"device": "cpu",
"dtype": "torch.float32"
}
},
"inferenceMs": 9763.276834000862,
"durationMs": 9770.38787499987,
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"promptTokens": 12,
"promptTruncated": false,
"negativePromptTokens": 2,
"safetyCheckerAvailable": true,
"maskedPixels": 0,
"paddedWidth": 256,
"paddedHeight": 256,
"megapixelsPerSecond": 0.006712500435485881,
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 10280.714332999196,
"artifactRevision": "8a4288a76071f7280aedbdb3253bdb9e9d5d84bb",
"fallback": false,
"imagesPerSecond": 0.10242462822701845,
"grade": "moderate"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"maskedClipCosine": 0.2952187955379486,
"maskedPixelStd": 0.21843436360359192,
"outsideMaskExact": true,
"emptyMaskIdentity": true,
"dimensionsExact": true,
"safetyFlag": false,
"safetyAssessment": "Original checker flag preserved; with an empty mask its unused generated pixels are not part of the unchanged final output",
"gates": {
"minimumMaskedClipCosine": 0.22,
"minimumMaskedStd": 0.03,
"outsideMaskExact": true,
"dimensionsExact": true,
"emptyMaskIdentity": true,
"nsfwFlagFalseForGeneratedPixels": true
},
"evaluatorRevision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268",
"method": "Independent prompt vs masked-region OpenAI CLIP ViT-B/32 cosine, nonflat RGB, exact unmasked pixels/dimensions/no-mask identity; not aesthetic/safety/broad semantic certification"
},
"runtime": {
"engine": "diffusers",
"version": "0.32.2",
"transformersVersion": "4.51.3",
"torchVersion": "2.6.0",
"loadMs": 0,
"device": "cpu",
"placement": {
"unet": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae": {
"device": "cpu",
"dtype": "torch.float32"
},
"text_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"safety_checker": {
"device": "cpu",
"dtype": "torch.float32"
}
},
"parameterDtype": "torch.float32",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"accelerationDetails": "UNet/VAE/CLIP/safety checker on selected device; tokenize/decode/padding/mask composite/PNG and seeded RNG CPU",
"observedPlacement": {
"text_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae_encoder": {
"device": "cpu",
"dtype": "torch.float32"
},
"unet": {
"device": "cpu",
"dtype": "torch.float32"
},
"vae_decoder": {
"device": "cpu",
"dtype": "torch.float32"
}
},
"inferenceMs": 44110.20395800006,
"durationMs": 44123.1402500016,
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"promptTokens": 13,
"promptTruncated": false,
"negativePromptTokens": 2,
"safetyCheckerAvailable": true,
"maskedPixels": 147456,
"paddedWidth": 512,
"paddedHeight": 512,
"megapixelsPerSecond": 0.005942933300639526,
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 44123.1402500016,
"artifactRevision": "8a4288a76071f7280aedbdb3253bdb9e9d5d84bb",
"fallback": false,
"imagesPerSecond": 0.02267049141174136,
"grade": "slow"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"maskedClipCosine": null,
"maskedPixelStd": null,
"outsideMaskExact": true,
"emptyMaskIdentity": true,
"dimensionsExact": true,
"safetyFlag": true,
"safetyAssessment": "Original checker flag preserved; with an empty mask its unused generated pixels are not part of the unchanged final output",
"gates": {
"minimumMaskedClipCosine": 0.22,
"minimumMaskedStd": 0.03,
"outsideMaskExact": true,
"dimensionsExact": true,
"emptyMaskIdentity": true,
"nsfwFlagFalseForGeneratedPixels": true
},
"evaluatorRevision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268",
"method": "Independent prompt vs masked-region OpenAI CLIP ViT-B/32 cosine, nonflat RGB, exact unmasked pixels/dimensions/no-mask identity; not aesthetic/safety/broad semantic certification"
},
"runtime": {
"engine": "diffusers",
"version": "0.32.2",
"transformersVersion": "4.51.3",
"torchVersion": "2.6.0",
"loadMs": 1120.9867079996911,
"device": "mps",
"placement": {
"unet": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae": {
"device": "mps:0",
"dtype": "torch.float32"
},
"text_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"safety_checker": {
"device": "mps:0",
"dtype": "torch.float32"
}
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "UNet/VAE/CLIP/safety checker on selected device; tokenize/decode/padding/mask composite/PNG and seeded RNG CPU",
"observedPlacement": {
"text_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"unet": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae_decoder": {
"device": "mps:0",
"dtype": "torch.float32"
}
},
"inferenceMs": 3860.03024999809,
"durationMs": 3866.5830419995473,
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"promptTokens": 12,
"promptTruncated": false,
"negativePromptTokens": 2,
"safetyCheckerAvailable": true,
"maskedPixels": 0,
"paddedWidth": 256,
"paddedHeight": 256,
"megapixelsPerSecond": 0.016978105288172916,
"driverAllocatedMemoryBytes": 6749093888,
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 4987.569749999238,
"artifactRevision": "8a4288a76071f7280aedbdb3253bdb9e9d5d84bb",
"fallback": false,
"imagesPerSecond": 0.25906532727314635,
"grade": "moderate"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"maskedClipCosine": 0.29660657048225403,
"maskedPixelStd": 0.2182992845773697,
"outsideMaskExact": true,
"emptyMaskIdentity": true,
"dimensionsExact": true,
"safetyFlag": false,
"safetyAssessment": "Original checker flag preserved; with an empty mask its unused generated pixels are not part of the unchanged final output",
"gates": {
"minimumMaskedClipCosine": 0.22,
"minimumMaskedStd": 0.03,
"outsideMaskExact": true,
"dimensionsExact": true,
"emptyMaskIdentity": true,
"nsfwFlagFalseForGeneratedPixels": true
},
"evaluatorRevision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268",
"method": "Independent prompt vs masked-region OpenAI CLIP ViT-B/32 cosine, nonflat RGB, exact unmasked pixels/dimensions/no-mask identity; not aesthetic/safety/broad semantic certification"
},
"runtime": {
"engine": "diffusers",
"version": "0.32.2",
"transformersVersion": "4.51.3",
"torchVersion": "2.6.0",
"loadMs": 0,
"device": "mps",
"placement": {
"unet": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae": {
"device": "mps:0",
"dtype": "torch.float32"
},
"text_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"safety_checker": {
"device": "mps:0",
"dtype": "torch.float32"
}
},
"parameterDtype": "torch.float32",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "UNet/VAE/CLIP/safety checker on selected device; tokenize/decode/padding/mask composite/PNG and seeded RNG CPU",
"observedPlacement": {
"text_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae_encoder": {
"device": "mps:0",
"dtype": "torch.float32"
},
"unet": {
"device": "mps:0",
"dtype": "torch.float32"
},
"vae_decoder": {
"device": "mps:0",
"dtype": "torch.float32"
}
},
"inferenceMs": 9173.324708001019,
"durationMs": 9185.46970800162,
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"promptTokens": 13,
"promptTruncated": false,
"negativePromptTokens": 2,
"safetyCheckerAvailable": true,
"maskedPixels": 147456,
"paddedWidth": 512,
"paddedHeight": 512,
"megapixelsPerSecond": 0.02857677105568461,
"driverAllocatedMemoryBytes": 9096675328,
"precision": "fp32",
"cpuThreads": 4,
"totalMs": 9185.46970800162,
"artifactRevision": "8a4288a76071f7280aedbdb3253bdb9e9d5d84bb",
"fallback": false,
"imagesPerSecond": 0.10901173040651173,
"grade": "moderate"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "fail",
"quality": {
"passed": false
},
"runtime": "Not embedded",
"failure": "{'ok': False, 'error': \"view size is not compatible with input tensor's size and stride (at least one dimension spans across two contiguous subspaces). Use .reshape(...) instead.\", 'code': 'runtime_error', 'traceback': 'Traceback (most recent call last):\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/localai-desktop/crates/desktopai/src/models/sd_inpainting/runtime.py\", line 55, in <module>\\n with contextlib.redirect_stdout(sys.stderr):data=init(r) if r[\\'type\\']==\\'init\\' else {\\'alive\\':True,\\'pid\\':os.getpid()} if r[\\'type\\']==\\'health\\' else generate(r)\\n ~~~~~~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/localai-desktop/crates/desktopai/src/models/sd_inpainting/runtime.py\", line 46, in generate\\n out=pipe(prompt=prompt,negative_prompt=negative,image=Image.fromarray(padded),mask_image=Image.fromarray(pmask),width=pw,height=ph,num_inference_steps=steps,guidance_scale=guidance,generator=torch.Generator(device=\\'cpu\\').manual_seed(seed),output_type=\\'np\\')\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/localai-desktop/.cache/sd-turbo-probe/venv/lib/python3.13/site-packages/torch/utils/_contextlib.py\", line 116, in decorate_context\\n return func(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/localai-desktop/.cache/sd-turbo-probe/venv/lib/python3.13/site-packages/diffusers/pipelines/stable_diffusion/pipeline_stable_diffusion_inpaint.py\", line 1189, in __call__\\n mask, masked_image_latents = self.prepare_mask_latents(\\n ~~~~~~~~~~~~~~~~~~~~~~~~~^\\n mask_condition,\\n ^^^^^^^^^^^^^^^\\n ...<7 lines>...\\n self.do_classifier_free_guidance,\\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\\n )\\n ^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/localai-desktop/.cache/sd-turbo-probe/venv/lib/python3.13/site-packages/diffusers/pipelines/stable_diffusion/pipeline_stable_diffusion_inpaint.py\", line 763, in prepare_mask_latents\\n masked_image_latents = self._encode_vae_image(masked_image, generator=generator)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/localai-desktop/.cache/sd-turbo-probe/venv/lib/python3.13/site-packages/diffusers/pipelines/stable_diffusion/pipeline_stable_diffusion_inpaint.py\", line 741, in _encode_vae_image\\n image_latents = retrieve_latents(self.vae.encode(image), generator=generator)\\n ~~~~~~~~~~~~~~~^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/localai-desktop/.cache/sd-turbo-probe/venv/lib/python3.13/site-packages/diffusers/utils/accelerate_utils.py\", line 46, in wrapper\\n return method(self, *args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/localai-desktop/.cache/sd-turbo-probe/venv/lib/python3.13/site-packages/diffusers/models/autoencoders/autoencoder_kl.py\", line 282, in encode\\n h = self._encode(x)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/localai-desktop/.cache/sd-turbo-probe/venv/lib/python3.13/site-packages/diffusers/models/autoencoders/autoencoder_kl.py\", line 254, in _encode\\n return self._tiled_encode(x)\\n ~~~~~~~~~~~~~~~~~~^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/localai-desktop/.cache/sd-turbo-probe/venv/lib/python3.13/site-packages/diffusers/models/autoencoders/autoencoder_kl.py\", line 373, in _tiled_encode\\n tile = self.encoder(tile)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/localai-desktop/.cache/sd-turbo-probe/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1739, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/localai-desktop/.cache/sd-turbo-probe/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1750, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/localai-desktop/.cache/sd-turbo-probe/venv/lib/python3.13/site-packages/diffusers/models/autoencoders/vae.py\", line 156, in forward\\n sample = self.conv_in(sample)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/localai-desktop/.cache/sd-turbo-probe/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1739, in _wrapped_call_impl\\n return self._call_impl(*args, **kwargs)\\n ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/localai-desktop/.cache/sd-turbo-probe/venv/lib/python3.13/site-packages/torch/nn/modules/module.py\", line 1750, in _call_impl\\n return forward_call(*args, **kwargs)\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/localai-desktop/.cache/sd-turbo-probe/venv/lib/python3.13/site-packages/torch/nn/modules/conv.py\", line 554, in forward\\n return self._conv_forward(input, self.weight, self.bias)\\n ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\\n File \"/Users/pengzhang/Desktop/hubters-webai/webai-js/localai-desktop/.cache/sd-turbo-probe/venv/lib/python3.13/site-packages/torch/nn/modules/conv.py\", line 549, in _conv_forward\\n return F.conv2d(\\n ~~~~~~~~^\\n input, weight, bias, self.stride, self.padding, self.dilation, self.groups\\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\\n )\\n ^\\nRuntimeError: view size is not compatible with input tensor\\'s size and stride (at least one dimension spans across two contiguous subspaces). Use .reshape(...) instead.\\n'}"
},
{
"precision": "fp16",
"device": "mps",
"status": "fail",
"quality": {
"passed": false,
"maskedClipCosine": 0.20950530469417572,
"maskedPixelStd": 0,
"outsideMaskExact": true,
"emptyMaskIdentity": true,
"dimensionsExact": true,
"safetyFlag": true,
"gates": {
"minimumMaskedClipCosine": 0.22,
"minimumMaskedStd": 0.03,
"outsideMaskExact": true,
"dimensionsExact": true,
"emptyMaskIdentity": true,
"nsfwFlagFalse": true
},
"evaluatorRevision": "3d74acf9a28c67741b2f4f2ea7635f0aaf6f0268",
"method": "Independent prompt vs masked-region OpenAI CLIP ViT-B/32 cosine, nonflat RGB, exact unmasked pixels/dimensions/no-mask identity; not aesthetic/safety/broad semantic certification"
},
"runtime": {
"engine": "diffusers",
"version": "0.32.2",
"transformersVersion": "4.51.3",
"torchVersion": "2.6.0",
"loadMs": 897.4306249983783,
"device": "mps",
"placement": {
"unet": {
"device": "mps:0",
"dtype": "torch.float16"
},
"vae": {
"device": "mps:0",
"dtype": "torch.float16"
},
"text_encoder": {
"device": "mps:0",
"dtype": "torch.float16"
},
"safety_checker": {
"device": "mps:0",
"dtype": "torch.float16"
}
},
"parameterDtype": "torch.float16",
"provider": "Metal/MPS",
"acceleration": "partial",
"accelerationDetails": "UNet/VAE/CLIP/safety checker on selected device; tokenize/decode/padding/mask composite/PNG and seeded RNG CPU",
"inferenceMs": 9786.458500002482,
"durationMs": 9796.29974999989,
"seed": 42,
"steps": 20,
"guidanceScale": 7.5,
"promptTokens": 13,
"promptTruncated": false,
"negativePromptTokens": 2,
"safetyCheckerAvailable": true,
"maskedPixels": 147456,
"paddedWidth": 512,
"paddedHeight": 512,
"megapixelsPerSecond": 0.026786400821086964,
"driverAllocatedMemoryBytes": 4832378880,
"precision": "fp16",
"cpuThreads": 4,
"totalMs": 10693.730374998268,
"artifactRevision": "8a4288a76071f7280aedbdb3253bdb9e9d5d84bb",
"fallback": false,
"imagesPerSecond": 0.1021820099681357,
"grade": "moderate"
}
}
]