A model is still running

A model is still running or downloading. Leaving will stop the current operation. Stay on this page to let it finish.

Skip to content
LocalAI.toolsBeta

Join the waitlist

Get an email when the new apps and model runs launch.

No account needed.

Stable Diffusion XL 1.0

Generate images locally with Stable Diffusion XL Base 1.0. Supports positive/negative prompts, guidance, configurable dimensions, steps and seed; no refiner required.

Desktop inferencePrivate · Runs on your computer
About this model

Generate images locally with Stable Diffusion XL Base 1.0. Supports positive/negative prompts, guidance, configurable dimensions, steps and seed; no refiner required.

Created by
Stability AI
Model released
Unknown
Source repository created
Jul 25, 2023
Model weights · FP16
6.9 GB

Best for

  • Local creative image generation
  • Concept art and illustration experiments
  • Higher-detail drafts with configurable denoising

Keep in mind

  • Prompt alignment and aesthetics vary; hands, faces, counting, spatial relations and rendered text can be wrong.
  • Both CLIP text encoders truncate at their77-token context; negative prompts only apply with classifier-free guidance above1.
  • No safety checker or invisible-watermark package is included. Outputs can reflect bias or unsafe content; license restrictions still apply.
  • 1024×1024/20steps is recommended. Other multiples of8 at least64 are accepted without a product size ceiling; memory/time and quality depend on configuration.
  • The Base checkpoint is used without the optional Refiner. This is standard diffusion, not a one-step distilled model. BF16 failed prompt alignment on512px cat cases and is not advertised; coarse CLIP-passing images can still have compositional artifacts.
  • The default Diffusers Metal decode cast produced black FP16 output. This adapter explicitly decodes in FP32; only precision/device pairs passing the corrected runtime are advertised.
  • The app downloads its own pinned CPython and isolated packages on request; installed Python, user packages and Python/pip configuration are not used. Automatic model-package provisioning is verified on Apple Silicon Mac; other platform stacks remain unverified.
  • CreativeML Open RAIL++-M applies; availability does not grant unrestricted usage rights.

Processed on your deviceYour input is processed locally in the desktop app. Model and runtime files download from external hosts.

Target platforms · verification required

  • macos · aarch64, x86_64
  • windows · x86_64

Recommended configuration

FP16 · mps (verified platform only)

Sources & technical details
Original model
https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
Release verification
Unknown
Release evidence
Exact original checkpoint public release date has not been verified. Repository creation, training, paper, artifact conversion and update dates are not release evidence.
Source updated
Oct 30, 2023
Native model files
https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
Files updated
Oct 30, 2023
Artifact revision
462165984030d82259a11f4367a4eed129e94a7b

Desktop app

Sample result

SDXL Base 1.0 — Image Generation

Run Stable Diffusion XL 1.0 on your computer

Download the desktop app to load this model, provide input and view results locally.

Public desktop downloads are coming soon.

Device requirements

macOS Apple SiliconMPS / FP16Tested32.0 GiBRAM estimate
macOS Apple SiliconMPS / FP32Tested40.0 GiBRAM estimate
macOS Apple SiliconCPU / FP32Tested40.0 GiBRAM estimate
macOS Apple SiliconMPS / BF16Unverified32.0 GiBRAM estimate
Windows Intel / AMDCPU / FP32Unverified40.0 GiBRAM estimate
macOS Intel / AMDCPU / FP32Unverified40.0 GiBRAM estimate
If your device falls short

MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.

GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.

PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.

Benchmark evidence

Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.

SDXL Base 1.0 — Image Generation

27 configurations tested
Passed22
Failed5
TestedNov 1, 2026
Runtimediffusers 0.32.2

Quality criteria

No explicit quality gate recorded. Review per-case evidence; full certification is pending.

PrecisionDeviceResultPlatformInference / load
FP16mpsAcceleratedPassedFastmacos · aarch647388 ms / 0 ms
FP32mpsAcceleratedPassedFastmacos · aarch647556 ms / 0 ms
FP16mpsAcceleratedPassedFastmacos · aarch647794 ms / 0 ms
FP32mpsAcceleratedPassedFastmacos · aarch648114 ms / 0 ms
FP16mpsAcceleratedPassedFastmacos · aarch648347 ms / 0 ms
FP32mpsAcceleratedPassedFastmacos · aarch648391 ms / 0 ms
FP32mpsAcceleratedPassedFastmacos · aarch648410 ms / 0 ms
FP16mpsAcceleratedPassedFastmacos · aarch648531 ms / 1764 ms
FP16mpsAcceleratedPassedFastmacos · aarch649146 ms / 0 ms
BF16mpsAcceleratedPassedFastmacos · aarch649250 ms / 0 ms
FP32mpsAcceleratedPassedFastmacos · aarch6410258 ms / 2540 ms
FP16mpsAcceleratedPassedFastmacos · aarch6439248 ms / 1757 ms
BF16mpsAcceleratedPassedFastmacos · aarch6448855 ms / 2210 ms
FP16mpsAcceleratedPassedFastmacos · aarch6454563 ms / 1882 ms
FP32mpsAcceleratedPassedModeratemacos · aarch6466237 ms / 2312 ms
FP32cpuPassedFastmacos · aarch6430598 ms / 0 ms
FP32cpuPassedFastmacos · aarch6430649 ms / 0 ms
FP32cpuPassedFastmacos · aarch6430823 ms / 1245 ms
FP32cpuPassedFastmacos · aarch6430993 ms / 0 ms
FP32cpuPassedFastmacos · aarch6435415 ms / 0 ms
FP32cpuPassedFastmacos · aarch6435469 ms / 1250 ms
FP32cpuPassedSlowmacos · aarch64204449 ms / 1124 ms
BF16mpsFailed—macos · aarch647406 ms / 0 ms
BF16mpsFailed—macos · aarch648794 ms / 0 ms
BF16mpsFailed—macos · aarch648310 ms / 3873 ms
BF16mpsFailed—macos · aarch647247 ms / 0 ms
FP16mpsFailed—Not recorded42360 ms / —
Test setup & sample details
Quality gate
No explicit quality gate recorded. Review the per-case quality evidence; full certification is pending.
Tested
2026-11-01T16:37:07.634233+00:00
Environment
{ "hardware": "Apple M3 Max", "os": "macOS-27.2-arm64-arm-64bit-Mach-O", "python": "3.13.1 (main, Dec 3 2024, 17:59:52) [Clang 16.0.0 (clang-1600.0.26.4)]", "runtime": "Torch2.6.0/Diffusers0.32.2/Transformers4.51.3" }
Runtime
diffusers 0.32.2
Artifact revision
462165984030d82259a11f4367a4eed129e94a7b
Fixture
{
  "file": "model-samples/desktop/sdxl-red-car-prompt.txt",
  "size": 51,
  "sha1": "8f1ff3dafe3aee473e0269e73b7049b25bf64a15",
  "sha256": "d34c6e72f38b09d86b5f864c1313958191179b8eda4cb98ca7572af3a3b80f17",
  "url": "https://assets.localai.tools/samples/v1/files/d34c6e72f38b09d86b5f864c1313958191179b8eda4cb98ca7572af3a3b80f17/sdxl-red-car-prompt.txt"
}
Rerun when
artifact revision/checksum; runtime/driver/backend changes; prompt/negative prompt/seed/dimensions/steps/guidance configuration; quality evaluator/revision/gates
Per-case quality & failure details
[
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
      "score": 0.3099501132965088,
      "threshold": 0.22,
      "pixelStd": 0.20869044959545135,
      "minimumPixelStd": 0.05,
      "targetRank": 0,
      "cosines": [
        0.3099501132965088,
        0.12112657725811005,
        0.0959417000412941,
        0.18555428087711334
      ],
      "referencePrompts": [
        "A photograph of a red sports car parked on a street",
        "An orange cat on a table",
        "A snowy mountain above a blue lake",
        "A green forest with no cars"
      ]
    },
    "runtime": {
      "inferenceMs": 54563.070125001104,
      "durationMs": 54563.070125001104,
      "placement": {
        "unet": {
          "mps:0/torch.float16": 1680
        },
        "vae": {
          "mps:0/torch.float32": 248
        },
        "text_encoder": {
          "mps:0/torch.float16": 196
        },
        "text_encoder_2": {
          "mps:0/torch.float16": 517
        }
      },
      "seed": 42,
      "steps": 20,
      "guidanceScale": 7.5,
      "scheduler": "EulerDiscreteScheduler",
      "promptTokens": [
        13,
        13
      ],
      "negativePromptTokens": [
        2,
        2
      ],
      "promptTruncated": false,
      "negativePromptTruncated": false,
      "negativePromptIgnored": false,
      "safetyCheckerAvailable": false,
      "watermarkApplied": false,
      "imagesPerSecond": 0.018327414452835096,
      "denoisingStepsPerSecond": 0.3665482890567019,
      "driverAllocatedMemoryBytes": 21152382976,
      "memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
      "loadMs": 1881.996000000072,
      "totalMs": 56644.0036669992,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.018327414452835096
      },
      "performanceGrade": "A",
      "engine": "diffusers",
      "version": "0.32.2",
      "torchVersion": "2.6.0",
      "transformersVersion": "4.51.3",
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
      "fallback": false,
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "grade": "fast"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
      "score": 0.28906795382499695,
      "threshold": 0.22,
      "pixelStd": 0.296662837266922,
      "minimumPixelStd": 0.05,
      "targetRank": 0,
      "cosines": [
        0.28906795382499695,
        0.14524361491203308,
        0.12646064162254333,
        0.15507793426513672
      ],
      "referencePrompts": [
        "A photograph of an orange cat sitting on a wooden table",
        "A red sports car on a street",
        "A snowy mountain above a blue lake",
        "A photograph of a black dog sitting on a wooden table"
      ]
    },
    "runtime": {
      "inferenceMs": 9145.587459002854,
      "durationMs": 9145.587459002854,
      "placement": {
        "unet": {
          "mps:0/torch.float16": 1680
        },
        "vae": {
          "mps:0/torch.float32": 248
        },
        "text_encoder": {
          "mps:0/torch.float16": 196
        },
        "text_encoder_2": {
          "mps:0/torch.float16": 517
        }
      },
      "seed": 42,
      "steps": 12,
      "guidanceScale": 7.5,
      "scheduler": "EulerDiscreteScheduler",
      "promptTokens": [
        13,
        13
      ],
      "negativePromptTokens": [
        9,
        9
      ],
      "promptTruncated": false,
      "negativePromptTruncated": false,
      "negativePromptIgnored": false,
      "safetyCheckerAvailable": false,
      "watermarkApplied": false,
      "imagesPerSecond": 0.10934234727760508,
      "denoisingStepsPerSecond": 1.3121081673312611,
      "driverAllocatedMemoryBytes": 19764297728,
      "memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
      "loadMs": 0,
      "totalMs": 9190.440207999927,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.10934234727760508
      },
      "performanceGrade": "A",
      "engine": "diffusers",
      "version": "0.32.2",
      "torchVersion": "2.6.0",
      "transformersVersion": "4.51.3",
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
      "fallback": false,
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "grade": "fast"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
      "score": 0.2704277038574219,
      "threshold": 0.22,
      "pixelStd": 0.25833043456077576,
      "minimumPixelStd": 0.05,
      "targetRank": 0,
      "cosines": [
        0.2704277038574219,
        0.09799514710903168,
        0.10969637334346771,
        0.22659353911876678
      ],
      "referencePrompts": [
        "A landscape photograph of snowy mountains above a blue lake",
        "A red sports car on a street",
        "An orange cat on a table",
        "A flat sandy desert with no water"
      ]
    },
    "runtime": {
      "inferenceMs": 8346.942791999027,
      "durationMs": 8346.942791999027,
      "placement": {
        "unet": {
          "mps:0/torch.float16": 1680
        },
        "vae": {
          "mps:0/torch.float32": 248
        },
        "text_encoder": {
          "mps:0/torch.float16": 196
        },
        "text_encoder_2": {
          "mps:0/torch.float16": 517
        }
      },
      "seed": 42,
      "steps": 12,
      "guidanceScale": 7.5,
      "scheduler": "EulerDiscreteScheduler",
      "promptTokens": [
        12,
        12
      ],
      "negativePromptTokens": [
        2,
        2
      ],
      "promptTruncated": false,
      "negativePromptTruncated": false,
      "negativePromptIgnored": false,
      "safetyCheckerAvailable": false,
      "watermarkApplied": false,
      "imagesPerSecond": 0.11980434332897924,
      "denoisingStepsPerSecond": 1.437652119947751,
      "driverAllocatedMemoryBytes": 19764297728,
      "memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
      "loadMs": 0,
      "totalMs": 8389.879583999573,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.11980434332897924
      },
      "performanceGrade": "A",
      "engine": "diffusers",
      "version": "0.32.2",
      "torchVersion": "2.6.0",
      "transformersVersion": "4.51.3",
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
      "fallback": false,
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "grade": "fast"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
      "score": 0.28906795382499695,
      "threshold": 0.22,
      "pixelStd": 0.296662837266922,
      "minimumPixelStd": 0.05,
      "targetRank": 0,
      "cosines": [
        0.28906795382499695,
        0.14524361491203308,
        0.12646064162254333,
        0.15507793426513672
      ],
      "referencePrompts": [
        "A photograph of an orange cat sitting on a wooden table",
        "A red sports car on a street",
        "A snowy mountain above a blue lake",
        "A photograph of a black dog sitting on a wooden table"
      ]
    },
    "runtime": {
      "inferenceMs": 7794.411334001779,
      "durationMs": 7794.411334001779,
      "placement": {
        "unet": {
          "mps:0/torch.float16": 1680
        },
        "vae": {
          "mps:0/torch.float32": 248
        },
        "text_encoder": {
          "mps:0/torch.float16": 196
        },
        "text_encoder_2": {
          "mps:0/torch.float16": 517
        }
      },
      "seed": 42,
      "steps": 12,
      "guidanceScale": 7.5,
      "scheduler": "EulerDiscreteScheduler",
      "promptTokens": [
        13,
        13
      ],
      "negativePromptTokens": [
        9,
        9
      ],
      "promptTruncated": false,
      "negativePromptTruncated": false,
      "negativePromptIgnored": false,
      "safetyCheckerAvailable": false,
      "watermarkApplied": false,
      "imagesPerSecond": 0.12829705248396014,
      "denoisingStepsPerSecond": 1.5395646298075216,
      "driverAllocatedMemoryBytes": 19764297728,
      "memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
      "loadMs": 0,
      "totalMs": 7838.257999999769,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.12829705248396014
      },
      "performanceGrade": "A",
      "engine": "diffusers",
      "version": "0.32.2",
      "torchVersion": "2.6.0",
      "transformersVersion": "4.51.3",
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
      "fallback": false,
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "grade": "fast"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
      "score": 0.28906795382499695,
      "threshold": 0.22,
      "pixelStd": 0.296662837266922,
      "minimumPixelStd": 0.05,
      "targetRank": 0,
      "cosines": [
        0.28906795382499695,
        0.14524361491203308,
        0.12646064162254333,
        0.15507793426513672
      ],
      "referencePrompts": [
        "A photograph of an orange cat sitting on a wooden table",
        "A red sports car on a street",
        "A snowy mountain above a blue lake",
        "A photograph of a black dog sitting on a wooden table"
      ]
    },
    "runtime": {
      "inferenceMs": 8530.868750000081,
      "durationMs": 8530.868750000081,
      "placement": {
        "unet": {
          "mps:0/torch.float16": 1680
        },
        "vae": {
          "mps:0/torch.float32": 248
        },
        "text_encoder": {
          "mps:0/torch.float16": 196
        },
        "text_encoder_2": {
          "mps:0/torch.float16": 517
        }
      },
      "seed": 42,
      "steps": 12,
      "guidanceScale": 7.5,
      "scheduler": "EulerDiscreteScheduler",
      "promptTokens": [
        13,
        13
      ],
      "negativePromptTokens": [
        9,
        9
      ],
      "promptTruncated": false,
      "negativePromptTruncated": false,
      "negativePromptIgnored": false,
      "safetyCheckerAvailable": false,
      "watermarkApplied": false,
      "imagesPerSecond": 0.11722135567962999,
      "denoisingStepsPerSecond": 1.4066562681555599,
      "driverAllocatedMemoryBytes": 10290069504,
      "memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
      "loadMs": 1764.0299170016078,
      "totalMs": 10343.039167000825,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.11722135567962999
      },
      "performanceGrade": "A",
      "engine": "diffusers",
      "version": "0.32.2",
      "torchVersion": "2.6.0",
      "transformersVersion": "4.51.3",
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
      "fallback": false,
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "grade": "fast"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
      "score": 0.28906795382499695,
      "threshold": 0.22,
      "pixelStd": 0.296662837266922,
      "minimumPixelStd": 0.05,
      "targetRank": 0,
      "cosines": [
        0.28906795382499695,
        0.14524361491203308,
        0.12646064162254333,
        0.15507793426513672
      ],
      "referencePrompts": [
        "A photograph of an orange cat sitting on a wooden table",
        "A red sports car on a street",
        "A snowy mountain above a blue lake",
        "A photograph of a black dog sitting on a wooden table"
      ]
    },
    "runtime": {
      "inferenceMs": 7388.27045799917,
      "durationMs": 7388.27045799917,
      "placement": {
        "unet": {
          "mps:0/torch.float16": 1680
        },
        "vae": {
          "mps:0/torch.float32": 248
        },
        "text_encoder": {
          "mps:0/torch.float16": 196
        },
        "text_encoder_2": {
          "mps:0/torch.float16": 517
        }
      },
      "seed": 42,
      "steps": 12,
      "guidanceScale": 7.5,
      "scheduler": "EulerDiscreteScheduler",
      "promptTokens": [
        13,
        13
      ],
      "negativePromptTokens": [
        9,
        9
      ],
      "promptTruncated": false,
      "negativePromptTruncated": false,
      "negativePromptIgnored": false,
      "safetyCheckerAvailable": false,
      "watermarkApplied": false,
      "imagesPerSecond": 0.13534967428233693,
      "denoisingStepsPerSecond": 1.6241960913880433,
      "driverAllocatedMemoryBytes": 10290069504,
      "memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
      "loadMs": 0,
      "totalMs": 7440.121833999001,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.13534967428233693
      },
      "performanceGrade": "A",
      "engine": "diffusers",
      "version": "0.32.2",
      "torchVersion": "2.6.0",
      "transformersVersion": "4.51.3",
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
      "fallback": false,
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "grade": "fast"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
      "score": 0.30552589893341064,
      "threshold": 0.22,
      "pixelStd": 0.18326924741268158,
      "minimumPixelStd": 0.05,
      "targetRank": 0,
      "cosines": [
        0.30552589893341064,
        0.16722582280635834,
        0.09530088305473328,
        0.18409931659698486
      ],
      "referencePrompts": [
        "A photograph of a red sports car parked on a street",
        "An orange cat on a table",
        "A snowy mountain above a blue lake",
        "A green forest with no cars"
      ]
    },
    "runtime": {
      "inferenceMs": 48854.957583000214,
      "durationMs": 48854.957583000214,
      "placement": {
        "unet": {
          "mps:0/torch.bfloat16": 1680
        },
        "vae": {
          "mps:0/torch.float32": 248
        },
        "text_encoder": {
          "mps:0/torch.bfloat16": 196
        },
        "text_encoder_2": {
          "mps:0/torch.bfloat16": 517
        }
      },
      "seed": 42,
      "steps": 20,
      "guidanceScale": 7.5,
      "scheduler": "EulerDiscreteScheduler",
      "promptTokens": [
        13,
        13
      ],
      "negativePromptTokens": [
        2,
        2
      ],
      "promptTruncated": false,
      "negativePromptTruncated": false,
      "negativePromptIgnored": false,
      "safetyCheckerAvailable": false,
      "watermarkApplied": false,
      "imagesPerSecond": 0.020468751780228018,
      "denoisingStepsPerSecond": 0.4093750356045604,
      "driverAllocatedMemoryBytes": 21185937408,
      "memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
      "loadMs": 2210.302708001109,
      "totalMs": 51257.565500000055,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.020468751780228018
      },
      "performanceGrade": "A",
      "engine": "diffusers",
      "version": "0.32.2",
      "torchVersion": "2.6.0",
      "transformersVersion": "4.51.3",
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
      "fallback": false,
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "grade": "fast"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "fail",
    "quality": {
      "passed": false,
      "metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
      "score": 0.152289479970932,
      "threshold": 0.22,
      "pixelStd": 0.39970725774765015,
      "minimumPixelStd": 0.05,
      "targetRank": 1,
      "cosines": [
        0.152289479970932,
        0.18239852786064148,
        0.16425111889839172,
        0.12811413407325745
      ],
      "referencePrompts": [
        "A photograph of an orange cat sitting on a wooden table",
        "A red sports car on a street",
        "A snowy mountain above a blue lake",
        "A photograph of a black dog sitting on a wooden table"
      ]
    },
    "runtime": {
      "inferenceMs": 7405.668625000544,
      "durationMs": 7405.668625000544,
      "placement": {
        "unet": {
          "mps:0/torch.bfloat16": 1680
        },
        "vae": {
          "mps:0/torch.float32": 248
        },
        "text_encoder": {
          "mps:0/torch.bfloat16": 196
        },
        "text_encoder_2": {
          "mps:0/torch.bfloat16": 517
        }
      },
      "seed": 42,
      "steps": 12,
      "guidanceScale": 7.5,
      "scheduler": "EulerDiscreteScheduler",
      "promptTokens": [
        13,
        13
      ],
      "negativePromptTokens": [
        9,
        9
      ],
      "promptTruncated": false,
      "negativePromptTruncated": false,
      "negativePromptIgnored": false,
      "safetyCheckerAvailable": false,
      "watermarkApplied": false,
      "imagesPerSecond": 0.13503169674972143,
      "denoisingStepsPerSecond": 1.6203803609966572,
      "driverAllocatedMemoryBytes": 19797852160,
      "memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
      "loadMs": 0,
      "totalMs": 7451.693750001141,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.13503169674972143
      },
      "performanceGrade": "A",
      "engine": "diffusers",
      "version": "0.32.2",
      "torchVersion": "2.6.0",
      "transformersVersion": "4.51.3",
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
      "fallback": false,
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "grade": "fast"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
      "score": 0.28719285130500793,
      "threshold": 0.22,
      "pixelStd": 0.2512918710708618,
      "minimumPixelStd": 0.05,
      "targetRank": 0,
      "cosines": [
        0.28719285130500793,
        0.10514500737190247,
        0.11050992459058762,
        0.21751534938812256
      ],
      "referencePrompts": [
        "A landscape photograph of snowy mountains above a blue lake",
        "A red sports car on a street",
        "An orange cat on a table",
        "A flat sandy desert with no water"
      ]
    },
    "runtime": {
      "inferenceMs": 9249.633792001987,
      "durationMs": 9249.633792001987,
      "placement": {
        "unet": {
          "mps:0/torch.bfloat16": 1680
        },
        "vae": {
          "mps:0/torch.float32": 248
        },
        "text_encoder": {
          "mps:0/torch.bfloat16": 196
        },
        "text_encoder_2": {
          "mps:0/torch.bfloat16": 517
        }
      },
      "seed": 42,
      "steps": 12,
      "guidanceScale": 7.5,
      "scheduler": "EulerDiscreteScheduler",
      "promptTokens": [
        12,
        12
      ],
      "negativePromptTokens": [
        2,
        2
      ],
      "promptTruncated": false,
      "negativePromptTruncated": false,
      "negativePromptIgnored": false,
      "safetyCheckerAvailable": false,
      "watermarkApplied": false,
      "imagesPerSecond": 0.10811238828338093,
      "denoisingStepsPerSecond": 1.2973486594005712,
      "driverAllocatedMemoryBytes": 19797852160,
      "memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
      "loadMs": 0,
      "totalMs": 9324.329833001684,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.10811238828338093
      },
      "performanceGrade": "A",
      "engine": "diffusers",
      "version": "0.32.2",
      "torchVersion": "2.6.0",
      "transformersVersion": "4.51.3",
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
      "fallback": false,
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "grade": "fast"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "fail",
    "quality": {
      "passed": false,
      "metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
      "score": 0.152289479970932,
      "threshold": 0.22,
      "pixelStd": 0.39970725774765015,
      "minimumPixelStd": 0.05,
      "targetRank": 1,
      "cosines": [
        0.152289479970932,
        0.18239852786064148,
        0.16425111889839172,
        0.12811413407325745
      ],
      "referencePrompts": [
        "A photograph of an orange cat sitting on a wooden table",
        "A red sports car on a street",
        "A snowy mountain above a blue lake",
        "A photograph of a black dog sitting on a wooden table"
      ]
    },
    "runtime": {
      "inferenceMs": 8794.136500000604,
      "durationMs": 8794.136500000604,
      "placement": {
        "unet": {
          "mps:0/torch.bfloat16": 1680
        },
        "vae": {
          "mps:0/torch.float32": 248
        },
        "text_encoder": {
          "mps:0/torch.bfloat16": 196
        },
        "text_encoder_2": {
          "mps:0/torch.bfloat16": 517
        }
      },
      "seed": 42,
      "steps": 12,
      "guidanceScale": 7.5,
      "scheduler": "EulerDiscreteScheduler",
      "promptTokens": [
        13,
        13
      ],
      "negativePromptTokens": [
        9,
        9
      ],
      "promptTruncated": false,
      "negativePromptTruncated": false,
      "negativePromptIgnored": false,
      "safetyCheckerAvailable": false,
      "watermarkApplied": false,
      "imagesPerSecond": 0.11371213080442079,
      "denoisingStepsPerSecond": 1.3645455696530495,
      "driverAllocatedMemoryBytes": 19797852160,
      "memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
      "loadMs": 0,
      "totalMs": 8844.17512499931,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.11371213080442079
      },
      "performanceGrade": "A",
      "engine": "diffusers",
      "version": "0.32.2",
      "torchVersion": "2.6.0",
      "transformersVersion": "4.51.3",
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
      "fallback": false,
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "grade": "fast"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "fail",
    "quality": {
      "passed": false,
      "metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
      "score": 0.152289479970932,
      "threshold": 0.22,
      "pixelStd": 0.39970725774765015,
      "minimumPixelStd": 0.05,
      "targetRank": 1,
      "cosines": [
        0.152289479970932,
        0.18239852786064148,
        0.16425111889839172,
        0.12811413407325745
      ],
      "referencePrompts": [
        "A photograph of an orange cat sitting on a wooden table",
        "A red sports car on a street",
        "A snowy mountain above a blue lake",
        "A photograph of a black dog sitting on a wooden table"
      ]
    },
    "runtime": {
      "inferenceMs": 8310.064042001613,
      "durationMs": 8310.064042001613,
      "placement": {
        "unet": {
          "mps:0/torch.bfloat16": 1680
        },
        "vae": {
          "mps:0/torch.float32": 248
        },
        "text_encoder": {
          "mps:0/torch.bfloat16": 196
        },
        "text_encoder_2": {
          "mps:0/torch.bfloat16": 517
        }
      },
      "seed": 42,
      "steps": 12,
      "guidanceScale": 7.5,
      "scheduler": "EulerDiscreteScheduler",
      "promptTokens": [
        13,
        13
      ],
      "negativePromptTokens": [
        9,
        9
      ],
      "promptTruncated": false,
      "negativePromptTruncated": false,
      "negativePromptIgnored": false,
      "safetyCheckerAvailable": false,
      "watermarkApplied": false,
      "imagesPerSecond": 0.12033601605784182,
      "denoisingStepsPerSecond": 1.4440321926941018,
      "driverAllocatedMemoryBytes": 10357178368,
      "memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
      "loadMs": 3873.1052080001973,
      "totalMs": 12237.668999998277,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.12033601605784182
      },
      "performanceGrade": "A",
      "engine": "diffusers",
      "version": "0.32.2",
      "torchVersion": "2.6.0",
      "transformersVersion": "4.51.3",
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
      "fallback": false,
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "grade": "fast"
    }
  },
  {
    "precision": "bf16",
    "device": "mps",
    "status": "fail",
    "quality": {
      "passed": false,
      "metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
      "score": 0.152289479970932,
      "threshold": 0.22,
      "pixelStd": 0.39970725774765015,
      "minimumPixelStd": 0.05,
      "targetRank": 1,
      "cosines": [
        0.152289479970932,
        0.18239852786064148,
        0.16425111889839172,
        0.12811413407325745
      ],
      "referencePrompts": [
        "A photograph of an orange cat sitting on a wooden table",
        "A red sports car on a street",
        "A snowy mountain above a blue lake",
        "A photograph of a black dog sitting on a wooden table"
      ]
    },
    "runtime": {
      "inferenceMs": 7247.405999998591,
      "durationMs": 7247.405999998591,
      "placement": {
        "unet": {
          "mps:0/torch.bfloat16": 1680
        },
        "vae": {
          "mps:0/torch.float32": 248
        },
        "text_encoder": {
          "mps:0/torch.bfloat16": 196
        },
        "text_encoder_2": {
          "mps:0/torch.bfloat16": 517
        }
      },
      "seed": 42,
      "steps": 12,
      "guidanceScale": 7.5,
      "scheduler": "EulerDiscreteScheduler",
      "promptTokens": [
        13,
        13
      ],
      "negativePromptTokens": [
        9,
        9
      ],
      "promptTruncated": false,
      "negativePromptTruncated": false,
      "negativePromptIgnored": false,
      "safetyCheckerAvailable": false,
      "watermarkApplied": false,
      "imagesPerSecond": 0.137980402919361,
      "denoisingStepsPerSecond": 1.655764835032332,
      "driverAllocatedMemoryBytes": 10357178368,
      "memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
      "loadMs": 0,
      "totalMs": 7289.825291998568,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.137980402919361
      },
      "performanceGrade": "A",
      "engine": "diffusers",
      "version": "0.32.2",
      "torchVersion": "2.6.0",
      "transformersVersion": "4.51.3",
      "device": "mps",
      "precision": "bf16",
      "cpuThreads": 4,
      "artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
      "fallback": false,
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
      "score": 0.3025013208389282,
      "threshold": 0.22,
      "pixelStd": 0.17550452053546906,
      "minimumPixelStd": 0.05,
      "targetRank": 0,
      "cosines": [
        0.3025013208389282,
        0.15131855010986328,
        0.07895906269550323,
        0.1936735063791275
      ],
      "referencePrompts": [
        "A photograph of a red sports car parked on a street",
        "An orange cat on a table",
        "A snowy mountain above a blue lake",
        "A green forest with no cars"
      ]
    },
    "runtime": {
      "inferenceMs": 66236.50058300336,
      "durationMs": 66236.50058300336,
      "placement": {
        "unet": {
          "mps:0/torch.float32": 1680
        },
        "vae": {
          "mps:0/torch.float32": 248
        },
        "text_encoder": {
          "mps:0/torch.float32": 196
        },
        "text_encoder_2": {
          "mps:0/torch.float32": 517
        }
      },
      "seed": 42,
      "steps": 20,
      "guidanceScale": 7.5,
      "scheduler": "EulerDiscreteScheduler",
      "promptTokens": [
        13,
        13
      ],
      "negativePromptTokens": [
        2,
        2
      ],
      "promptTruncated": false,
      "negativePromptTruncated": false,
      "negativePromptIgnored": false,
      "safetyCheckerAvailable": false,
      "watermarkApplied": false,
      "imagesPerSecond": 0.015097415944353276,
      "denoisingStepsPerSecond": 0.3019483188870655,
      "driverAllocatedMemoryBytes": 30001168384,
      "memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
      "loadMs": 2311.7020830031834,
      "totalMs": 68795.34808300377,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.015097415944353276
      },
      "performanceGrade": "B",
      "engine": "diffusers",
      "version": "0.32.2",
      "torchVersion": "2.6.0",
      "transformersVersion": "4.51.3",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
      "fallback": false,
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "grade": "moderate"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
      "score": 0.2612026333808899,
      "threshold": 0.22,
      "pixelStd": 0.32530075311660767,
      "minimumPixelStd": 0.05,
      "targetRank": 0,
      "cosines": [
        0.2612026333808899,
        0.13999365270137787,
        0.16308331489562988,
        0.24875833094120026
      ],
      "referencePrompts": [
        "A photograph of an orange cat sitting on a wooden table",
        "A red sports car on a street",
        "A snowy mountain above a blue lake",
        "A photograph of a black dog sitting on a wooden table"
      ]
    },
    "runtime": {
      "inferenceMs": 8409.630375001143,
      "durationMs": 8409.630375001143,
      "placement": {
        "unet": {
          "mps:0/torch.float32": 1680
        },
        "vae": {
          "mps:0/torch.float32": 248
        },
        "text_encoder": {
          "mps:0/torch.float32": 196
        },
        "text_encoder_2": {
          "mps:0/torch.float32": 517
        }
      },
      "seed": 42,
      "steps": 12,
      "guidanceScale": 7.5,
      "scheduler": "EulerDiscreteScheduler",
      "promptTokens": [
        13,
        13
      ],
      "negativePromptTokens": [
        9,
        9
      ],
      "promptTruncated": false,
      "negativePromptTruncated": false,
      "negativePromptIgnored": false,
      "safetyCheckerAvailable": false,
      "watermarkApplied": false,
      "imagesPerSecond": 0.11891129043823928,
      "denoisingStepsPerSecond": 1.4269354852588714,
      "driverAllocatedMemoryBytes": 29056663552,
      "memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
      "loadMs": 0,
      "totalMs": 8458.963042001415,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.11891129043823928
      },
      "performanceGrade": "A",
      "engine": "diffusers",
      "version": "0.32.2",
      "torchVersion": "2.6.0",
      "transformersVersion": "4.51.3",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
      "fallback": false,
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
      "score": 0.2753533124923706,
      "threshold": 0.22,
      "pixelStd": 0.3030684292316437,
      "minimumPixelStd": 0.05,
      "targetRank": 0,
      "cosines": [
        0.2753533124923706,
        0.10248155891895294,
        0.12241125106811523,
        0.18371526896953583
      ],
      "referencePrompts": [
        "A landscape photograph of snowy mountains above a blue lake",
        "A red sports car on a street",
        "An orange cat on a table",
        "A flat sandy desert with no water"
      ]
    },
    "runtime": {
      "inferenceMs": 8390.783541999554,
      "durationMs": 8390.783541999554,
      "placement": {
        "unet": {
          "mps:0/torch.float32": 1680
        },
        "vae": {
          "mps:0/torch.float32": 248
        },
        "text_encoder": {
          "mps:0/torch.float32": 196
        },
        "text_encoder_2": {
          "mps:0/torch.float32": 517
        }
      },
      "seed": 42,
      "steps": 12,
      "guidanceScale": 7.5,
      "scheduler": "EulerDiscreteScheduler",
      "promptTokens": [
        12,
        12
      ],
      "negativePromptTokens": [
        2,
        2
      ],
      "promptTruncated": false,
      "negativePromptTruncated": false,
      "negativePromptIgnored": false,
      "safetyCheckerAvailable": false,
      "watermarkApplied": false,
      "imagesPerSecond": 0.11917838125540496,
      "denoisingStepsPerSecond": 1.4301405750648595,
      "driverAllocatedMemoryBytes": 29056663552,
      "memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
      "loadMs": 0,
      "totalMs": 8464.000542000576,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.11917838125540496
      },
      "performanceGrade": "A",
      "engine": "diffusers",
      "version": "0.32.2",
      "torchVersion": "2.6.0",
      "transformersVersion": "4.51.3",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
      "fallback": false,
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
      "score": 0.2612026333808899,
      "threshold": 0.22,
      "pixelStd": 0.32530075311660767,
      "minimumPixelStd": 0.05,
      "targetRank": 0,
      "cosines": [
        0.2612026333808899,
        0.13999365270137787,
        0.16308331489562988,
        0.24875833094120026
      ],
      "referencePrompts": [
        "A photograph of an orange cat sitting on a wooden table",
        "A red sports car on a street",
        "A snowy mountain above a blue lake",
        "A photograph of a black dog sitting on a wooden table"
      ]
    },
    "runtime": {
      "inferenceMs": 8113.9116670019575,
      "durationMs": 8113.9116670019575,
      "placement": {
        "unet": {
          "mps:0/torch.float32": 1680
        },
        "vae": {
          "mps:0/torch.float32": 248
        },
        "text_encoder": {
          "mps:0/torch.float32": 196
        },
        "text_encoder_2": {
          "mps:0/torch.float32": 517
        }
      },
      "seed": 42,
      "steps": 12,
      "guidanceScale": 7.5,
      "scheduler": "EulerDiscreteScheduler",
      "promptTokens": [
        13,
        13
      ],
      "negativePromptTokens": [
        9,
        9
      ],
      "promptTruncated": false,
      "negativePromptTruncated": false,
      "negativePromptIgnored": false,
      "safetyCheckerAvailable": false,
      "watermarkApplied": false,
      "imagesPerSecond": 0.12324511789632214,
      "denoisingStepsPerSecond": 1.4789414147558657,
      "driverAllocatedMemoryBytes": 29056663552,
      "memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
      "loadMs": 0,
      "totalMs": 8169.819458002166,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.12324511789632214
      },
      "performanceGrade": "A",
      "engine": "diffusers",
      "version": "0.32.2",
      "torchVersion": "2.6.0",
      "transformersVersion": "4.51.3",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
      "fallback": false,
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
      "score": 0.2612026333808899,
      "threshold": 0.22,
      "pixelStd": 0.32530075311660767,
      "minimumPixelStd": 0.05,
      "targetRank": 0,
      "cosines": [
        0.2612026333808899,
        0.13999365270137787,
        0.16308331489562988,
        0.24875833094120026
      ],
      "referencePrompts": [
        "A photograph of an orange cat sitting on a wooden table",
        "A red sports car on a street",
        "A snowy mountain above a blue lake",
        "A photograph of a black dog sitting on a wooden table"
      ]
    },
    "runtime": {
      "inferenceMs": 10257.71720800185,
      "durationMs": 10257.71720800185,
      "placement": {
        "unet": {
          "mps:0/torch.float32": 1680
        },
        "vae": {
          "mps:0/torch.float32": 248
        },
        "text_encoder": {
          "mps:0/torch.float32": 196
        },
        "text_encoder_2": {
          "mps:0/torch.float32": 517
        }
      },
      "seed": 42,
      "steps": 12,
      "guidanceScale": 7.5,
      "scheduler": "EulerDiscreteScheduler",
      "promptTokens": [
        13,
        13
      ],
      "negativePromptTokens": [
        9,
        9
      ],
      "promptTruncated": false,
      "negativePromptTruncated": false,
      "negativePromptIgnored": false,
      "safetyCheckerAvailable": false,
      "watermarkApplied": false,
      "imagesPerSecond": 0.09748757737442001,
      "denoisingStepsPerSecond": 1.1698509284930403,
      "driverAllocatedMemoryBytes": 17202003968,
      "memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
      "loadMs": 2539.5833750008023,
      "totalMs": 12846.661125000537,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.09748757737442001
      },
      "performanceGrade": "A",
      "engine": "diffusers",
      "version": "0.32.2",
      "torchVersion": "2.6.0",
      "transformersVersion": "4.51.3",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
      "fallback": false,
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
      "score": 0.2612026333808899,
      "threshold": 0.22,
      "pixelStd": 0.32530075311660767,
      "minimumPixelStd": 0.05,
      "targetRank": 0,
      "cosines": [
        0.2612026333808899,
        0.13999365270137787,
        0.16308331489562988,
        0.24875833094120026
      ],
      "referencePrompts": [
        "A photograph of an orange cat sitting on a wooden table",
        "A red sports car on a street",
        "A snowy mountain above a blue lake",
        "A photograph of a black dog sitting on a wooden table"
      ]
    },
    "runtime": {
      "inferenceMs": 7555.857833998743,
      "durationMs": 7555.857833998743,
      "placement": {
        "unet": {
          "mps:0/torch.float32": 1680
        },
        "vae": {
          "mps:0/torch.float32": 248
        },
        "text_encoder": {
          "mps:0/torch.float32": 196
        },
        "text_encoder_2": {
          "mps:0/torch.float32": 517
        }
      },
      "seed": 42,
      "steps": 12,
      "guidanceScale": 7.5,
      "scheduler": "EulerDiscreteScheduler",
      "promptTokens": [
        13,
        13
      ],
      "negativePromptTokens": [
        9,
        9
      ],
      "promptTruncated": false,
      "negativePromptTruncated": false,
      "negativePromptIgnored": false,
      "safetyCheckerAvailable": false,
      "watermarkApplied": false,
      "imagesPerSecond": 0.13234764628581897,
      "denoisingStepsPerSecond": 1.5881717554298278,
      "driverAllocatedMemoryBytes": 17202003968,
      "memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
      "loadMs": 0,
      "totalMs": 7597.600917000818,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.13234764628581897
      },
      "performanceGrade": "A",
      "engine": "diffusers",
      "version": "0.32.2",
      "torchVersion": "2.6.0",
      "transformersVersion": "4.51.3",
      "device": "mps",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
      "fallback": false,
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
      "score": 0.30264812707901,
      "threshold": 0.22,
      "pixelStd": 0.17550447583198547,
      "minimumPixelStd": 0.05,
      "targetRank": 0,
      "cosines": [
        0.30264812707901,
        0.1513705998659134,
        0.07889587432146072,
        0.19370920956134796
      ],
      "referencePrompts": [
        "A photograph of a red sports car parked on a street",
        "An orange cat on a table",
        "A snowy mountain above a blue lake",
        "A green forest with no cars"
      ]
    },
    "runtime": {
      "inferenceMs": 204448.59629100029,
      "durationMs": 204448.59629100029,
      "placement": {
        "unet": {
          "cpu/torch.float32": 1680
        },
        "vae": {
          "cpu/torch.float32": 248
        },
        "text_encoder": {
          "cpu/torch.float32": 196
        },
        "text_encoder_2": {
          "cpu/torch.float32": 517
        }
      },
      "seed": 42,
      "steps": 20,
      "guidanceScale": 7.5,
      "scheduler": "EulerDiscreteScheduler",
      "promptTokens": [
        13,
        13
      ],
      "negativePromptTokens": [
        2,
        2
      ],
      "promptTruncated": false,
      "negativePromptTruncated": false,
      "negativePromptIgnored": false,
      "safetyCheckerAvailable": false,
      "watermarkApplied": false,
      "imagesPerSecond": 0.004891205017503069,
      "denoisingStepsPerSecond": 0.09782410035006138,
      "loadMs": 1124.4640000004438,
      "totalMs": 205767.25779099797,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.004891205017503069
      },
      "performanceGrade": "C",
      "engine": "diffusers",
      "version": "0.32.2",
      "torchVersion": "2.6.0",
      "transformersVersion": "4.51.3",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
      "fallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "grade": "slow"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
      "score": 0.2613724172115326,
      "threshold": 0.22,
      "pixelStd": 0.32526078820228577,
      "minimumPixelStd": 0.05,
      "targetRank": 0,
      "cosines": [
        0.2613724172115326,
        0.13984692096710205,
        0.16196058690547943,
        0.24857036769390106
      ],
      "referencePrompts": [
        "A photograph of an orange cat sitting on a wooden table",
        "A red sports car on a street",
        "A snowy mountain above a blue lake",
        "A photograph of a black dog sitting on a wooden table"
      ]
    },
    "runtime": {
      "inferenceMs": 30993.34579099741,
      "durationMs": 30993.34579099741,
      "placement": {
        "unet": {
          "cpu/torch.float32": 1680
        },
        "vae": {
          "cpu/torch.float32": 248
        },
        "text_encoder": {
          "cpu/torch.float32": 196
        },
        "text_encoder_2": {
          "cpu/torch.float32": 517
        }
      },
      "seed": 42,
      "steps": 12,
      "guidanceScale": 7.5,
      "scheduler": "EulerDiscreteScheduler",
      "promptTokens": [
        13,
        13
      ],
      "negativePromptTokens": [
        9,
        9
      ],
      "promptTruncated": false,
      "negativePromptTruncated": false,
      "negativePromptIgnored": false,
      "safetyCheckerAvailable": false,
      "watermarkApplied": false,
      "imagesPerSecond": 0.032264990257698106,
      "denoisingStepsPerSecond": 0.3871798830923773,
      "loadMs": 0,
      "totalMs": 31037.47837499759,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.032264990257698106
      },
      "performanceGrade": "A",
      "engine": "diffusers",
      "version": "0.32.2",
      "torchVersion": "2.6.0",
      "transformersVersion": "4.51.3",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
      "fallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
      "score": 0.2752610445022583,
      "threshold": 0.22,
      "pixelStd": 0.30306851863861084,
      "minimumPixelStd": 0.05,
      "targetRank": 0,
      "cosines": [
        0.2752610445022583,
        0.10254481434822083,
        0.12228523939847946,
        0.1836145520210266
      ],
      "referencePrompts": [
        "A landscape photograph of snowy mountains above a blue lake",
        "A red sports car on a street",
        "An orange cat on a table",
        "A flat sandy desert with no water"
      ]
    },
    "runtime": {
      "inferenceMs": 30597.968499998387,
      "durationMs": 30597.968499998387,
      "placement": {
        "unet": {
          "cpu/torch.float32": 1680
        },
        "vae": {
          "cpu/torch.float32": 248
        },
        "text_encoder": {
          "cpu/torch.float32": 196
        },
        "text_encoder_2": {
          "cpu/torch.float32": 517
        }
      },
      "seed": 42,
      "steps": 12,
      "guidanceScale": 7.5,
      "scheduler": "EulerDiscreteScheduler",
      "promptTokens": [
        12,
        12
      ],
      "negativePromptTokens": [
        2,
        2
      ],
      "promptTruncated": false,
      "negativePromptTruncated": false,
      "negativePromptIgnored": false,
      "safetyCheckerAvailable": false,
      "watermarkApplied": false,
      "imagesPerSecond": 0.03268190827767055,
      "denoisingStepsPerSecond": 0.3921828993320466,
      "loadMs": 0,
      "totalMs": 30646.7882500001,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.03268190827767055
      },
      "performanceGrade": "A",
      "engine": "diffusers",
      "version": "0.32.2",
      "torchVersion": "2.6.0",
      "transformersVersion": "4.51.3",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
      "fallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
      "score": 0.2613724172115326,
      "threshold": 0.22,
      "pixelStd": 0.32526078820228577,
      "minimumPixelStd": 0.05,
      "targetRank": 0,
      "cosines": [
        0.2613724172115326,
        0.13984692096710205,
        0.16196058690547943,
        0.24857036769390106
      ],
      "referencePrompts": [
        "A photograph of an orange cat sitting on a wooden table",
        "A red sports car on a street",
        "A snowy mountain above a blue lake",
        "A photograph of a black dog sitting on a wooden table"
      ]
    },
    "runtime": {
      "inferenceMs": 30648.850166999182,
      "durationMs": 30648.850166999182,
      "placement": {
        "unet": {
          "cpu/torch.float32": 1680
        },
        "vae": {
          "cpu/torch.float32": 248
        },
        "text_encoder": {
          "cpu/torch.float32": 196
        },
        "text_encoder_2": {
          "cpu/torch.float32": 517
        }
      },
      "seed": 42,
      "steps": 12,
      "guidanceScale": 7.5,
      "scheduler": "EulerDiscreteScheduler",
      "promptTokens": [
        13,
        13
      ],
      "negativePromptTokens": [
        9,
        9
      ],
      "promptTruncated": false,
      "negativePromptTruncated": false,
      "negativePromptIgnored": false,
      "safetyCheckerAvailable": false,
      "watermarkApplied": false,
      "imagesPerSecond": 0.032627651430680395,
      "denoisingStepsPerSecond": 0.39153181716816476,
      "loadMs": 0,
      "totalMs": 30691.506875002233,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.032627651430680395
      },
      "performanceGrade": "A",
      "engine": "diffusers",
      "version": "0.32.2",
      "torchVersion": "2.6.0",
      "transformersVersion": "4.51.3",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
      "fallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
      "score": 0.2613724172115326,
      "threshold": 0.22,
      "pixelStd": 0.32526078820228577,
      "minimumPixelStd": 0.05,
      "targetRank": 0,
      "cosines": [
        0.2613724172115326,
        0.13984692096710205,
        0.16196058690547943,
        0.24857036769390106
      ],
      "referencePrompts": [
        "A photograph of an orange cat sitting on a wooden table",
        "A red sports car on a street",
        "A snowy mountain above a blue lake",
        "A photograph of a black dog sitting on a wooden table"
      ]
    },
    "runtime": {
      "inferenceMs": 30823.36199999918,
      "durationMs": 30823.36199999918,
      "placement": {
        "unet": {
          "cpu/torch.float32": 1680
        },
        "vae": {
          "cpu/torch.float32": 248
        },
        "text_encoder": {
          "cpu/torch.float32": 196
        },
        "text_encoder_2": {
          "cpu/torch.float32": 517
        }
      },
      "seed": 42,
      "steps": 12,
      "guidanceScale": 7.5,
      "scheduler": "EulerDiscreteScheduler",
      "promptTokens": [
        13,
        13
      ],
      "negativePromptTokens": [
        9,
        9
      ],
      "promptTruncated": false,
      "negativePromptTruncated": false,
      "negativePromptIgnored": false,
      "safetyCheckerAvailable": false,
      "watermarkApplied": false,
      "imagesPerSecond": 0.03244292429878436,
      "denoisingStepsPerSecond": 0.3893150915854124,
      "loadMs": 1245.372834000591,
      "totalMs": 32117.733543000213,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.03244292429878436
      },
      "performanceGrade": "A",
      "engine": "diffusers",
      "version": "0.32.2",
      "torchVersion": "2.6.0",
      "transformersVersion": "4.51.3",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 4,
      "artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
      "fallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "grade": "fast"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
      "score": 0.3329932391643524,
      "threshold": 0.22,
      "pixelStd": 0.22786079347133636,
      "minimumPixelStd": 0.05,
      "targetRank": 0,
      "cosines": [
        0.3329932391643524,
        0.15929476916790009,
        0.11256163567304611,
        0.19956912100315094
      ],
      "referencePrompts": [
        "A photograph of an orange cat sitting on a wooden table",
        "A red sports car on a street",
        "A snowy mountain above a blue lake",
        "A photograph of a black dog sitting on a wooden table"
      ]
    },
    "runtime": {
      "inferenceMs": 39247.74708300174,
      "durationMs": 39247.74708300174,
      "placement": {
        "unet": {
          "mps:0/torch.float16": 1680
        },
        "vae": {
          "mps:0/torch.float32": 248
        },
        "text_encoder": {
          "mps:0/torch.float16": 196
        },
        "text_encoder_2": {
          "mps:0/torch.float16": 517
        }
      },
      "seed": 42,
      "steps": 20,
      "guidanceScale": 7.5,
      "scheduler": "EulerDiscreteScheduler",
      "promptTokens": [
        13,
        13
      ],
      "negativePromptTokens": [
        9,
        9
      ],
      "promptTruncated": false,
      "negativePromptTruncated": false,
      "negativePromptIgnored": false,
      "safetyCheckerAvailable": false,
      "watermarkApplied": false,
      "imagesPerSecond": 0.025479169489275005,
      "denoisingStepsPerSecond": 0.5095833897855001,
      "driverAllocatedMemoryBytes": 21219491840,
      "memoryMeasurementScope": "Post-inference MPS driver allocation, not peak",
      "loadMs": 1756.9205830004648,
      "totalMs": 41189.588707999064,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.025479169489275005
      },
      "performanceGrade": "A",
      "engine": "diffusers",
      "version": "0.32.2",
      "torchVersion": "2.6.0",
      "transformersVersion": "4.51.3",
      "device": "mps",
      "precision": "fp16",
      "cpuThreads": 4,
      "artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
      "fallback": false,
      "provider": "Metal/MPS",
      "acceleration": "partial",
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
      "score": 0.2613724172115326,
      "threshold": 0.22,
      "pixelStd": 0.32526078820228577,
      "minimumPixelStd": 0.05,
      "targetRank": 0,
      "cosines": [
        0.2613724172115326,
        0.13984692096710205,
        0.16196058690547943,
        0.24857036769390106
      ],
      "referencePrompts": [
        "A photograph of an orange cat sitting on a wooden table",
        "A red sports car on a street",
        "A snowy mountain above a blue lake",
        "A photograph of a black dog sitting on a wooden table"
      ]
    },
    "runtime": {
      "inferenceMs": 35468.713666999975,
      "durationMs": 35468.713666999975,
      "placement": {
        "unet": {
          "cpu/torch.float32": 1680
        },
        "vae": {
          "cpu/torch.float32": 248
        },
        "text_encoder": {
          "cpu/torch.float32": 196
        },
        "text_encoder_2": {
          "cpu/torch.float32": 517
        }
      },
      "seed": 42,
      "steps": 12,
      "guidanceScale": 7.5,
      "scheduler": "EulerDiscreteScheduler",
      "promptTokens": [
        13,
        13
      ],
      "negativePromptTokens": [
        9,
        9
      ],
      "promptTruncated": false,
      "negativePromptTruncated": false,
      "negativePromptIgnored": false,
      "safetyCheckerAvailable": false,
      "watermarkApplied": false,
      "imagesPerSecond": 0.028193861479966727,
      "denoisingStepsPerSecond": 0.33832633775960075,
      "loadMs": 1250.0311250005325,
      "totalMs": 36768.13754199975,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.028193861479966727
      },
      "performanceGrade": "A",
      "engine": "diffusers",
      "version": "0.32.2",
      "torchVersion": "2.6.0",
      "transformersVersion": "4.51.3",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 2,
      "artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
      "fallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "grade": "fast"
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "metric": "CLIP target cosine + target-vs-distractor rank + nonblank pixel variation",
      "score": 0.2613724172115326,
      "threshold": 0.22,
      "pixelStd": 0.32526078820228577,
      "minimumPixelStd": 0.05,
      "targetRank": 0,
      "cosines": [
        0.2613724172115326,
        0.13984692096710205,
        0.16196058690547943,
        0.24857036769390106
      ],
      "referencePrompts": [
        "A photograph of an orange cat sitting on a wooden table",
        "A red sports car on a street",
        "A snowy mountain above a blue lake",
        "A photograph of a black dog sitting on a wooden table"
      ]
    },
    "runtime": {
      "inferenceMs": 35415.12062499896,
      "durationMs": 35415.12062499896,
      "placement": {
        "unet": {
          "cpu/torch.float32": 1680
        },
        "vae": {
          "cpu/torch.float32": 248
        },
        "text_encoder": {
          "cpu/torch.float32": 196
        },
        "text_encoder_2": {
          "cpu/torch.float32": 517
        }
      },
      "seed": 42,
      "steps": 12,
      "guidanceScale": 7.5,
      "scheduler": "EulerDiscreteScheduler",
      "promptTokens": [
        13,
        13
      ],
      "negativePromptTokens": [
        9,
        9
      ],
      "promptTruncated": false,
      "negativePromptTruncated": false,
      "negativePromptIgnored": false,
      "safetyCheckerAvailable": false,
      "watermarkApplied": false,
      "imagesPerSecond": 0.028236526725088043,
      "denoisingStepsPerSecond": 0.3388383207010565,
      "loadMs": 0,
      "totalMs": 35457.88124999672,
      "performanceMetric": {
        "name": "imagesPerSecond",
        "value": 0.028236526725088043
      },
      "performanceGrade": "A",
      "engine": "diffusers",
      "version": "0.32.2",
      "torchVersion": "2.6.0",
      "transformersVersion": "4.51.3",
      "device": "cpu",
      "precision": "fp32",
      "cpuThreads": 2,
      "artifactRevision": "462165984030d82259a11f4367a4eed129e94a7b",
      "fallback": false,
      "provider": "PyTorch CPU",
      "acceleration": "cpu",
      "grade": "fast"
    }
  },
  {
    "precision": "fp16",
    "device": "mps",
    "status": "fail",
    "quality": {
      "passed": false,
      "pixelStd": 0,
      "minimumPixelStd": 0.05,
      "reason": "Entire1024px output black with unmodified Diffusers0.32.2 MPS decode: VAE starts FP32 but pipeline silently casts it to FP16 (confirmed by recorded final placement)."
    },
    "runtime": {
      "inferenceMs": 42360.09766699863,
      "totalMs": 42360.09766699863,
      "performanceGrade": "F",
      "imagesPerSecond": 0.023607122152106544
    }
  }
]

Something not quite right?

Tell us what happened with Stable Diffusion XL 1.0. Loading, results, or the page itself—we’re here for all of it.

Attachments Optional

Up to 3 files · 50 MB each

Browser, OS, CPU/GPU, memory, screen, storage, and network details are included automatically. Model inputs, results, and browsing history are not collected.