A model is still running

A model is still running or downloading. Leaving will stop the current operation. Stay on this page to let it finish.

Skip to content
LocalAI.toolsBeta

Join the waitlist

Get an email when the new apps and model runs launch.

No account needed.

Sortformer 2.1

Identify up to four speaker channels in speech recordings with incremental timed segments.

Desktop inferencePrivate · Runs on your computer
About this model

Identify up to four speaker channels in speech recordings with incremental timed segments.

Created by
NVIDIA
Model released
Unknown
Source repository created
Oct 22, 2025
Model weights · FP32
472.1 MB

Best for

  • Local anonymous speaker timelines
  • Speaker attribution experiments on authorized recordings

Keep in mind

  • Maximum four anonymous speaker channels. Similar voices, noise, overlap and short utterances can merge or split speakers.
  • Measured on two synthetic fixture suites on Apple M3 Max/macOS27.2. No broad natural-meeting, language or four-speaker accuracy certification.
  • The noisy challenge passes narrowly at24.33% DER against25%. Historical defaults failed and their outputs remain in the report.
  • Three-second internal chunks,0.2s minimum segments and0.5s merge gap define this adapter. Both generation operations use the same incremental path.
  • WAV decoding/resampling and result serialization execute on CPU. MLX CPU and Metal use separate strict probes.
  • Windows, Intel Mac, other Mac hardware/OS versions and FP16 remain unverified.
  • Complete public archive, forced recovery and final packaged acceptance remain required before release completion.

Processed on your deviceYour input is processed locally in the desktop app. Model and runtime files download from external hosts.

Target platforms · verification required

  • macos · aarch64, x86_64
  • windows · x86_64

Recommended configuration

FP32 · mps (verified platform only)

Sources & technical details
Original model
https://huggingface.co/nvidia/diar_streaming_sortformer_4spk-v2.1
Release verification
Unknown
Release evidence
Official weights upload history is October2025. Exact first public availability has not been established.
Source updated
Sep 23, 2026
Native model files
mlx-community/diar_streaming_sortformer_4spk-v2.1-fp32
Files updated
Feb 10, 2026
Artifact revision
8541fc3db304f350b544bbcab1cfae4f3eeb2356

Desktop app

Sample result

Streaming Sortformer 2.1 Desktop

Run Sortformer 2.1 on your computer

Download the desktop app to load this model, provide input and view results locally.

Public desktop downloads are coming soon.

Device requirements

macOS Apple SiliconCPU / FP32Tested8.0 GiBRAM estimate
macOS Apple SiliconMPS / FP32Tested8.0 GiBRAM estimate
Windows Intel / AMDCPU / FP32Unverified8.0 GiBRAM estimate
macOS Intel / AMDCPU / FP32Unverified8.0 GiBRAM estimate
If your device falls short

MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.

GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.

PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.

Benchmark evidence

Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.

Streaming Sortformer 2.1 Desktop

60 configurations tested
Passed60
Failed0
TestedNov 7, 2026
Runtimemlx-audio 0.6.3

Quality criteria

No explicit quality gate recorded. Review per-case evidence; full certification is pending.

PrecisionDeviceResultPlatformInference / loadTask metric
FP32mpsAcceleratedPassedVery fastmacos · aarch6415 ms / 0 ms0.005 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch6415 ms / 0 ms0.005 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch6415 ms / 0 ms0.005 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch6415 ms / 0 ms0.005 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch6415 ms / 0 ms0.005 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch6416 ms / 0 ms0.005 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64176 ms / 0 ms0.008 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64179 ms / 0 ms0.008 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64182 ms / 0 ms0.008 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64144 ms / 0 ms0.008 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64145 ms / 0 ms0.008 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64146 ms / 0 ms0.008 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64317 ms / 0 ms0.009 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64320 ms / 0 ms0.009 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64321 ms / 0 ms0.009 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64322 ms / 0 ms0.009 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64322 ms / 0 ms0.009 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64323 ms / 0 ms0.009 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64319 ms / 0 ms0.009 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64320 ms / 0 ms0.009 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64320 ms / 0 ms0.009 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64320 ms / 0 ms0.009 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64321 ms / 0 ms0.009 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64321 ms / 0 ms0.009 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64326 ms / 0 ms0.009 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64327 ms / 0 ms0.010 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64330 ms / 0 ms0.010 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64346 ms / 609 ms0.010 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64346 ms / 617 ms0.010 RTF
FP32mpsAcceleratedPassedVery fastmacos · aarch64349 ms / 643 ms0.010 RTF
FP32cpuPassedVery fastmacos · aarch6462 ms / 0 ms0.021 RTF
FP32cpuPassedVery fastmacos · aarch6463 ms / 0 ms0.021 RTF
FP32cpuPassedVery fastmacos · aarch6463 ms / 0 ms0.021 RTF
FP32cpuPassedVery fastmacos · aarch6464 ms / 0 ms0.021 RTF
FP32cpuPassedVery fastmacos · aarch6465 ms / 0 ms0.022 RTF
FP32cpuPassedVery fastmacos · aarch6466 ms / 0 ms0.022 RTF
FP32cpuPassedVery fastmacos · aarch64909 ms / 0 ms0.049 RTF
FP32cpuPassedVery fastmacos · aarch64917 ms / 0 ms0.049 RTF
FP32cpuPassedVery fastmacos · aarch64921 ms / 0 ms0.050 RTF
FP32cpuPassedVery fastmacos · aarch641170 ms / 0 ms0.050 RTF
FP32cpuPassedVery fastmacos · aarch641180 ms / 0 ms0.050 RTF
FP32cpuPassedVery fastmacos · aarch641190 ms / 0 ms0.051 RTF
FP32cpuPassedVery fastmacos · aarch642391 ms / 0 ms0.067 RTF
FP32cpuPassedVery fastmacos · aarch642396 ms / 0 ms0.067 RTF
FP32cpuPassedVery fastmacos · aarch642400 ms / 0 ms0.067 RTF
FP32cpuPassedVery fastmacos · aarch642402 ms / 0 ms0.067 RTF
FP32cpuPassedVery fastmacos · aarch642405 ms / 0 ms0.067 RTF
FP32cpuPassedVery fastmacos · aarch642443 ms / 606 ms0.069 RTF
FP32cpuPassedVery fastmacos · aarch642375 ms / 0 ms0.069 RTF
FP32cpuPassedVery fastmacos · aarch642379 ms / 0 ms0.069 RTF
FP32cpuPassedVery fastmacos · aarch642387 ms / 0 ms0.069 RTF
FP32cpuPassedVery fastmacos · aarch642387 ms / 0 ms0.069 RTF
FP32cpuPassedVery fastmacos · aarch642391 ms / 0 ms0.069 RTF
FP32cpuPassedVery fastmacos · aarch642391 ms / 0 ms0.069 RTF
FP32cpuPassedVery fastmacos · aarch642402 ms / 0 ms0.070 RTF
FP32cpuPassedVery fastmacos · aarch642493 ms / 684 ms0.070 RTF
FP32cpuPassedVery fastmacos · aarch642436 ms / 0 ms0.071 RTF
FP32cpuPassedVery fastmacos · aarch642442 ms / 0 ms0.071 RTF
FP32cpuPassedVery fastmacos · aarch642527 ms / 627 ms0.071 RTF
FP32cpuPassedVery fastmacos · aarch642538 ms / 0 ms0.071 RTF
Test setup & sample details
Quality gate
No explicit quality gate recorded. Review the per-case quality evidence; full certification is pending.
Tested
2026-11-07T08:43:39.621007+00:00
Environment
{ "os": "macos", "arch": "aarch64", "hardware": "Apple M3 Max", "osVersion": "27.2", "runtime": "MLX Audio0.6.3 / MLX0.32.4", "scope": "Isolated private app-owned CPython probe venv. Model-local snapshot initialization, excludes network/provisioning." }
Runtime
mlx-audio 0.6.3
Artifact revision
8541fc3db304f350b544bbcab1cfae4f3eeb2356
Fixture
{
  "file": "model-samples/desktop/nemotron-diarization/two-speakers.wav",
  "size": 2281320,
  "sha1": "dd1f5044b4dfa54815d41ae8c786458557b5344e",
  "sha256": "65ff2090f2ae357a70d7d2b65ba00634a37b60642c9de5857acabe97648f287a",
  "url": "https://assets.localai.tools/samples/v1/files/65ff2090f2ae357a70d7d2b65ba00634a37b60642c9de5857acabe97648f287a/two-speakers.wav"
}
Rerun when
Artifact/runtime/preprocessing; Fixtures/quality gate; Backend behavior
Per-case quality & failure details
[
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.16184971098265896,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 684.0625409968197,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 2492.7507499960484,
      "inferenceMs": 2492.7507499960484,
      "audioSeconds": 35.644375,
      "realTimeFactor": 0.06993391664171551,
      "audioSecondsPerSecond": 14.299213429203261,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 3176.813290992868,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.17212588310854207,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 2391.0615829954622,
      "inferenceMs": 2391.0615829954622,
      "audioSeconds": 35.644375,
      "realTimeFactor": 0.06708103545076782,
      "audioSecondsPerSecond": 14.907342936498363,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 2391.0615829954622,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.17469492614001284,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 2399.9466249952093,
      "inferenceMs": 2399.9466249952093,
      "audioSeconds": 35.644375,
      "realTimeFactor": 0.06733030457106372,
      "audioSecondsPerSecond": 14.85215322239558,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 2399.9466249952093,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.21455938697318008,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A"
      },
      "referenceSpeakers": 1,
      "hypothesisSpeakers": 1,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 1190.3591250011232,
      "inferenceMs": 1190.3591250011232,
      "audioSeconds": 23.387375,
      "realTimeFactor": 0.05089750880554672,
      "audioSecondsPerSecond": 19.647327019883964,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 1190.3591250011232,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {},
      "referenceSpeakers": 0,
      "hypothesisSpeakers": 0,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 64.39670799591113,
      "inferenceMs": 64.39670799591113,
      "audioSeconds": 3,
      "realTimeFactor": 0.021465569331970375,
      "audioSecondsPerSecond": 46.58623233023783,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 64.39670799591113,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.013368983957219251,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 2386.988999998721,
      "inferenceMs": 2386.988999998721,
      "audioSeconds": 34.439375,
      "realTimeFactor": 0.06930988149461832,
      "audioSecondsPerSecond": 14.427957146018878,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 2386.988999998721,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.013368983957219251,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 2441.574499993294,
      "inferenceMs": 2441.574499993294,
      "audioSeconds": 34.439375,
      "realTimeFactor": 0.07089485508936483,
      "audioSecondsPerSecond": 14.105395923857571,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 2441.574499993294,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.24598930481283424,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 2401.7808329954278,
      "inferenceMs": 2401.7808329954278,
      "audioSeconds": 34.439375,
      "realTimeFactor": 0.0697393850206465,
      "audioSecondsPerSecond": 14.339099774165597,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 2401.7808329954278,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A"
      },
      "referenceSpeakers": 1,
      "hypothesisSpeakers": 1,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 920.9682500004419,
      "inferenceMs": 920.9682500004419,
      "audioSeconds": 18.5855,
      "realTimeFactor": 0.04955305211054004,
      "audioSecondsPerSecond": 20.180391669301393,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 920.9682500004419,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {},
      "referenceSpeakers": 0,
      "hypothesisSpeakers": 0,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 65.88883400399936,
      "inferenceMs": 65.88883400399936,
      "audioSeconds": 3,
      "realTimeFactor": 0.02196294466799979,
      "audioSecondsPerSecond": 45.531235228990454,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 65.88883400399936,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.16184971098265896,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 606.3782909986912,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 2443.072124995524,
      "inferenceMs": 2443.072124995524,
      "audioSeconds": 35.644375,
      "realTimeFactor": 0.06854018691576227,
      "audioSecondsPerSecond": 14.589980637622519,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 3049.4504159942153,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.17212588310854207,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 2538.017624996428,
      "inferenceMs": 2538.017624996428,
      "audioSeconds": 35.644375,
      "realTimeFactor": 0.0712038750853796,
      "audioSecondsPerSecond": 14.044179460751446,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 2538.017624996428,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.17469492614001284,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 2401.794749996043,
      "inferenceMs": 2401.794749996043,
      "audioSeconds": 35.644375,
      "realTimeFactor": 0.06738215356549365,
      "audioSecondsPerSecond": 14.840724837148855,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 2401.794749996043,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.21455938697318008,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A"
      },
      "referenceSpeakers": 1,
      "hypothesisSpeakers": 1,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 1170.1209590028157,
      "inferenceMs": 1170.1209590028157,
      "audioSeconds": 23.387375,
      "realTimeFactor": 0.05003216303680151,
      "audioSecondsPerSecond": 19.987143055646882,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 1170.1209590028157,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {},
      "referenceSpeakers": 0,
      "hypothesisSpeakers": 0,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 61.90387500100769,
      "inferenceMs": 61.90387500100769,
      "audioSeconds": 3,
      "realTimeFactor": 0.020634625000335898,
      "audioSecondsPerSecond": 48.4622327754307,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 61.90387500100769,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.013368983957219251,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 2378.9042079952196,
      "inferenceMs": 2378.9042079952196,
      "audioSeconds": 34.439375,
      "realTimeFactor": 0.06907512717623998,
      "audioSecondsPerSecond": 14.476991080285316,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 2378.9042079952196,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.013368983957219251,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 2375.0383340011467,
      "inferenceMs": 2375.0383340011467,
      "audioSeconds": 34.439375,
      "realTimeFactor": 0.06896287560390242,
      "audioSecondsPerSecond": 14.500555425554394,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 2375.0383340011467,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.24598930481283424,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 2390.945125000144,
      "inferenceMs": 2390.945125000144,
      "audioSeconds": 34.439375,
      "realTimeFactor": 0.0694247536431815,
      "audioSecondsPerSecond": 14.404084242626826,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 2390.945125000144,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A"
      },
      "referenceSpeakers": 1,
      "hypothesisSpeakers": 1,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 909.3475839981693,
      "inferenceMs": 909.3475839981693,
      "audioSeconds": 18.5855,
      "realTimeFactor": 0.04892779769165044,
      "audioSecondsPerSecond": 20.438279407181465,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 909.3475839981693,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {},
      "referenceSpeakers": 0,
      "hypothesisSpeakers": 0,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 62.717749999137595,
      "inferenceMs": 62.717749999137595,
      "audioSeconds": 3,
      "realTimeFactor": 0.0209059166663792,
      "audioSecondsPerSecond": 47.83334861408854,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 62.717749999137595,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.16184971098265896,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 626.5279169965652,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 2527.2695409948938,
      "inferenceMs": 2527.2695409948938,
      "audioSeconds": 35.644375,
      "realTimeFactor": 0.07090233847542267,
      "audioSecondsPerSecond": 14.103907170094768,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 3153.797457991459,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.17212588310854207,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 2395.7039580054698,
      "inferenceMs": 2395.7039580054698,
      "audioSeconds": 35.644375,
      "realTimeFactor": 0.06721127689868232,
      "audioSecondsPerSecond": 14.878455612552198,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 2395.7039580054698,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.17469492614001284,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 2404.706500004977,
      "inferenceMs": 2404.706500004977,
      "audioSeconds": 35.644375,
      "realTimeFactor": 0.06746384247177786,
      "audioSecondsPerSecond": 14.822754876707917,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 2404.706500004977,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.21455938697318008,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A"
      },
      "referenceSpeakers": 1,
      "hypothesisSpeakers": 1,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 1179.7617920019547,
      "inferenceMs": 1179.7617920019547,
      "audioSeconds": 23.387375,
      "realTimeFactor": 0.05044438685410204,
      "audioSecondsPerSecond": 19.823811178283393,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 1179.7617920019547,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {},
      "referenceSpeakers": 0,
      "hypothesisSpeakers": 0,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 63.14900000143098,
      "inferenceMs": 63.14900000143098,
      "audioSeconds": 3,
      "realTimeFactor": 0.021049666667143658,
      "audioSecondsPerSecond": 47.506690524505835,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 63.14900000143098,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.013368983957219251,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 2391.265416998067,
      "inferenceMs": 2391.265416998067,
      "audioSeconds": 34.439375,
      "realTimeFactor": 0.06943405381189603,
      "audioSecondsPerSecond": 14.402154923995974,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 2391.265416998067,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.013368983957219251,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 2435.856625001179,
      "inferenceMs": 2435.856625001179,
      "audioSeconds": 34.439375,
      "realTimeFactor": 0.07072882783154977,
      "audioSecondsPerSecond": 14.138506612630918,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 2435.856625001179,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.24598930481283424,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 2386.927042003663,
      "inferenceMs": 2386.927042003663,
      "audioSeconds": 34.439375,
      "realTimeFactor": 0.0693080824493378,
      "audioSecondsPerSecond": 14.428331655705106,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 2386.927042003663,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A"
      },
      "referenceSpeakers": 1,
      "hypothesisSpeakers": 1,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 917.0772500001476,
      "inferenceMs": 917.0772500001476,
      "audioSeconds": 18.5855,
      "realTimeFactor": 0.04934369535391287,
      "audioSecondsPerSecond": 20.266013577369854,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 917.0772500001476,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {},
      "referenceSpeakers": 0,
      "hypothesisSpeakers": 0,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX CPU",
      "acceleration": "cpu",
      "executionDevice": "Device(cpu, 0)",
      "durationMs": 64.905708997685,
      "inferenceMs": 64.905708997685,
      "audioSeconds": 3,
      "realTimeFactor": 0.021635236332561664,
      "audioSecondsPerSecond": 46.220895608843925,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 64.905708997685,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.16184971098265896,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 642.8446670033736,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 349.2665419980767,
      "inferenceMs": 349.2665419980767,
      "audioSeconds": 35.644375,
      "realTimeFactor": 0.009798644021618466,
      "audioSecondsPerSecond": 102.05493717229942,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 992.1112090014503,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.17212588310854207,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 321.3156670026365,
      "inferenceMs": 321.3156670026365,
      "audioSeconds": 35.644375,
      "realTimeFactor": 0.009014484529540397,
      "audioSecondsPerSecond": 110.93257709001637,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 321.3156670026365,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.17469492614001284,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 320.2506670058938,
      "inferenceMs": 320.2506670058938,
      "audioSeconds": 35.644375,
      "realTimeFactor": 0.008984606042493206,
      "audioSecondsPerSecond": 111.30148559329623,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 320.2506670058938,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.21455938697318008,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A"
      },
      "referenceSpeakers": 1,
      "hypothesisSpeakers": 1,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 179.11816700507188,
      "inferenceMs": 179.11816700507188,
      "audioSeconds": 23.387375,
      "realTimeFactor": 0.007658754648825355,
      "audioSecondsPerSecond": 130.5695306681972,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 179.11816700507188,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {},
      "referenceSpeakers": 0,
      "hypothesisSpeakers": 0,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 15.063708000525367,
      "inferenceMs": 15.063708000525367,
      "audioSeconds": 3,
      "realTimeFactor": 0.005021236000175122,
      "audioSecondsPerSecond": 199.15415247662602,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 15.063708000525367,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.013368983957219251,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 327.4847499997122,
      "inferenceMs": 327.4847499997122,
      "audioSeconds": 34.439375,
      "realTimeFactor": 0.009509021287398863,
      "audioSecondsPerSecond": 105.16329386339444,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 327.4847499997122,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.013368983957219251,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 319.59316600114107,
      "inferenceMs": 319.59316600114107,
      "audioSeconds": 34.439375,
      "realTimeFactor": 0.009279877059358396,
      "audioSecondsPerSecond": 107.76004828550381,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 319.59316600114107,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.24598930481283424,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 320.8313340001041,
      "inferenceMs": 320.8313340001041,
      "audioSeconds": 34.439375,
      "realTimeFactor": 0.009315829163569435,
      "audioSecondsPerSecond": 107.34417542891501,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 320.8313340001041,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A"
      },
      "referenceSpeakers": 1,
      "hypothesisSpeakers": 1,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 145.04583399684634,
      "inferenceMs": 145.04583399684634,
      "audioSeconds": 18.5855,
      "realTimeFactor": 0.007804247074162457,
      "audioSecondsPerSecond": 128.13535892664174,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 145.04583399684634,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {},
      "referenceSpeakers": 0,
      "hypothesisSpeakers": 0,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 14.85066700115567,
      "inferenceMs": 14.85066700115567,
      "audioSeconds": 3,
      "realTimeFactor": 0.004950222333718557,
      "audioSecondsPerSecond": 202.0111285080018,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 14.85066700115567,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.16184971098265896,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 617.3439999984112,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 346.30900000047404,
      "inferenceMs": 346.30900000047404,
      "audioSeconds": 35.644375,
      "realTimeFactor": 0.009715670424869956,
      "audioSecondsPerSecond": 102.92650494197727,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 963.6529999988852,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.17212588310854207,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 317.4555000005057,
      "inferenceMs": 317.4555000005057,
      "audioSeconds": 35.644375,
      "realTimeFactor": 0.008906187862755504,
      "audioSecondsPerSecond": 112.28148512135785,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 317.4555000005057,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.17469492614001284,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 322.0611669967184,
      "inferenceMs": 322.0611669967184,
      "audioSeconds": 35.644375,
      "realTimeFactor": 0.009035399470371366,
      "audioSecondsPerSecond": 110.6757928389522,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 322.0611669967184,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.21455938697318008,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A"
      },
      "referenceSpeakers": 1,
      "hypothesisSpeakers": 1,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 181.55962500168243,
      "inferenceMs": 181.55962500168243,
      "audioSeconds": 23.387375,
      "realTimeFactor": 0.007763146783325723,
      "audioSecondsPerSecond": 128.81374369319875,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 181.55962500168243,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {},
      "referenceSpeakers": 0,
      "hypothesisSpeakers": 0,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 14.891250000800937,
      "inferenceMs": 14.891250000800937,
      "audioSeconds": 3,
      "realTimeFactor": 0.004963750000266979,
      "audioSecondsPerSecond": 201.4605892613879,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 14.891250000800937,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.013368983957219251,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 329.5793750003213,
      "inferenceMs": 329.5793750003213,
      "audioSeconds": 34.439375,
      "realTimeFactor": 0.009569841932390506,
      "audioSecondsPerSecond": 104.49493388342769,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 329.5793750003213,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.013368983957219251,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 319.5224169976427,
      "inferenceMs": 319.5224169976427,
      "audioSeconds": 34.439375,
      "realTimeFactor": 0.009277822753683617,
      "audioSecondsPerSecond": 107.7839086334092,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 319.5224169976427,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.24598930481283424,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 321.3717499966151,
      "inferenceMs": 321.3717499966151,
      "audioSeconds": 34.439375,
      "realTimeFactor": 0.00933152096972187,
      "audioSecondsPerSecond": 107.16366637815159,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 321.3717499966151,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A"
      },
      "referenceSpeakers": 1,
      "hypothesisSpeakers": 1,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 146.40791700367117,
      "inferenceMs": 146.40791700367117,
      "audioSeconds": 18.5855,
      "realTimeFactor": 0.007877534475998557,
      "audioSecondsPerSecond": 126.94327178723518,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 146.40791700367117,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {},
      "referenceSpeakers": 0,
      "hypothesisSpeakers": 0,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 15.159791997575667,
      "inferenceMs": 15.159791997575667,
      "audioSeconds": 3,
      "realTimeFactor": 0.005053263999191889,
      "audioSecondsPerSecond": 197.8918972291807,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 15.159791997575667,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.16184971098265896,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 608.504375006305,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 345.86337500513764,
      "inferenceMs": 345.86337500513764,
      "audioSeconds": 35.644375,
      "realTimeFactor": 0.009703168452389407,
      "audioSecondsPerSecond": 103.05911980264032,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 954.3677500114427,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.17212588310854207,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 322.7877500030445,
      "inferenceMs": 322.7877500030445,
      "audioSeconds": 35.644375,
      "realTimeFactor": 0.00905578369667148,
      "audioSecondsPerSecond": 110.42666581883545,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 322.7877500030445,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.17469492614001284,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 321.6960839999956,
      "inferenceMs": 321.6960839999956,
      "audioSeconds": 35.644375,
      "realTimeFactor": 0.009025157097017289,
      "audioSecondsPerSecond": 110.80139539404676,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 321.6960839999956,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.21455938697318008,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A"
      },
      "referenceSpeakers": 1,
      "hypothesisSpeakers": 1,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 176.48887500399724,
      "inferenceMs": 176.48887500399724,
      "audioSeconds": 23.387375,
      "realTimeFactor": 0.007546331086921779,
      "audioSecondsPerSecond": 132.51472649179902,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 176.48887500399724,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {},
      "referenceSpeakers": 0,
      "hypothesisSpeakers": 0,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 16.043584000726696,
      "inferenceMs": 16.043584000726696,
      "audioSeconds": 3,
      "realTimeFactor": 0.005347861333575565,
      "audioSecondsPerSecond": 186.99063749497085,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 16.043584000726696,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.013368983957219251,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 325.5804999935208,
      "inferenceMs": 325.5804999935208,
      "audioSeconds": 34.439375,
      "realTimeFactor": 0.00945372847194587,
      "audioSecondsPerSecond": 105.77837124976882,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 325.5804999935208,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.013368983957219251,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 319.5813749989611,
      "inferenceMs": 319.5813749989611,
      "audioSeconds": 34.439375,
      "realTimeFactor": 0.009279534689551163,
      "audioSecondsPerSecond": 107.76402410845111,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 319.5813749989611,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0.24598930481283424,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A",
        "1": "B"
      },
      "referenceSpeakers": 2,
      "hypothesisSpeakers": 2,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 319.19704199390253,
      "inferenceMs": 319.19704199390253,
      "audioSeconds": 34.439375,
      "realTimeFactor": 0.009268374992110123,
      "audioSecondsPerSecond": 107.89377866683952,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 319.19704199390253,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {
        "0": "A"
      },
      "referenceSpeakers": 1,
      "hypothesisSpeakers": 1,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 144.46916700399015,
      "inferenceMs": 144.46916700399015,
      "audioSeconds": 18.5855,
      "realTimeFactor": 0.007773219284065005,
      "audioSecondsPerSecond": 128.64682745410084,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 144.46916700399015,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  },
  {
    "precision": "fp32",
    "device": "mps",
    "status": "pass",
    "quality": {
      "diarizationErrorRate": 0,
      "maximumDiarizationErrorRate": 0.25,
      "collarSeconds": 0.25,
      "evaluationStepSeconds": 0.02,
      "speakerMapping": {},
      "referenceSpeakers": 0,
      "hypothesisSpeakers": 0,
      "passed": true
    },
    "runtime": {
      "engine": "mlx-audio",
      "version": "0.6.3",
      "mlxVersion": "0.32.4",
      "loadMs": 0,
      "provider": "MLX Metal",
      "acceleration": "partial",
      "executionDevice": "Device(gpu, 0)",
      "durationMs": 15.143709002586547,
      "inferenceMs": 15.143709002586547,
      "audioSeconds": 3,
      "realTimeFactor": 0.005047903000862182,
      "audioSecondsPerSecond": 198.1020633378256,
      "threshold": 0.5,
      "chunkSeconds": 3,
      "minDuration": 0.2,
      "mergeGap": 0.5,
      "stateResetPerRequest": true,
      "totalMs": 15.143709002586547,
      "grade": "fast",
      "artifactRevision": "8541fc3db304f350b544bbcab1cfae4f3eeb2356",
      "fallback": false
    }
  }
]
Release validation still required
  • Complete public dependency archive and separate forced model/runtime-source recovery pending

Something not quite right?

Tell us what happened with Sortformer 2.1. Loading, results, or the page itself—we’re here for all of it.

Attachments Optional

Up to 3 files · 50 MB each

Browser, OS, CPU/GPU, memory, screen, storage, and network details are included automatically. Model inputs, results, and browsing history are not collected.