GLiClass 4 Desktop
Rank custom labels against text using an optional instruction.
Desktop app
Run GLiClass 4 Desktop on your computer
Download the desktop app to load this model, provide input and view results locally.
Public desktop downloads are coming soon.Device requirements
If your device falls short
MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.
GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.
PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.
Benchmark evidence
Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.
GLiClass 4 Edge 0.4B Desktop
4 configurations testedQuality criteria
Expected top label, relevant labels in top three, complete finite scores and less than 1.5 seconds per fixture.
| Precision | Device | Result | Platform | Inference / load | |
|---|---|---|---|---|---|
BF16 | mpsAccelerated | Passed | Not measured | macos · aarch64 | 205 ms / 2464 ms |
FP16 | mpsAccelerated | Passed | Not measured | macos · aarch64 | 205 ms / 2382 ms |
FP32 | mpsAccelerated | Passed | Not measured | macos · aarch64 | 203 ms / 2480 ms |
FP32 | cpu | Passed | Not measured | macos · aarch64 | 98 ms / 4240 ms |
Test setup & sample details
- Quality gate
- Expected top label, relevant labels in top three, complete finite scores and less than 1.5 seconds per fixture.
- Tested
- 2026-11-14T13:18:43.557094+00:00
- Environment
- Apple M3 Max macOS 27.2. Three repetitions per fixture with independently initialized backends.
- Runtime
- transformers 5.22.1
- Artifact revision
- 885af1af8a07edf4ed34df83ca0d995ed8201283
- Fixture
{ "file": "model-samples/gliclass-v4-product.json", "size": 279, "sha1": "aeb6baa836a422081758d97527bb1e922270d633", "sha256": "ae5cc91185924e774a5de326dfb98d21203b41991a912c7dc6a61fca61f62027", "url": "https://assets.localai.tools/samples/v1/files/ae5cc91185924e774a5de326dfb98d21203b41991a912c7dc6a61fca61f62027/gliclass-v4-product.json", "durationSeconds": 0 }- Rerun when
- artifact or runtime revision; tokenizer or prompt formatting; fixture or threshold
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"matches": 1,
"topLabel": "billing support",
"grade": "ranking-pass"
},
"runtime": {
"inferenceMs": 97.81041700625792,
"durationMs": 97.81041700625792,
"itemsPerSecond": 10.223859897622356,
"peakResidentMemoryBytes": 3202891776,
"outputDevice": "cpu",
"loadMs": 4239.581832953263,
"totalMs": 4337.392249959521,
"grade": "interactive",
"engine": "transformers",
"version": "5.22.1",
"device": "cpu",
"precision": "fp32",
"fallback": false,
"artifactRevision": "885af1af8a07edf4ed34df83ca0d995ed8201283",
"torchVersion": "2.10.0",
"provider": "PyTorch CPU",
"acceleration": "cpu",
"placement": [
"cpu/torch.float32"
],
"cpuThreads": 4,
"requestedDevice": "cpu",
"requestedPrecision": "fp32"
}
},
{
"precision": "bf16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"matches": 1,
"topLabel": "billing support",
"grade": "ranking-pass"
},
"runtime": {
"inferenceMs": 204.7680409741588,
"durationMs": 204.7680409741588,
"itemsPerSecond": 4.8835745814758145,
"peakResidentMemoryBytes": 675004416,
"outputDevice": "mps",
"loadMs": 2464.3356659798883,
"totalMs": 2669.103706954047,
"grade": "interactive",
"engine": "transformers",
"version": "5.22.1",
"device": "mps",
"precision": "bf16",
"fallback": false,
"artifactRevision": "885af1af8a07edf4ed34df83ca0d995ed8201283",
"torchVersion": "2.10.0",
"provider": "PyTorch Metal",
"acceleration": "partial",
"placement": [
"mps:0/torch.bfloat16"
],
"cpuThreads": 4,
"requestedDevice": "mps",
"requestedPrecision": "bf16"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"matches": 1,
"topLabel": "billing support",
"grade": "ranking-pass"
},
"runtime": {
"inferenceMs": 205.4120830143802,
"durationMs": 205.4120830143802,
"itemsPerSecond": 4.868262788270315,
"peakResidentMemoryBytes": 2103115776,
"outputDevice": "mps",
"loadMs": 2381.668125046417,
"totalMs": 2587.0802080607973,
"grade": "interactive",
"engine": "transformers",
"version": "5.22.1",
"device": "mps",
"precision": "fp16",
"fallback": false,
"artifactRevision": "885af1af8a07edf4ed34df83ca0d995ed8201283",
"torchVersion": "2.10.0",
"provider": "PyTorch Metal",
"acceleration": "partial",
"placement": [
"mps:0/torch.float16"
],
"cpuThreads": 4,
"requestedDevice": "mps",
"requestedPrecision": "fp16"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"matches": 1,
"topLabel": "billing support",
"grade": "ranking-pass"
},
"runtime": {
"inferenceMs": 202.75029097683728,
"durationMs": 202.75029097683728,
"itemsPerSecond": 4.932175412336363,
"peakResidentMemoryBytes": 2989899776,
"outputDevice": "mps",
"loadMs": 2480.079040979035,
"totalMs": 2682.8293319558725,
"grade": "interactive",
"engine": "transformers",
"version": "5.22.1",
"device": "mps",
"precision": "fp32",
"fallback": false,
"artifactRevision": "885af1af8a07edf4ed34df83ca0d995ed8201283",
"torchVersion": "2.10.0",
"provider": "PyTorch Metal",
"acceleration": "partial",
"placement": [
"mps:0/torch.float32"
],
"cpuThreads": 4,
"requestedDevice": "mps",
"requestedPrecision": "fp32"
}
}
]Release validation still required
- Model/runtime backup and dependent outage checks deferred.
- Windows benchmarking deferred.