NeuDecide Desktop
Turn English speech into proposed calls to supplied tools.
Desktop app
Run NeuDecide Desktop on your computer
Download the desktop app to load this model, provide input and view results locally.
Public desktop downloads are coming soon.Device requirements
If your device falls short
MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.
GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.
PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.
Benchmark evidence
Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.
NeuDecide Desktop
12 configurations testedQuality criteria
No explicit quality gate recorded. Review per-case evidence; full certification is pending.
| Precision | Device | Result | Platform | Inference / load | Task metric | |
|---|---|---|---|---|---|---|
Q4 | cpu | Passed | Very fast | macos · aarch64 | 61 ms / 117 ms | 0.015 RTF |
Q4 | cpu | Passed | Very fast | macos · aarch64 | 63 ms / 117 ms | 0.015 RTF |
Q4 | cpu | Passed | Very fast | macos · aarch64 | 58 ms / 117 ms | 0.016 RTF |
Q4 | cpu | Passed | Very fast | macos · aarch64 | 59 ms / 117 ms | 0.017 RTF |
Q4 | cpu | Passed | Very fast | macos · aarch64 | 58 ms / 117 ms | 0.019 RTF |
Q4 | cpu | Passed | Very fast | macos · aarch64 | 74 ms / 117 ms | 0.025 RTF |
Q4 | cpu | Passed | Very fast | macos · aarch64 | 146 ms / 112 ms | 0.035 RTF |
Q4 | cpu | Passed | Very fast | macos · aarch64 | 149 ms / 112 ms | 0.036 RTF |
Q4 | cpu | Passed | Very fast | macos · aarch64 | 134 ms / 112 ms | 0.038 RTF |
Q4 | cpu | Passed | Very fast | macos · aarch64 | 136 ms / 112 ms | 0.039 RTF |
Q4 | cpu | Passed | Very fast | macos · aarch64 | 136 ms / 112 ms | 0.046 RTF |
Q4 | cpu | Passed | Very fast | macos · aarch64 | 155 ms / 112 ms | 0.052 RTF |
Test setup & sample details
- Quality gate
- No explicit quality gate recorded. Review the per-case quality evidence; full certification is pending.
- Tested
- 2026-11-14T19:52:59.123621+00:00
- Environment
- { "os": "macos", "osVersion": "27.2", "arch": "aarch64", "hardware": "Apple M3 Max" }
- Runtime
- onnxruntime 1.23.2
- Artifact revision
- e1b1388cdf210f523d9bb22b6a0e3ba6b546ea0f
- Fixture
{ "file": "model-samples/desktop/neudecide/binfullness.wav", "size": 263152, "sha1": "9204836aa127063701fd862a4f70773811b051df", "sha256": "45440609257d430cff2d08ee77dd49f551e160ce94031bf10cefa67a6a5ee156", "url": "https://assets.localai.tools/samples/v1/files/45440609257d430cff2d08ee77dd49f551e160ce94031bf10cefa67a6a5ee156/binfullness.wav" }- Rerun when
- artifact revision; runtime version; fixture or quality gate
Per-case quality & failure details
[
{
"precision": "q4",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"exactCallMatch": 1
},
"runtime": {
"precision": "q4",
"device": "cpu",
"version": "1.23.2",
"artifactRevision": "e1b1388cdf210f523d9bb22b6a0e3ba6b546ea0f",
"provider": "CPUExecutionProvider",
"fallback": false,
"loadMs": 112.12266597431153,
"inferenceMs": 155.36137495655566,
"totalMs": 267.4840409308672,
"realTimeFactor": 0.05208116657178844,
"grade": "fast"
}
},
{
"precision": "q4",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"exactCallMatch": 1
},
"runtime": {
"precision": "q4",
"device": "cpu",
"version": "1.23.2",
"artifactRevision": "e1b1388cdf210f523d9bb22b6a0e3ba6b546ea0f",
"provider": "CPUExecutionProvider",
"fallback": false,
"loadMs": 112.12266597431153,
"inferenceMs": 136.05791598092765,
"totalMs": 248.18058195523918,
"realTimeFactor": 0.0456101459426102,
"grade": "fast"
}
},
{
"precision": "q4",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"exactCallMatch": 1
},
"runtime": {
"precision": "q4",
"device": "cpu",
"version": "1.23.2",
"artifactRevision": "e1b1388cdf210f523d9bb22b6a0e3ba6b546ea0f",
"provider": "CPUExecutionProvider",
"fallback": false,
"loadMs": 112.12266597431153,
"inferenceMs": 136.3797500380315,
"totalMs": 248.50241601234302,
"realTimeFactor": 0.03882144891489652,
"grade": "fast"
}
},
{
"precision": "q4",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"exactCallMatch": 1
},
"runtime": {
"precision": "q4",
"device": "cpu",
"version": "1.23.2",
"artifactRevision": "e1b1388cdf210f523d9bb22b6a0e3ba6b546ea0f",
"provider": "CPUExecutionProvider",
"fallback": false,
"loadMs": 112.12266597431153,
"inferenceMs": 133.90612497460097,
"totalMs": 246.0287909489125,
"realTimeFactor": 0.038117314254085106,
"grade": "fast"
}
},
{
"precision": "q4",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"exactCallMatch": 1
},
"runtime": {
"precision": "q4",
"device": "cpu",
"version": "1.23.2",
"artifactRevision": "e1b1388cdf210f523d9bb22b6a0e3ba6b546ea0f",
"provider": "CPUExecutionProvider",
"fallback": false,
"loadMs": 112.12266597431153,
"inferenceMs": 145.6993329920806,
"totalMs": 257.82199896639213,
"realTimeFactor": 0.03489543189691325,
"grade": "fast"
}
},
{
"precision": "q4",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"exactCallMatch": 1
},
"runtime": {
"precision": "q4",
"device": "cpu",
"version": "1.23.2",
"artifactRevision": "e1b1388cdf210f523d9bb22b6a0e3ba6b546ea0f",
"provider": "CPUExecutionProvider",
"fallback": false,
"loadMs": 112.12266597431153,
"inferenceMs": 149.00600002147257,
"totalMs": 261.1286659957841,
"realTimeFactor": 0.03568738867365558,
"grade": "fast"
}
},
{
"precision": "q4",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"exactCallMatch": 1
},
"runtime": {
"precision": "q4",
"device": "cpu",
"version": "1.23.2",
"artifactRevision": "e1b1388cdf210f523d9bb22b6a0e3ba6b546ea0f",
"provider": "CPUExecutionProvider",
"fallback": false,
"loadMs": 117.07345803733915,
"inferenceMs": 74.41829203162342,
"totalMs": 191.49175006896257,
"realTimeFactor": 0.024946943629784297,
"grade": "fast"
}
},
{
"precision": "q4",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"exactCallMatch": 1
},
"runtime": {
"precision": "q4",
"device": "cpu",
"version": "1.23.2",
"artifactRevision": "e1b1388cdf210f523d9bb22b6a0e3ba6b546ea0f",
"provider": "CPUExecutionProvider",
"fallback": false,
"loadMs": 117.07345803733915,
"inferenceMs": 57.59529198985547,
"totalMs": 174.66875002719462,
"realTimeFactor": 0.019307437236013483,
"grade": "fast"
}
},
{
"precision": "q4",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"exactCallMatch": 1
},
"runtime": {
"precision": "q4",
"device": "cpu",
"version": "1.23.2",
"artifactRevision": "e1b1388cdf210f523d9bb22b6a0e3ba6b546ea0f",
"provider": "CPUExecutionProvider",
"fallback": false,
"loadMs": 117.07345803733915,
"inferenceMs": 57.59395903442055,
"totalMs": 174.6674170717597,
"realTimeFactor": 0.01639452292468561,
"grade": "fast"
}
},
{
"precision": "q4",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"exactCallMatch": 1
},
"runtime": {
"precision": "q4",
"device": "cpu",
"version": "1.23.2",
"artifactRevision": "e1b1388cdf210f523d9bb22b6a0e3ba6b546ea0f",
"provider": "CPUExecutionProvider",
"fallback": false,
"loadMs": 117.07345803733915,
"inferenceMs": 59.02637500548735,
"totalMs": 176.0998330428265,
"realTimeFactor": 0.016802270141043938,
"grade": "fast"
}
},
{
"precision": "q4",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"exactCallMatch": 1
},
"runtime": {
"precision": "q4",
"device": "cpu",
"version": "1.23.2",
"artifactRevision": "e1b1388cdf210f523d9bb22b6a0e3ba6b546ea0f",
"provider": "CPUExecutionProvider",
"fallback": false,
"loadMs": 117.07345803733915,
"inferenceMs": 63.030666031409055,
"totalMs": 180.1041240687482,
"realTimeFactor": 0.015096035573722699,
"grade": "fast"
}
},
{
"precision": "q4",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"exactCallMatch": 1
},
"runtime": {
"precision": "q4",
"device": "cpu",
"version": "1.23.2",
"artifactRevision": "e1b1388cdf210f523d9bb22b6a0e3ba6b546ea0f",
"provider": "CPUExecutionProvider",
"fallback": false,
"loadMs": 117.07345803733915,
"inferenceMs": 61.49933399865404,
"totalMs": 178.5727920359932,
"realTimeFactor": 0.014729276910088535,
"grade": "fast"
}
}
]Release validation still required
- Packaged app, public backup and forced recovery await verification.