A model is still running

A model is still running or downloading. Leaving will stop the current operation. Stay on this page to let it finish.

Skip to content
LocalAI.toolsBeta

Join the waitlist

Get an email when the new apps and model runs launch.

No account needed.

NeuDecide Desktop

Turn English speech into proposed calls to supplied tools.

Desktop inferencePrivate · Runs on your computer
About this model

Turn English speech into proposed calls to supplied tools.

Created by
Neuphonic
License
Apache-2.0
Model released
Unknown
Source repository created
Oct 6, 2026
Model weights · Q4
42.6 MB

Best for

  • Suggest structured actions for a human to review

Keep in mind

  • Speech must be mono 16 kHz PCM, up to 30 seconds.
  • Ambiguous speech can produce incorrect calls. Confirm proposed actions before executing them.

Processed on your deviceYour input is processed locally in the desktop app. Model and runtime files download from external hosts.

Target platforms · verification required

  • macos · aarch64, x86_64
  • windows · x86_64

Recommended configuration

Q4 · cpu (verified platform only)

Sources & technical details
Original model
https://huggingface.co/neuphonic/neudecide
Release verification
Unknown
Release evidence
The exact public checkpoint release day was not established.
Source updated
Oct 9, 2026
Native model files
https://huggingface.co/spaces/neuphonic/neudecide
Files updated
Oct 9, 2026
Artifact revision
e1b1388cdf210f523d9bb22b6a0e3ba6b546ea0f

Desktop app

Sample result

NeuDecide Desktop

Run NeuDecide Desktop on your computer

Download the desktop app to load this model, provide input and view results locally.

Public desktop downloads are coming soon.

Device requirements

macOS Apple SiliconCPU / Q4TestedNot establishedRAM estimate
If your device falls short

MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.

GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.

PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.

Benchmark evidence

Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.

NeuDecide Desktop

12 configurations tested
Passed12
Failed0
TestedNov 14, 2026
Runtimeonnxruntime 1.23.2

Quality criteria

No explicit quality gate recorded. Review per-case evidence; full certification is pending.

PrecisionDeviceResultPlatformInference / loadTask metric
Q4cpuPassedVery fastmacos · aarch6461 ms / 117 ms0.015 RTF
Q4cpuPassedVery fastmacos · aarch6463 ms / 117 ms0.015 RTF
Q4cpuPassedVery fastmacos · aarch6458 ms / 117 ms0.016 RTF
Q4cpuPassedVery fastmacos · aarch6459 ms / 117 ms0.017 RTF
Q4cpuPassedVery fastmacos · aarch6458 ms / 117 ms0.019 RTF
Q4cpuPassedVery fastmacos · aarch6474 ms / 117 ms0.025 RTF
Q4cpuPassedVery fastmacos · aarch64146 ms / 112 ms0.035 RTF
Q4cpuPassedVery fastmacos · aarch64149 ms / 112 ms0.036 RTF
Q4cpuPassedVery fastmacos · aarch64134 ms / 112 ms0.038 RTF
Q4cpuPassedVery fastmacos · aarch64136 ms / 112 ms0.039 RTF
Q4cpuPassedVery fastmacos · aarch64136 ms / 112 ms0.046 RTF
Q4cpuPassedVery fastmacos · aarch64155 ms / 112 ms0.052 RTF
Test setup & sample details
Quality gate
No explicit quality gate recorded. Review the per-case quality evidence; full certification is pending.
Tested
2026-11-14T19:52:59.123621+00:00
Environment
{ "os": "macos", "osVersion": "27.2", "arch": "aarch64", "hardware": "Apple M3 Max" }
Runtime
onnxruntime 1.23.2
Artifact revision
e1b1388cdf210f523d9bb22b6a0e3ba6b546ea0f
Fixture
{
  "file": "model-samples/desktop/neudecide/binfullness.wav",
  "size": 263152,
  "sha1": "9204836aa127063701fd862a4f70773811b051df",
  "sha256": "45440609257d430cff2d08ee77dd49f551e160ce94031bf10cefa67a6a5ee156",
  "url": "https://assets.localai.tools/samples/v1/files/45440609257d430cff2d08ee77dd49f551e160ce94031bf10cefa67a6a5ee156/binfullness.wav"
}
Rerun when
artifact revision; runtime version; fixture or quality gate
Per-case quality & failure details
[
  {
    "precision": "q4",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "exactCallMatch": 1
    },
    "runtime": {
      "precision": "q4",
      "device": "cpu",
      "version": "1.23.2",
      "artifactRevision": "e1b1388cdf210f523d9bb22b6a0e3ba6b546ea0f",
      "provider": "CPUExecutionProvider",
      "fallback": false,
      "loadMs": 112.12266597431153,
      "inferenceMs": 155.36137495655566,
      "totalMs": 267.4840409308672,
      "realTimeFactor": 0.05208116657178844,
      "grade": "fast"
    }
  },
  {
    "precision": "q4",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "exactCallMatch": 1
    },
    "runtime": {
      "precision": "q4",
      "device": "cpu",
      "version": "1.23.2",
      "artifactRevision": "e1b1388cdf210f523d9bb22b6a0e3ba6b546ea0f",
      "provider": "CPUExecutionProvider",
      "fallback": false,
      "loadMs": 112.12266597431153,
      "inferenceMs": 136.05791598092765,
      "totalMs": 248.18058195523918,
      "realTimeFactor": 0.0456101459426102,
      "grade": "fast"
    }
  },
  {
    "precision": "q4",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "exactCallMatch": 1
    },
    "runtime": {
      "precision": "q4",
      "device": "cpu",
      "version": "1.23.2",
      "artifactRevision": "e1b1388cdf210f523d9bb22b6a0e3ba6b546ea0f",
      "provider": "CPUExecutionProvider",
      "fallback": false,
      "loadMs": 112.12266597431153,
      "inferenceMs": 136.3797500380315,
      "totalMs": 248.50241601234302,
      "realTimeFactor": 0.03882144891489652,
      "grade": "fast"
    }
  },
  {
    "precision": "q4",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "exactCallMatch": 1
    },
    "runtime": {
      "precision": "q4",
      "device": "cpu",
      "version": "1.23.2",
      "artifactRevision": "e1b1388cdf210f523d9bb22b6a0e3ba6b546ea0f",
      "provider": "CPUExecutionProvider",
      "fallback": false,
      "loadMs": 112.12266597431153,
      "inferenceMs": 133.90612497460097,
      "totalMs": 246.0287909489125,
      "realTimeFactor": 0.038117314254085106,
      "grade": "fast"
    }
  },
  {
    "precision": "q4",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "exactCallMatch": 1
    },
    "runtime": {
      "precision": "q4",
      "device": "cpu",
      "version": "1.23.2",
      "artifactRevision": "e1b1388cdf210f523d9bb22b6a0e3ba6b546ea0f",
      "provider": "CPUExecutionProvider",
      "fallback": false,
      "loadMs": 112.12266597431153,
      "inferenceMs": 145.6993329920806,
      "totalMs": 257.82199896639213,
      "realTimeFactor": 0.03489543189691325,
      "grade": "fast"
    }
  },
  {
    "precision": "q4",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "exactCallMatch": 1
    },
    "runtime": {
      "precision": "q4",
      "device": "cpu",
      "version": "1.23.2",
      "artifactRevision": "e1b1388cdf210f523d9bb22b6a0e3ba6b546ea0f",
      "provider": "CPUExecutionProvider",
      "fallback": false,
      "loadMs": 112.12266597431153,
      "inferenceMs": 149.00600002147257,
      "totalMs": 261.1286659957841,
      "realTimeFactor": 0.03568738867365558,
      "grade": "fast"
    }
  },
  {
    "precision": "q4",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "exactCallMatch": 1
    },
    "runtime": {
      "precision": "q4",
      "device": "cpu",
      "version": "1.23.2",
      "artifactRevision": "e1b1388cdf210f523d9bb22b6a0e3ba6b546ea0f",
      "provider": "CPUExecutionProvider",
      "fallback": false,
      "loadMs": 117.07345803733915,
      "inferenceMs": 74.41829203162342,
      "totalMs": 191.49175006896257,
      "realTimeFactor": 0.024946943629784297,
      "grade": "fast"
    }
  },
  {
    "precision": "q4",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "exactCallMatch": 1
    },
    "runtime": {
      "precision": "q4",
      "device": "cpu",
      "version": "1.23.2",
      "artifactRevision": "e1b1388cdf210f523d9bb22b6a0e3ba6b546ea0f",
      "provider": "CPUExecutionProvider",
      "fallback": false,
      "loadMs": 117.07345803733915,
      "inferenceMs": 57.59529198985547,
      "totalMs": 174.66875002719462,
      "realTimeFactor": 0.019307437236013483,
      "grade": "fast"
    }
  },
  {
    "precision": "q4",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "exactCallMatch": 1
    },
    "runtime": {
      "precision": "q4",
      "device": "cpu",
      "version": "1.23.2",
      "artifactRevision": "e1b1388cdf210f523d9bb22b6a0e3ba6b546ea0f",
      "provider": "CPUExecutionProvider",
      "fallback": false,
      "loadMs": 117.07345803733915,
      "inferenceMs": 57.59395903442055,
      "totalMs": 174.6674170717597,
      "realTimeFactor": 0.01639452292468561,
      "grade": "fast"
    }
  },
  {
    "precision": "q4",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "exactCallMatch": 1
    },
    "runtime": {
      "precision": "q4",
      "device": "cpu",
      "version": "1.23.2",
      "artifactRevision": "e1b1388cdf210f523d9bb22b6a0e3ba6b546ea0f",
      "provider": "CPUExecutionProvider",
      "fallback": false,
      "loadMs": 117.07345803733915,
      "inferenceMs": 59.02637500548735,
      "totalMs": 176.0998330428265,
      "realTimeFactor": 0.016802270141043938,
      "grade": "fast"
    }
  },
  {
    "precision": "q4",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "exactCallMatch": 1
    },
    "runtime": {
      "precision": "q4",
      "device": "cpu",
      "version": "1.23.2",
      "artifactRevision": "e1b1388cdf210f523d9bb22b6a0e3ba6b546ea0f",
      "provider": "CPUExecutionProvider",
      "fallback": false,
      "loadMs": 117.07345803733915,
      "inferenceMs": 63.030666031409055,
      "totalMs": 180.1041240687482,
      "realTimeFactor": 0.015096035573722699,
      "grade": "fast"
    }
  },
  {
    "precision": "q4",
    "device": "cpu",
    "status": "pass",
    "quality": {
      "passed": true,
      "exactCallMatch": 1
    },
    "runtime": {
      "precision": "q4",
      "device": "cpu",
      "version": "1.23.2",
      "artifactRevision": "e1b1388cdf210f523d9bb22b6a0e3ba6b546ea0f",
      "provider": "CPUExecutionProvider",
      "fallback": false,
      "loadMs": 117.07345803733915,
      "inferenceMs": 61.49933399865404,
      "totalMs": 178.5727920359932,
      "realTimeFactor": 0.014729276910088535,
      "grade": "fast"
    }
  }
]
Release validation still required
  • Packaged app, public backup and forced recovery await verification.

Something not quite right?

Tell us what happened with NeuDecide Desktop. Loading, results, or the page itself—we’re here for all of it.

Attachments Optional

Up to 3 files · 50 MB each

Browser, OS, CPU/GPU, memory, screen, storage, and network details are included automatically. Model inputs, results, and browsing history are not collected.