Voxtral Mini Realtime 2602 Desktop
Transcribe speech into text with incremental output while processing audio.
Desktop app
Run Voxtral Mini Realtime 2602 Desktop on your computer
Download the desktop app to load this model, provide input and view results locally.
Public desktop downloads are coming soon.Device requirements
If your device falls short
MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.
GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.
PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.
Benchmark evidence
Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.
Voxtral Mini Realtime 2602 Desktop
6 configurations testedQuality criteria
No explicit quality gate recorded. Review per-case evidence; full certification is pending.
| Precision | Device | Result | Platform | Inference / load | Task metric | |
|---|---|---|---|---|---|---|
Q4 | metalAccelerated | Passed | Fast | macos · aarch64 | 1431 ms / 337 ms | 0.246 RTF |
Q4 | metalAccelerated | Passed | Fast | macos · aarch64 | 1213 ms / 337 ms | 0.269 RTF |
Q4 | metalAccelerated | Passed | Fast | macos · aarch64 | 3123 ms / 337 ms | 0.284 RTF |
Q4 | cpu | Passed | Fast | macos · aarch64 | 10191 ms / 299 ms | 0.926 RTF |
Q4 | cpu | Passed | Moderate | macos · aarch64 | 6238 ms / 299 ms | 1.075 RTF |
Q4 | cpu | Passed | Moderate | macos · aarch64 | 5295 ms / 299 ms | 1.175 RTF |
Test setup & sample details
- Quality gate
- No explicit quality gate recorded. Review the per-case quality evidence; full certification is pending.
- Tested
- 2026-11-14T20:44:15.678869+00:00
- Environment
- { "os": "macos", "osVersion": "27.2", "arch": "aarch64", "hardware": "Apple M3 Max" }
- Runtime
- transcribe.cpp 0.4.2
- Artifact revision
- 7fd3d424fc558edca2c53808578b0541ef52a81a
- Fixture
{ "file": "model-samples/desktop/voxtral-realtime/jfk.wav", "size": 352078, "sha256": "4d968ac99a1d0d4bc42ae8dd1552f4235e7b952a8121b39797f3dc2ca16123e9", "sha1": "069db705beb788608e93b99f1a4300451ebfb972", "url": "https://assets.localai.tools/samples/v1/files/4d968ac99a1d0d4bc42ae8dd1552f4235e7b952a8121b39797f3dc2ca16123e9/jfk.wav" }- Rerun when
- Artifact revision; Runtime version; Fixture checksum; Quality threshold
Per-case quality & failure details
[
{
"precision": "q4",
"device": "metal",
"status": "pass",
"quality": {
"passed": true,
"wordErrorRate": 0,
"reference": "And so my fellow Americans ask not what your country can do for you ask what you can do for your country."
},
"runtime": {
"inferenceMs": 3122.85870796768,
"firstTokenMs": 1345.7481670193374,
"audioSeconds": 11,
"realTimeFactor": 0.28389624617888,
"device": "metal",
"precision": "q4",
"version": "0.4.2",
"loadMs": 337.1142499963753,
"totalMs": 3459.9729579640552,
"grade": "fast",
"artifactRevision": "7fd3d424fc558edca2c53808578b0541ef52a81a"
}
},
{
"precision": "q4",
"device": "metal",
"status": "pass",
"quality": {
"passed": true,
"wordErrorRate": 0,
"reference": "The morning train arrives at nine. Please bring your ticket."
},
"runtime": {
"inferenceMs": 1213.1156669929624,
"firstTokenMs": 501.85270799556747,
"audioSeconds": 4.5046875,
"realTimeFactor": 0.2693007377299674,
"device": "metal",
"precision": "q4",
"version": "0.4.2",
"loadMs": 337.1142499963753,
"totalMs": 1550.2299169893377,
"grade": "fast",
"artifactRevision": "7fd3d424fc558edca2c53808578b0541ef52a81a"
}
},
{
"precision": "q4",
"device": "metal",
"status": "pass",
"quality": {
"passed": true,
"wordErrorRate": 0.18181818181818182,
"reference": "El tren llega a las nueve. Por favor, trae tu billete."
},
"runtime": {
"inferenceMs": 1430.7763330289163,
"firstTokenMs": 692.114333040081,
"audioSeconds": 5.805,
"realTimeFactor": 0.24647309785166516,
"device": "metal",
"precision": "q4",
"version": "0.4.2",
"loadMs": 337.1142499963753,
"totalMs": 1767.8905830252916,
"grade": "fast",
"artifactRevision": "7fd3d424fc558edca2c53808578b0541ef52a81a"
}
},
{
"precision": "q4",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"wordErrorRate": 0,
"reference": "And so my fellow Americans ask not what your country can do for you ask what you can do for your country."
},
"runtime": {
"inferenceMs": 10191.472999984398,
"firstTokenMs": 3180.08458300028,
"audioSeconds": 11,
"realTimeFactor": 0.9264975454531271,
"device": "cpu",
"precision": "q4",
"version": "0.4.2",
"loadMs": 298.8963749958202,
"totalMs": 10490.369374980219,
"grade": "fast",
"artifactRevision": "7fd3d424fc558edca2c53808578b0541ef52a81a"
}
},
{
"precision": "q4",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"wordErrorRate": 0,
"reference": "The morning train arrives at nine. Please bring your ticket."
},
"runtime": {
"inferenceMs": 5294.609333039261,
"firstTokenMs": 2573.031250038184,
"audioSeconds": 4.5046875,
"realTimeFactor": 1.1753555231165895,
"device": "cpu",
"precision": "q4",
"version": "0.4.2",
"loadMs": 298.8963749958202,
"totalMs": 5593.505708035082,
"grade": "moderate",
"artifactRevision": "7fd3d424fc558edca2c53808578b0541ef52a81a"
}
},
{
"precision": "q4",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"wordErrorRate": 0.18181818181818182,
"reference": "El tren llega a las nueve. Por favor, trae tu billete."
},
"runtime": {
"inferenceMs": 6237.999667006079,
"firstTokenMs": 3237.7433329820633,
"audioSeconds": 5.805,
"realTimeFactor": 1.0745908125764132,
"device": "cpu",
"precision": "q4",
"version": "0.4.2",
"loadMs": 298.8963749958202,
"totalMs": 6536.896042001899,
"grade": "moderate",
"artifactRevision": "7fd3d424fc558edca2c53808578b0541ef52a81a"
}
}
]Release validation still required
- Packaged UI, public backup and separate forced model/runtime source recovery.