TranslatePsy Nano Desktop
Local English to French translation using the original FP32 EuroNano Base checkpoint.
Desktop app
Run TranslatePsy Nano Desktop on your computer
Download the desktop app to load this model, provide input and view results locally.
Public desktop downloads are coming soon.Device requirements
If your device falls short
MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.
GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.
PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.
Benchmark evidence
Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.
TranslatePsy EuroNano Base · English to French Desktop
24 configurations testedQuality criteria
No explicit quality gate recorded. Review per-case evidence; full certification is pending.
| Precision | Device | Result | Platform | Inference / load | |
|---|---|---|---|---|---|
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 207 ms / 391 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 48 ms / 391 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 65 ms / 391 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 80 ms / 391 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 89 ms / 391 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 81 ms / 391 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 47 ms / 391 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 72 ms / 391 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 45 ms / 391 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 45 ms / 391 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 97 ms / 391 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 62 ms / 391 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 37 ms / 321 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 15 ms / 321 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 24 ms / 321 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 35 ms / 321 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 35 ms / 321 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 37 ms / 321 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 32 ms / 321 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 35 ms / 321 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 32 ms / 321 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 29 ms / 321 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 43 ms / 321 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 45 ms / 321 ms |
Test setup & sample details
- Quality gate
- No explicit quality gate recorded. Review the per-case quality evidence; full certification is pending.
- Tested
- 2026-11-15T16:23:54.115Z
- Environment
- { "scope": "Opt-in DesktopAI TypeScript client through the native model host and pinned developer runtime", "hardware": "Apple M3 Max", "os": "macOS 27.2", "runtime": { "name": "PyTorch", "version": "2.10.0" }, "speedGradePolicy": "Interactive at 500 ms or less." }
- Runtime
- PyTorch 2.10.0
- Artifact revision
- 3a5e1e4e2f7001ff5cfd79785bef03cf19281b73
- Fixture
{ "file": "research/translatepsy-nano/desktop-samples/base/euronano-base-fixtures.json", "size": 3063, "sha256": "5daae57714763ab18c8348eef37fa912acf110a656036f5d423dbd5b80a30288", "sha1": "8fa62b0270cbdd49e333596ecd72f28761474682", "url": "https://assets.localai.tools/samples/v1/files/5daae57714763ab18c8348eef37fa912acf110a656036f5d423dbd5b80a30288/euronano-base-fixtures.json" }- Rerun when
- artifactRevision; runtimeVersion; fixtureChecksum; qualityGate; nativeBackend
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 36.70850000344217,
"loadMs": 321.0698750335723,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 357.7783750370145,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 708.2828227130493,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 15.206041978672147,
"loadMs": 321.0698750335723,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 336.27591701224446,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1578.3199884402645,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 23.909333045594394,
"loadMs": 321.0698750335723,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 344.9792080791667,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1631.162187821306,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 76.86301920798947,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 34.913667012006044,
"loadMs": 321.0698750335723,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 355.98354204557836,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1403.4618587371522,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 34.90141604561359,
"loadMs": 321.0698750335723,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 355.9712910791859,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1461.2587619180479,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 58.87298802907711,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 37.124541006051004,
"loadMs": 321.0698750335723,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 358.1944160396233,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1643.1179577427633,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 31.737374956719577,
"loadMs": 321.0698750335723,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 352.8072499902919,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 2111.075666823997,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 34.777917026076466,
"loadMs": 321.0698750335723,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 355.8477920596488,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1523.9555595080817,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 76.994030392143,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 32.021833991166204,
"loadMs": 321.0698750335723,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 353.0917090247385,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1342.8337681052972,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 28.5301249823533,
"loadMs": 321.0698750335723,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 349.6000000159256,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1296.874795427134,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 77.32329393647703,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 42.536166962236166,
"loadMs": 321.0698750335723,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 363.6060419958085,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1151.9608723442914,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 85.74431238266759,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 44.9372089933604,
"loadMs": 321.0698750335723,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 366.0070840269327,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1513.2225948889525,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 206.9260830176063,
"loadMs": 390.8533750218339,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 597.7794580394402,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 125.64873224700142,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 48.00054198130965,
"loadMs": 390.8533750218339,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 438.8539170031436,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 499.99435442510355,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 64.69299999298528,
"loadMs": 390.8533750218339,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 455.5463750148192,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 602.847294208474,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 76.86301920798947,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 80.10845800163224,
"loadMs": 390.8533750218339,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 470.96183302346617,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 611.6707426699139,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 88.78658298635855,
"loadMs": 390.8533750218339,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 479.6399580081925,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 574.4111135331765,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 58.87298802907711,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 80.76441602315754,
"loadMs": 390.8533750218339,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 471.61779104499146,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 755.2831185272175,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 46.646583010442555,
"loadMs": 390.8533750218339,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 437.4999580322765,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1436.3324315738416,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 72.11354095488787,
"loadMs": 390.8533750218339,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 462.9669159767218,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 734.9521226971126,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 76.994030392143,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 44.82470796210691,
"loadMs": 390.8533750218339,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 435.67808298394084,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 959.2923625146772,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 44.884542003273964,
"loadMs": 390.8533750218339,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 435.7379170251079,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 824.3372517269119,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 77.32329393647703,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 97.20466600265354,
"loadMs": 390.8533750218339,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 488.05804102448747,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 504.0910278799001,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 85.74431238266759,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 61.6770830238238,
"loadMs": 390.8533750218339,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 452.5304580456577,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1102.516472345715,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
}
]TranslatePsy EuroNano Tiny · French to English Desktop
24 configurations testedQuality criteria
No explicit quality gate recorded. Review per-case evidence; full certification is pending.
| Precision | Device | Result | Platform | Inference / load | |
|---|---|---|---|---|---|
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 116 ms / 240 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 63 ms / 240 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 72 ms / 240 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 61 ms / 240 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 63 ms / 240 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 68 ms / 240 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 64 ms / 240 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 57 ms / 240 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 77 ms / 240 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 52 ms / 240 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 96 ms / 240 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 72 ms / 240 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 11 ms / 152 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 9 ms / 152 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 12 ms / 152 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 17 ms / 152 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 14 ms / 152 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 14 ms / 152 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 19 ms / 152 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 15 ms / 152 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 18 ms / 152 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 9 ms / 152 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 17 ms / 152 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 19 ms / 152 ms |
Test setup & sample details
- Quality gate
- No explicit quality gate recorded. Review the per-case quality evidence; full certification is pending.
- Tested
- 2026-11-15T16:23:54.115Z
- Environment
- { "scope": "Opt-in DesktopAI TypeScript client through the native model host and pinned developer runtime", "hardware": "Apple M3 Max", "os": "macOS 27.2", "runtime": { "name": "PyTorch", "version": "2.10.0" }, "speedGradePolicy": "Interactive at 500 ms or less." }
- Runtime
- PyTorch 2.10.0
- Artifact revision
- 3a5e1e4e2f7001ff5cfd79785bef03cf19281b73
- Fixture
{ "file": "research/translatepsy-nano/desktop-samples/tiny-reverse/euronano-tiny-reverse-fixtures.json", "size": 3066, "sha256": "9c0059398f7ad89783459b996b43a6f34db116dde9bca83aab54d7012fde520f", "sha1": "dc6daac8ed9c37e036e3c124214c6596e2b16292", "url": "https://assets.localai.tools/samples/v1/files/9c0059398f7ad89783459b996b43a6f34db116dde9bca83aab54d7012fde520f/euronano-tiny-reverse-fixtures.json" }- Rerun when
- artifactRevision; runtimeVersion; fixtureChecksum; qualityGate; nativeBackend
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 52.963011414524175,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 10.894500010181218,
"loadMs": 151.64879203075543,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 162.54329204093665,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 2661.8936135571785,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 8.73383297584951,
"loadMs": 151.64879203075543,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 160.38262500660494,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 2518.939858460041,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 86.30828191848533,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 12.22829200560227,
"loadMs": 151.64879203075543,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 163.8770840363577,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 3679.9906298756764,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 81.18490052459887,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 17.096250026952475,
"loadMs": 151.64879203075543,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 168.7450420577079,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 2749.1408891367314,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 13.645708037074655,
"loadMs": 151.64879203075543,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 165.29450006783009,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 3884.005128645714,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 84.44227139890678,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 14.469082991126925,
"loadMs": 151.64879203075543,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 166.11787502188236,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 5045.240257780455,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 82.9965744435484,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 18.716000020503998,
"loadMs": 151.64879203075543,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 170.36479205125943,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 4488.138486213679,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 15.23191697197035,
"loadMs": 151.64879203075543,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 166.88070900272578,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 4136.051956948826,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 63.963385685626704,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 18.040624971035868,
"loadMs": 151.64879203075543,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 169.6894170017913,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 2549.800800906441,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 9.077415976207703,
"loadMs": 151.64879203075543,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 160.72620800696313,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 4406.540375018807,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 92.20589105425509,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 16.956457984633744,
"loadMs": 151.64879203075543,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 168.60525001538917,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 3479.500261992622,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 93.55689270152116,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 19.090540998149663,
"loadMs": 151.64879203075543,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 170.7393330289051,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 4190.5569888121,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 52.963011414524175,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 115.86525000166148,
"loadMs": 239.95745804859325,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 355.82270805025473,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 250.2907472221753,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 62.81579099595547,
"loadMs": 239.95745804859325,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 302.7732490445487,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 350.2304062590968,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 86.30828191848533,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 71.51824998436496,
"loadMs": 239.95745804859325,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 311.4757080329582,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 629.2100269488939,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 81.18490052459887,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 60.5367089738138,
"loadMs": 239.95745804859325,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 300.49416702240705,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 776.3884227722168,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 62.825959001202136,
"loadMs": 239.95745804859325,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 302.7834170497954,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 843.6003340432237,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 84.44227139890678,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 67.64741701772436,
"loadMs": 239.95745804859325,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 307.6048750663176,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1079.1247207690606,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 82.9965744435484,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 64.2039580270648,
"loadMs": 239.95745804859325,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 304.16141607565805,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1308.3305543965107,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 56.72720802249387,
"loadMs": 239.95745804859325,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 296.6846660710871,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1110.5781898347402,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 63.963385685626704,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 76.58279099268839,
"loadMs": 239.95745804859325,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 316.54024904128164,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 600.6571372463009,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 52.23633302375674,
"loadMs": 239.95745804859325,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 292.19379107235,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 765.7505357776217,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 92.20589105425509,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 95.55833303602412,
"loadMs": 239.95745804859325,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 335.5157910846174,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 617.4239140165604,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 93.55689270152116,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 72.28137500351295,
"loadMs": 239.95745804859325,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 312.2388330521062,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1106.7858074934506,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
}
]TranslatePsy EuroNano BaseMemory · French to English Desktop
24 configurations testedQuality criteria
No explicit quality gate recorded. Review per-case evidence; full certification is pending.
| Precision | Device | Result | Platform | Inference / load | |
|---|---|---|---|---|---|
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 269 ms / 323 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 63 ms / 323 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 132 ms / 323 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 151 ms / 323 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 158 ms / 323 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 117 ms / 323 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 86 ms / 323 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 55 ms / 323 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 76 ms / 323 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 126 ms / 323 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 54 ms / 323 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 60 ms / 323 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 18 ms / 272 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 23 ms / 272 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 26 ms / 272 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 37 ms / 272 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 34 ms / 272 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 41 ms / 272 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 43 ms / 272 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 34 ms / 272 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 40 ms / 272 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 25 ms / 272 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 39 ms / 272 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 44 ms / 272 ms |
Test setup & sample details
- Quality gate
- No explicit quality gate recorded. Review the per-case quality evidence; full certification is pending.
- Tested
- 2026-11-15T17:41:33.649Z
- Environment
- { "scope": "Opt-in DesktopAI TypeScript client through native model host and app-managed Python runtime", "hardware": "Apple M3 Max", "os": "macOS 27.2", "runtime": { "name": "PyTorch", "version": "2.10.0" }, "speedGradePolicy": "Interactive at 500 ms or less." }
- Runtime
- PyTorch 2.10.0
- Artifact revision
- 3a5e1e4e2f7001ff5cfd79785bef03cf19281b73
- Fixture
{ "file": "research/translatepsy-nano/desktop-samples/memory-reverse/euronano-memory-reverse-fixtures.json", "size": 3056, "sha256": "c08cffdb2ea22890abe6343c0ee4ebe71e6557f51f4aefcd027a2258883cdb6b", "sha1": "233f54ecb8712a31af681d4d17cdb619009d02e7", "url": "https://assets.localai.tools/samples/v1/files/c08cffdb2ea22890abe6343c0ee4ebe71e6557f51f4aefcd027a2258883cdb6b/euronano-memory-reverse-fixtures.json" }- Rerun when
- artifactRevision; runtimeVersion; fixtureChecksum; qualityGate; nativeBackend
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 38.653012942074476,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 18.278083007317036,
"loadMs": 271.7752080061473,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 290.05329101346433,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1586.5996444151606,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 23.09166599297896,
"loadMs": 271.7752080061473,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 294.86687399912626,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 952.7246759367262,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 25.63866600394249,
"loadMs": 271.7752080061473,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 297.4138740100898,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1755.1615202241917,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 81.18490052459887,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 37.36895800102502,
"loadMs": 271.7752080061473,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 309.1441660071723,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1257.728406521552,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 34.4031669665128,
"loadMs": 271.7752080061473,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 306.1783749726601,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1540.5558462565061,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 89.62499989168151,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 41.26150003867224,
"loadMs": 271.7752080061473,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 313.03670804481953,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1769.2037354817671,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 43.365165998693556,
"loadMs": 271.7752080061473,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 315.14037400484085,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1937.0385899717444,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 34.19025003677234,
"loadMs": 271.7752080061473,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 305.96545804291964,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1842.6305725241016,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 84.13301971396966,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 39.55666703404859,
"loadMs": 271.7752080061473,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 311.3318750401959,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1162.8886721018555,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 80.57421947480698,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 24.786208989098668,
"loadMs": 271.7752080061473,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 296.56141699524596,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1613.8006428329793,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 92.20589105425509,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 38.97125000366941,
"loadMs": 271.7752080061473,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 310.7464580098167,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1513.936555651788,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 86.12252167779229,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 43.694583990145475,
"loadMs": 271.7752080061473,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 315.46979199629277,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1830.890529088057,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 38.653012942074476,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 269.0514589776285,
"loadMs": 322.5136250257492,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 591.5650840033777,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 107.78607226363837,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 62.74974998086691,
"loadMs": 322.5136250257492,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 385.2633750066161,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 350.5990064774448,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 132.10166594944894,
"loadMs": 322.5136250257492,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 454.61529097519815,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 340.64672596347157,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 81.18490052459887,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 151.04191697901115,
"loadMs": 322.5136250257492,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 473.55554200476035,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 311.17189810647824,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 158.43179199146107,
"loadMs": 322.5136250257492,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 480.9454170172103,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 334.52881731500275,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 89.62499989168151,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 117.21333401510492,
"loadMs": 322.5136250257492,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 439.7269590408541,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 622.796037783489,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 85.92533302726224,
"loadMs": 322.5136250257492,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 408.43895805301145,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 977.5929523991327,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 55.376917007379234,
"loadMs": 322.5136250257492,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 377.89054203312844,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1137.658132748794,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 84.13301971396966,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 75.60979196568951,
"loadMs": 322.5136250257492,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 398.1234169914387,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 608.3868081646627,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 80.57421947480698,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 125.69462496321648,
"loadMs": 322.5136250257492,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 448.2082499889657,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 318.2315871637763,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 92.20589105425509,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 54.17466699145734,
"loadMs": 322.5136250257492,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 376.68829201720655,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1089.069915451507,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 86.12252167779229,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 60.42900000466034,
"loadMs": 322.5136250257492,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 382.94262503040954,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1323.8676793233435,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
}
]TranslatePsy EuroNano Base · French to English Desktop
24 configurations testedQuality criteria
No explicit quality gate recorded. Review per-case evidence; full certification is pending.
| Precision | Device | Result | Platform | Inference / load | |
|---|---|---|---|---|---|
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 152 ms / 357 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 49 ms / 357 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 42 ms / 357 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 49 ms / 357 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 46 ms / 357 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 51 ms / 357 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 58 ms / 357 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 46 ms / 357 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 48 ms / 357 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 44 ms / 357 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 46 ms / 357 ms |
FP32 | mpsAccelerated | Passed | Not measured | Not recorded | 41 ms / 357 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 17 ms / 300 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 15 ms / 300 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 18 ms / 300 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 25 ms / 300 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 22 ms / 300 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 25 ms / 300 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 27 ms / 300 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 20 ms / 300 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 23 ms / 300 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 16 ms / 300 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 30 ms / 300 ms |
FP32 | cpu | Passed | Not measured | Not recorded | 29 ms / 300 ms |
Test setup & sample details
- Quality gate
- No explicit quality gate recorded. Review the per-case quality evidence; full certification is pending.
- Tested
- 2026-11-15T17:07:55.959Z
- Environment
- { "scope": "Opt-in DesktopAI TypeScript client through native model host and app-managed Python runtime", "hardware": "Apple M3 Max", "os": "macOS 27.2", "runtime": { "name": "PyTorch", "version": "2.10.0" }, "speedGradePolicy": "Interactive at 500 ms or less." }
- Runtime
- PyTorch 2.10.0
- Artifact revision
- 3a5e1e4e2f7001ff5cfd79785bef03cf19281b73
- Fixture
{ "file": "research/translatepsy-nano/desktop-samples/base-reverse/euronano-base-reverse-fixtures.json", "size": 3070, "sha256": "e6dc14109e2bddff374caa7d100eb952eed58b46448bd9ec99490bc5d977288d", "sha1": "787afaf6af6e861c7f0364eb29cfe2af0d32adb0", "url": "https://assets.localai.tools/samples/v1/files/e6dc14109e2bddff374caa7d100eb952eed58b46448bd9ec99490bc5d977288d/euronano-base-reverse-fixtures.json" }- Rerun when
- artifactRevision; runtimeVersion; fixtureChecksum; qualityGate; nativeBackend
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 52.963011414524175,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 17.03691598959267,
"loadMs": 300.16712500946596,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 317.20404099905863,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1702.1860070047426,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 14.720667037181556,
"loadMs": 300.16712500946596,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 314.8877920466475,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1494.4974941986159,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 17.592749965842813,
"loadMs": 300.16712500946596,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 317.7598749753088,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 2557.8718555865175,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 25.211916014086455,
"loadMs": 300.16712500946596,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 325.3790410235524,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1864.1978647612525,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 22.278041986282915,
"loadMs": 300.16712500946596,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 322.4451669957489,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 2379.024154485088,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 81.34774481338243,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 25.107833032961935,
"loadMs": 300.16712500946596,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 325.2749580424279,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 2907.4591942747315,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 27.032666956074536,
"loadMs": 300.16712500946596,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 327.1997919655405,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 3107.3515660327507,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 20.24450001772493,
"loadMs": 300.16712500946596,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 320.4116250271909,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 3111.9563310944104,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 70.73036450219966,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 23.12479098327458,
"loadMs": 300.16712500946596,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 323.29191599274054,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1989.2071687597231,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 80.57421947480698,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 15.725834004115313,
"loadMs": 300.16712500946596,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 315.8929590135813,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 2543.5852870844465,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 62.93680404395386,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 29.579333029687405,
"loadMs": 300.16712500946596,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 329.74645803915337,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1994.635914906683,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"chrFpp": 86.12252167779229,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "cpu",
"cpuThreads": 4,
"decoderDevice": "cpu",
"device": "cpu",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 29.20758305117488,
"loadMs": 300.16712500946596,
"parameterDevice": "cpu",
"precision": "fp32",
"provider": "PyTorch CPU",
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 329.37470806064084,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 2739.014722985851,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 52.963011414524175,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 152.2602919721976,
"loadMs": 357.1409579599276,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 509.4012499321252,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 190.46331531595473,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 48.56233298778534,
"loadMs": 357.1409579599276,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 405.70329094771296,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 453.0260110347985,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 42.07804100587964,
"loadMs": 357.1409579599276,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 399.21899896580726,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1069.4414218026943,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 48.80612500710413,
"loadMs": 357.1409579599276,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 405.94708296703175,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 962.9938863853413,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 45.50970799755305,
"loadMs": 357.1409579599276,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 402.65066595748067,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1164.5866856111159,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 81.34774481338243,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 50.53283303277567,
"loadMs": 357.1409579599276,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 407.6737909927033,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1444.605331204211,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 58.3715409738943,
"loadMs": 357.1409579599276,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 415.5124989338219,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1439.0574344708084,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 100,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 46.01666604867205,
"loadMs": 357.1409579599276,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 403.15762400859967,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1369.0691962204432,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 70.73036450219966,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 48.152417002711445,
"loadMs": 357.1409579599276,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 405.29337496263906,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 955.2999177052682,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 80.57421947480698,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 43.84754097554833,
"loadMs": 357.1409579599276,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 400.98849893547595,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 912.2518414956515,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 62.93680404395386,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 45.90983397793025,
"loadMs": 357.1409579599276,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 403.05079193785787,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1285.1277142139622,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"chrFpp": 86.12252167779229,
"passed": true,
"exactOutputParity": true,
"streamParity": true
},
"runtime": {
"acceleration": "partial",
"cpuThreads": 4,
"decoderDevice": "mps",
"device": "mps",
"engine": "PyTorch",
"fallback": false,
"fallbackReason": null,
"inferenceMs": 40.95958301331848,
"loadMs": 357.1409579599276,
"parameterDevice": "mps",
"precision": "fp32",
"provider": "PyTorch MPS",
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"selectionReason": "Pinned FP32 Marian SSRU checkpoint",
"version": "2.10.0",
"totalMs": 398.1005409732461,
"artifactRevision": "3a5e1e4e2f7001ff5cfd79785bef03cf19281b73",
"performanceScore": 1953.144883676845,
"performanceMetric": "source characters per second",
"grade": "interactive"
}
}
]