PP-OCR 5 Desktop
Read an already cropped Greek printed text line. Returns complete text,confidence,CTC IDs and normalized line coordinates;it does not detect page layout.
Desktop app
Run PP-OCR 5 Desktop on your computer
Download the desktop app to load this model, provide input and view results locally.
Public desktop downloads are coming soon.Device requirements
If your device falls short
MemoryAdvisory only: close other apps, reduce image/tile/token/batch settings or choose a smaller verified model/precision. CPU can need more RAM than GPU.
GPUIf the selected GPU runtime fails, existing CPU fallback may recover when enabled, but CPU has its own memory/runtime needs.
PlatformUse a compatible OS/architecture/runtime or another model. These estimates do not add hardware detection or block runs.
Benchmark evidence
Saved desktop measurements apply to the recorded hardware and runtime. Fallback cases report the device that actually ran; they do not prove GPU support on the requested device.
PP-OCR 5 Greek Mobile Text Recognizer Desktop
60 configurations testedQuality criteria
No explicit quality gate recorded. Review per-case evidence; full certification is pending.
| Precision | Device | Result | Platform | Inference / load | |
|---|---|---|---|---|---|
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 24 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 24 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 24 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 24 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 28 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 31 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 32 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 33 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 33 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 248 ms / 2238 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 248 ms / 2006 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 257 ms / 2130 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 265 ms / 2208 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 330 ms / 1969 ms |
FP16 | mpsAccelerated | Passed | Not measured | macos · aarch64 | 1590 ms / 2147 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 73 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 73 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 73 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 73 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 74 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 74 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 74 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 75 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 75 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 83 ms / 1938 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 85 ms / 2003 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 140 ms / 3144 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 191 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 191 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 196 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 198 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 200 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 201 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 202 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 204 ms / 1941 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 209 ms / 1821 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 213 ms / 1834 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 214 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 228 ms / 0 ms |
Test setup & sample details
- Quality gate
- No explicit quality gate recorded. Review the per-case quality evidence; full certification is pending.
- Tested
- 2026-11-11T02:00:45.841958+00:00
- Environment
- { "hardware": "Apple M3 Max", "os": "macOS27.2", "python": "3.13.18", "runtime": "Transformers5.22.1/Torch2.10.0/Pillow12.0.0", "interpreterScope": "Sequential independent helper processes;existing privatevenv based on app-ownedCPython3.13.18,Transformers5.22.1/Torch2.10/Pillow12.0.StrictMPSnoCPUfallback;verifiedlocal snapshot notnetwork transfer.Writable percase caches removed onlyunder their isolated roots.No concurrent builds/uploads launched.Windows/otherMacs unverified." }
- Runtime
- transformers 5.22.1
- Artifact revision
- 0d7a6ed5020d57efffb993b7979328481bb04c3b
- Fixture
{ "file": "research/ppocrv5-language-onboarding/fixtures/el-0-normal.png", "url": "https://assets.localai.tools/samples/v1/files/1f385ee7892c72517190b8c6215d9ff65bbc8241d1a7e8d099763653b3eab1ff/el-0-normal.png", "size": 4244, "sha1": "04c69880e05a593fbd3ade656803dfc07ca33df1" }- Rerun when
- artifact revision; runtime version; fixture checksum; quality gate; backend behavior; adapter preprocessing or inference changes
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Καλημέρα κόσμε",
"actual": "Καλημέρα κόσμε"
},
"runtime": {
"durationMs": 139.79062502039596,
"inferenceMs": 139.79062502039596,
"forwardMs": 113.86149999452755,
"charactersPerSecond": 100.14977755452018,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 384663552,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 3143.802707985742,
"totalMs": 3283.593333006138,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Καλημέρα κόσμε",
"actual": "Καλημέρα κόσμε"
},
"runtime": {
"durationMs": 73.57079099165276,
"inferenceMs": 73.57079099165276,
"forwardMs": 72.18954100972041,
"charactersPerSecond": 190.29291123957634,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 384958464,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 73.57079099165276,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Τιμή 12,50 €",
"actual": "Τιμή 12,50 €"
},
"runtime": {
"durationMs": 73.91445798566565,
"inferenceMs": 73.91445798566565,
"forwardMs": 72.61466700583696,
"charactersPerSecond": 162.34983421412872,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 392904704,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 73.91445798566565,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Τιμή 12,50 €",
"actual": "Τιμή 12,50 €"
},
"runtime": {
"durationMs": 73.29637501970865,
"inferenceMs": 73.29637501970865,
"forwardMs": 71.96933301747777,
"charactersPerSecond": 163.71887418406874,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 392904704,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 73.29637501970865,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Ελληνικό κείμενο",
"actual": "Ελληνικό κείμενο"
},
"runtime": {
"durationMs": 73.6653330095578,
"inferenceMs": 73.6653330095578,
"forwardMs": 72.3930410167668,
"charactersPerSecond": 217.19850228497657,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 393150464,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 73.6653330095578,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Αθήνα 2026",
"actual": "Αθήνα 2026"
},
"runtime": {
"durationMs": 72.54804199328646,
"inferenceMs": 72.54804199328646,
"forwardMs": 71.33937499020249,
"charactersPerSecond": 137.83969525911385,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 393543680,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 72.54804199328646,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "ΚΑΛΗΜΕΡΑ",
"actual": "ΚΑΛΗΜΕΡΑ"
},
"runtime": {
"durationMs": 72.63383298413828,
"inferenceMs": 72.63383298413828,
"forwardMs": 71.50549997459166,
"charactersPerSecond": 110.14150942229682,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 393789440,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 72.63383298413828,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Καφές 3,20",
"actual": "Καφές 3,20"
},
"runtime": {
"durationMs": 72.76329200249165,
"inferenceMs": 72.76329200249165,
"forwardMs": 71.5775830030907,
"charactersPerSecond": 137.43193476811862,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 393805824,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 72.76329200249165,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Corner Cafe",
"actual": "Corner Cafe"
},
"runtime": {
"durationMs": 74.90754200262018,
"inferenceMs": 74.90754200262018,
"forwardMs": 72.18962500337511,
"charactersPerSecond": 146.84769658594902,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 396869632,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 74.90754200262018,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Espresso 3.20",
"actual": "Espresso 3.20"
},
"runtime": {
"durationMs": 75.17416699556634,
"inferenceMs": 75.17416699556634,
"forwardMs": 73.0062079965137,
"charactersPerSecond": 172.9317466300188,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 396886016,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 75.17416699556634,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.41779098683036864,
"inferenceMs": 0.41779098683036864,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 396886016,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.41779098683036864,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.3861250006593764,
"inferenceMs": 0.3861250006593764,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 396886016,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.3861250006593764,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.38712500827386975,
"inferenceMs": 0.38712500827386975,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 396886016,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.38712500827386975,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Καλημέρα κόσμε",
"actual": "Καλημέρα κόσμε"
},
"runtime": {
"durationMs": 85.02970798872411,
"inferenceMs": 85.02970798872411,
"forwardMs": 77.16099999379367,
"charactersPerSecond": 164.6483368125474,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 389267456,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 2002.8612909954973,
"totalMs": 2087.8909989842214,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Καλημέρα κόσμε",
"actual": "Καλημέρα κόσμε"
},
"runtime": {
"durationMs": 82.843625015812,
"inferenceMs": 82.843625015812,
"forwardMs": 75.65116698970087,
"charactersPerSecond": 168.99308784867733,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 389627904,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 1938.2948340207804,
"totalMs": 2021.1384590365924,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Καλημέρα κόσμε",
"actual": "Καλημέρα κόσμε"
},
"runtime": {
"durationMs": 208.7422080221586,
"inferenceMs": 208.7422080221586,
"forwardMs": 200.2322920016013,
"charactersPerSecond": 67.06837171385031,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 386023424,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 1821.0322090017144,
"totalMs": 2029.774417023873,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Καλημέρα κόσμε",
"actual": "Καλημέρα κόσμε"
},
"runtime": {
"durationMs": 196.0241669730749,
"inferenceMs": 196.0241669730749,
"forwardMs": 194.53795801382512,
"charactersPerSecond": 71.41976530844273,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 387317760,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 196.0241669730749,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Τιμή 12,50 €",
"actual": "Τιμή 12,50 €"
},
"runtime": {
"durationMs": 198.31329100998119,
"inferenceMs": 198.31329100998119,
"forwardMs": 196.81604200741276,
"charactersPerSecond": 60.51031647392728,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 390332416,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 198.31329100998119,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Τιμή 12,50 €",
"actual": "Τιμή 12,50 €"
},
"runtime": {
"durationMs": 190.69095799932256,
"inferenceMs": 190.69095799932256,
"forwardMs": 189.36041599954478,
"charactersPerSecond": 62.929045644852394,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 390365184,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 190.69095799932256,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Ελληνικό κείμενο",
"actual": "Ελληνικό κείμενο"
},
"runtime": {
"durationMs": 190.64045799314044,
"inferenceMs": 190.64045799314044,
"forwardMs": 189.35595799121074,
"charactersPerSecond": 83.92762044547598,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 390610944,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 190.64045799314044,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Αθήνα 2026",
"actual": "Αθήνα 2026"
},
"runtime": {
"durationMs": 200.12324998970143,
"inferenceMs": 200.12324998970143,
"forwardMs": 198.92883399734274,
"charactersPerSecond": 49.96920647908032,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 390610944,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 200.12324998970143,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "ΚΑΛΗΜΕΡΑ",
"actual": "ΚΑΛΗΜΕΡΑ"
},
"runtime": {
"durationMs": 227.86479198839515,
"inferenceMs": 227.86479198839515,
"forwardMs": 226.59120900789276,
"charactersPerSecond": 35.10853927976477,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 390807552,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 227.86479198839515,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Καφές 3,20",
"actual": "Καφές 3,20"
},
"runtime": {
"durationMs": 213.81587500218302,
"inferenceMs": 213.81587500218302,
"forwardMs": 212.56366700981744,
"charactersPerSecond": 46.76921206106844,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 390971392,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 213.81587500218302,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Corner Cafe",
"actual": "Corner Cafe"
},
"runtime": {
"durationMs": 201.92833401961252,
"inferenceMs": 201.92833401961252,
"forwardMs": 199.40833299187943,
"charactersPerSecond": 54.47477221761069,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 399917056,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 201.92833401961252,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Espresso 3.20",
"actual": "Espresso 3.20"
},
"runtime": {
"durationMs": 201.0645830014255,
"inferenceMs": 201.0645830014255,
"forwardMs": 198.7664169864729,
"charactersPerSecond": 64.655842445946,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 400097280,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 201.0645830014255,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.4237920220475644,
"inferenceMs": 0.4237920220475644,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 400097280,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.4237920220475644,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.3463340108282864,
"inferenceMs": 0.3463340108282864,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 400097280,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.3463340108282864,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.31762500293552876,
"inferenceMs": 0.31762500293552876,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 400097280,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.31762500293552876,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Καλημέρα κόσμε",
"actual": "Καλημέρα κόσμε"
},
"runtime": {
"durationMs": 213.2109579979442,
"inferenceMs": 213.2109579979442,
"forwardMs": 204.74579199799336,
"charactersPerSecond": 65.66266636321285,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 387858432,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 1834.0162920067087,
"totalMs": 2047.227250004653,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Καλημέρα κόσμε",
"actual": "Καλημέρα κόσμε"
},
"runtime": {
"durationMs": 203.92270799493417,
"inferenceMs": 203.92270799493417,
"forwardMs": 196.19179199798964,
"charactersPerSecond": 68.65346256753215,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 386908160,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 1941.187041986268,
"totalMs": 2145.109749981202,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Καλημέρα κόσμε",
"actual": "Καλημέρα κόσμε"
},
"runtime": {
"durationMs": 330.293624982005,
"inferenceMs": 330.293624982005,
"forwardMs": 308.4960830165073,
"charactersPerSecond": 42.386528049891204,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 466255872,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22401280,
"mpsDriverAllocatedBytes": 63160320,
"loadMs": 1969.1552500007674,
"totalMs": 2299.4488749827724,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Καλημέρα κόσμε",
"actual": "Καλημέρα κόσμε"
},
"runtime": {
"durationMs": 26.757791987620294,
"inferenceMs": 26.757791987620294,
"forwardMs": 23.641791980480775,
"charactersPerSecond": 523.2120799233812,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 466944000,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22401280,
"mpsDriverAllocatedBytes": 63160320,
"loadMs": 0,
"totalMs": 26.757791987620294,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Τιμή 12,50 €",
"actual": "Τιμή 12,50 €"
},
"runtime": {
"durationMs": 23.724041995592415,
"inferenceMs": 23.724041995592415,
"forwardMs": 21.099625009810552,
"charactersPerSecond": 505.81599890227085,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 466976768,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22401280,
"mpsDriverAllocatedBytes": 63160320,
"loadMs": 0,
"totalMs": 23.724041995592415,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Τιμή 12,50 €",
"actual": "Τιμή 12,50 €"
},
"runtime": {
"durationMs": 24.281959020299837,
"inferenceMs": 24.281959020299837,
"forwardMs": 21.361708000767976,
"charactersPerSecond": 494.1940635830882,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 467025920,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22401280,
"mpsDriverAllocatedBytes": 63160320,
"loadMs": 0,
"totalMs": 24.281959020299837,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Ελληνικό κείμενο",
"actual": "Ελληνικό κείμενο"
},
"runtime": {
"durationMs": 25.039875006768852,
"inferenceMs": 25.039875006768852,
"forwardMs": 21.472583001013845,
"charactersPerSecond": 638.9808254104636,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 467025920,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22401280,
"mpsDriverAllocatedBytes": 63160320,
"loadMs": 0,
"totalMs": 25.039875006768852,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Αθήνα 2026",
"actual": "Αθήνα 2026"
},
"runtime": {
"durationMs": 24.887624982511625,
"inferenceMs": 24.887624982511625,
"forwardMs": 21.36437501758337,
"charactersPerSecond": 401.8061187850161,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 467042304,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22401280,
"mpsDriverAllocatedBytes": 63160320,
"loadMs": 0,
"totalMs": 24.887624982511625,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "ΚΑΛΗΜΕΡΑ",
"actual": "ΚΑΛΗΜΕΡΑ"
},
"runtime": {
"durationMs": 23.92516698455438,
"inferenceMs": 23.92516698455438,
"forwardMs": 21.510083024622872,
"charactersPerSecond": 334.3759316356974,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 467042304,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22401280,
"mpsDriverAllocatedBytes": 63160320,
"loadMs": 0,
"totalMs": 23.92516698455438,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Καφές 3,20",
"actual": "Καφές 3,20"
},
"runtime": {
"durationMs": 24.015541013795882,
"inferenceMs": 24.015541013795882,
"forwardMs": 20.813583018025383,
"charactersPerSecond": 416.397031999214,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 467058688,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22401280,
"mpsDriverAllocatedBytes": 63160320,
"loadMs": 0,
"totalMs": 24.015541013795882,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Corner Cafe",
"actual": "Corner Cafe"
},
"runtime": {
"durationMs": 25.692040973808616,
"inferenceMs": 25.692040973808616,
"forwardMs": 20.966417010640725,
"charactersPerSecond": 428.1481572917384,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 471269376,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22401280,
"mpsDriverAllocatedBytes": 63160320,
"loadMs": 0,
"totalMs": 25.692040973808616,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Espresso 3.20",
"actual": "Espresso 3.20"
},
"runtime": {
"durationMs": 25.95779101829976,
"inferenceMs": 25.95779101829976,
"forwardMs": 21.415666997199878,
"charactersPerSecond": 500.8130310793874,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 471285760,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22401280,
"mpsDriverAllocatedBytes": 63160320,
"loadMs": 0,
"totalMs": 25.95779101829976,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.34875000710599124,
"inferenceMs": 0.34875000710599124,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 471285760,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22401280,
"mpsDriverAllocatedBytes": 63160320,
"loadMs": 0,
"totalMs": 0.34875000710599124,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.28825001209042966,
"inferenceMs": 0.28825001209042966,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 471285760,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22401280,
"mpsDriverAllocatedBytes": 63160320,
"loadMs": 0,
"totalMs": 0.28825001209042966,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.2946660097222775,
"inferenceMs": 0.2946660097222775,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 471285760,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22401280,
"mpsDriverAllocatedBytes": 63160320,
"loadMs": 0,
"totalMs": 0.2946660097222775,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Καλημέρα κόσμε",
"actual": "Καλημέρα κόσμε"
},
"runtime": {
"durationMs": 248.2083340000827,
"inferenceMs": 248.2083340000827,
"forwardMs": 227.2756249876693,
"charactersPerSecond": 56.404230165757994,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 470548480,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22401280,
"mpsDriverAllocatedBytes": 63160320,
"loadMs": 2005.769292009063,
"totalMs": 2253.9776260091458,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Καλημέρα κόσμε",
"actual": "Καλημέρα κόσμε"
},
"runtime": {
"durationMs": 257.2283750050701,
"inferenceMs": 257.2283750050701,
"forwardMs": 235.42675000499003,
"charactersPerSecond": 54.42634390441588,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 468402176,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22401280,
"mpsDriverAllocatedBytes": 63160320,
"loadMs": 2130.142165988218,
"totalMs": 2387.370540993288,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Καλημέρα κόσμε",
"actual": "Καλημέρα κόσμε"
},
"runtime": {
"durationMs": 1589.892374991905,
"inferenceMs": 1589.892374991905,
"forwardMs": 1564.2670840024948,
"charactersPerSecond": 8.805627487880292,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 485441536,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11258112,
"mpsDriverAllocatedBytes": 46284800,
"loadMs": 2147.304249985609,
"totalMs": 3737.196624977514,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "usable",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Καλημέρα κόσμε",
"actual": "Καλημέρα κόσμε"
},
"runtime": {
"durationMs": 32.890083006350324,
"inferenceMs": 32.890083006350324,
"forwardMs": 28.39904199936427,
"charactersPerSecond": 425.6602209637756,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 486129664,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11258112,
"mpsDriverAllocatedBytes": 46284800,
"loadMs": 0,
"totalMs": 32.890083006350324,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Τιμή 12,50 €",
"actual": "Τιμή 12,50 €"
},
"runtime": {
"durationMs": 31.84162499383092,
"inferenceMs": 31.84162499383092,
"forwardMs": 28.12958398135379,
"charactersPerSecond": 376.8651883289534,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 486129664,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11258112,
"mpsDriverAllocatedBytes": 46284800,
"loadMs": 0,
"totalMs": 31.84162499383092,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Τιμή 12,50 €",
"actual": "Τιμή 12,50 €"
},
"runtime": {
"durationMs": 32.52300000167452,
"inferenceMs": 32.52300000167452,
"forwardMs": 28.47854100400582,
"charactersPerSecond": 368.96965222710554,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 486146048,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11258112,
"mpsDriverAllocatedBytes": 46284800,
"loadMs": 0,
"totalMs": 32.52300000167452,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Ελληνικό κείμενο",
"actual": "Ελληνικό κείμενο"
},
"runtime": {
"durationMs": 27.479207987198606,
"inferenceMs": 27.479207987198606,
"forwardMs": 24.499791994458064,
"charactersPerSecond": 582.2584117946092,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 486146048,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11258112,
"mpsDriverAllocatedBytes": 46284800,
"loadMs": 0,
"totalMs": 27.479207987198606,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Αθήνα 2026",
"actual": "Αθήνα 2026"
},
"runtime": {
"durationMs": 28.337208001175895,
"inferenceMs": 28.337208001175895,
"forwardMs": 24.27512500435114,
"charactersPerSecond": 352.8929173115797,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 486146048,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11258112,
"mpsDriverAllocatedBytes": 46284800,
"loadMs": 0,
"totalMs": 28.337208001175895,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "ΚΑΛΗΜΕΡΑ",
"actual": "ΚΑΛΗΜΕΡΑ"
},
"runtime": {
"durationMs": 27.315417013596743,
"inferenceMs": 27.315417013596743,
"forwardMs": 23.331290984060615,
"charactersPerSecond": 292.8748990366083,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 486146048,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11258112,
"mpsDriverAllocatedBytes": 46284800,
"loadMs": 0,
"totalMs": 27.315417013596743,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Καφές 3,20",
"actual": "Καφές 3,20"
},
"runtime": {
"durationMs": 26.866375003010035,
"inferenceMs": 26.866375003010035,
"forwardMs": 23.870333010563627,
"charactersPerSecond": 372.2124774510751,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 486178816,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11258112,
"mpsDriverAllocatedBytes": 46284800,
"loadMs": 0,
"totalMs": 26.866375003010035,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Corner Cafe",
"actual": "Corner Cafe"
},
"runtime": {
"durationMs": 30.613290990004316,
"inferenceMs": 30.613290990004316,
"forwardMs": 26.20187500724569,
"charactersPerSecond": 359.3210544920394,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 489242624,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11258112,
"mpsDriverAllocatedBytes": 46284800,
"loadMs": 0,
"totalMs": 30.613290990004316,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Espresso 3.20",
"actual": "Espresso 3.20"
},
"runtime": {
"durationMs": 27.023417002055794,
"inferenceMs": 27.023417002055794,
"forwardMs": 22.265959007199854,
"charactersPerSecond": 481.06425619717265,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 489259008,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11258112,
"mpsDriverAllocatedBytes": 46284800,
"loadMs": 0,
"totalMs": 27.023417002055794,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.418040988733992,
"inferenceMs": 0.418040988733992,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float16",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 489259008,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11258112,
"mpsDriverAllocatedBytes": 46284800,
"loadMs": 0,
"totalMs": 0.418040988733992,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.405042024794966,
"inferenceMs": 0.405042024794966,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float16",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 489259008,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11258112,
"mpsDriverAllocatedBytes": 46284800,
"loadMs": 0,
"totalMs": 0.405042024794966,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.41666600736789405,
"inferenceMs": 0.41666600736789405,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float16",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 489259008,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11258112,
"mpsDriverAllocatedBytes": 46284800,
"loadMs": 0,
"totalMs": 0.41666600736789405,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Καλημέρα κόσμε",
"actual": "Καλημέρα κόσμε"
},
"runtime": {
"durationMs": 264.51224999618717,
"inferenceMs": 264.51224999618717,
"forwardMs": 243.1511250033509,
"charactersPerSecond": 52.92760543302552,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 481738752,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11258112,
"mpsDriverAllocatedBytes": 46301184,
"loadMs": 2208.129665988963,
"totalMs": 2472.6419159851503,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Καλημέρα κόσμε",
"actual": "Καλημέρα κόσμε"
},
"runtime": {
"durationMs": 247.89362502633594,
"inferenceMs": 247.89362502633594,
"forwardMs": 225.1690000121016,
"charactersPerSecond": 56.47583716004256,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 481050624,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11258112,
"mpsDriverAllocatedBytes": 46301184,
"loadMs": 2237.722042016685,
"totalMs": 2485.615667043021,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "0d7a6ed5020d57efffb993b7979328481bb04c3b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
}
]PP-OCR 5 Korean Mobile Text Recognizer Desktop
60 configurations testedQuality criteria
No explicit quality gate recorded. Review per-case evidence; full certification is pending.
| Precision | Device | Result | Platform | Inference / load | |
|---|---|---|---|---|---|
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 24 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 24 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 24 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 28 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 30 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 212 ms / 1980 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 217 ms / 1926 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 219 ms / 1951 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 220 ms / 1996 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 359 ms / 1952 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 492 ms / 2104 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 72 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 72 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 72 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 72 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 73 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 73 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 73 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 73 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 73 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 81 ms / 1732 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 84 ms / 1887 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 144 ms / 3180 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 188 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 189 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 191 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 191 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 193 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 194 ms / 1816 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 196 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 196 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 199 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 206 ms / 1785 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 206 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 212 ms / 1915 ms |
Test setup & sample details
- Quality gate
- No explicit quality gate recorded. Review the per-case quality evidence; full certification is pending.
- Tested
- 2026-11-11T02:27:35.043119+00:00
- Environment
- { "hardware": "Apple M3 Max", "os": "macOS27.2", "python": "3.13.18", "runtime": "Transformers5.22.1/Torch2.10.0/Pillow12.0.0", "interpreterScope": "Sequential independent helper processes;existing privatevenv based on app-ownedCPython3.13.18,Transformers5.22.1/Torch2.10/Pillow12.0.StrictMPSnoCPUfallback;verifiedlocal snapshot notnetwork transfer.Writable percase caches removed onlyunder their isolated roots.No concurrent builds/uploads launched.Windows/otherMacs unverified.", "concurrentActivity": "Family-review metadata commands ran during the development matrix;no parallel builds,uploads or model inference launched.Timings reflect this host activity." }
- Runtime
- transformers 5.22.1
- Artifact revision
- 6ef525a357645ce46495c7ed1fef622c4e009e7a
- Fixture
{ "file": "research/ppocrv5-cyrillic-onboarding/fixtures/korean-0-normal.png", "url": "https://assets.localai.tools/samples/v1/files/90ffd3f0f79b861341b56f6dc32875b8726d87bd11ad6d06c788a67c12439c21/korean-0-normal.png", "size": 3430, "sha1": "a2ee407fbf5f94c211be334c2b70a32a13d99679" }- Rerun when
- artifact revision; runtime version; fixture checksum; quality gate; backend behavior; adapter preprocessing or inference changes
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "안녕하세요",
"actual": "안녕하세요"
},
"runtime": {
"durationMs": 143.52766700903885,
"inferenceMs": 143.52766700903885,
"forwardMs": 119.71749999793246,
"charactersPerSecond": 34.836489049077336,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 391790592,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 3180.4520829755347,
"totalMs": 3323.9797499845736,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "안녕하세요",
"actual": "안녕하세요"
},
"runtime": {
"durationMs": 72.50425001257099,
"inferenceMs": 72.50425001257099,
"forwardMs": 70.70112501969561,
"charactersPerSecond": 68.96147466021766,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 392101888,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 72.50425001257099,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "가격 12,500",
"actual": "가격 12,500"
},
"runtime": {
"durationMs": 72.49666700954549,
"inferenceMs": 72.49666700954549,
"forwardMs": 70.74045797344297,
"charactersPerSecond": 124.14363820084291,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 396820480,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 72.49666700954549,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "가격 12,500",
"actual": "가격 12,500"
},
"runtime": {
"durationMs": 72.52545797382481,
"inferenceMs": 72.52545797382481,
"forwardMs": 70.6949169980362,
"charactersPerSecond": 124.09435598804757,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 396853248,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 72.52545797382481,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "서울 2026",
"actual": "서울 2026"
},
"runtime": {
"durationMs": 72.54366701818071,
"inferenceMs": 72.54366701818071,
"forwardMs": 70.6962919794023,
"charactersPerSecond": 96.49360568229446,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 396869632,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 72.54366701818071,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "영수증 4821",
"actual": "영수증 4821"
},
"runtime": {
"durationMs": 72.24762500845827,
"inferenceMs": 72.24762500845827,
"forwardMs": 70.30366599792615,
"charactersPerSecond": 110.73028350846707,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 396902400,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 72.24762500845827,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "좋은 하루",
"actual": "좋은 하루"
},
"runtime": {
"durationMs": 72.21495799603872,
"inferenceMs": 72.21495799603872,
"forwardMs": 70.48062499961816,
"charactersPerSecond": 69.23773327229894,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 396902400,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 72.21495799603872,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "한국어 문장",
"actual": "한국어 문장"
},
"runtime": {
"durationMs": 71.60825000028126,
"inferenceMs": 71.60825000028126,
"forwardMs": 69.83583301189356,
"charactersPerSecond": 83.78922819614267,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 396902400,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 71.60825000028126,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Corner Cafe",
"actual": "Corner Cafe"
},
"runtime": {
"durationMs": 73.00895801745355,
"inferenceMs": 73.00895801745355,
"forwardMs": 69.83766701887362,
"charactersPerSecond": 150.66644284075846,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 399998976,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 73.00895801745355,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Espresso 3.20",
"actual": "Espresso 3.20"
},
"runtime": {
"durationMs": 72.83637500950135,
"inferenceMs": 72.83637500950135,
"forwardMs": 70.05941701936536,
"charactersPerSecond": 178.48224871575744,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 399998976,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 72.83637500950135,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.36545799230225384,
"inferenceMs": 0.36545799230225384,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 399998976,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.36545799230225384,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.29958400409668684,
"inferenceMs": 0.29958400409668684,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 399998976,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.29958400409668684,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.285916990833357,
"inferenceMs": 0.285916990833357,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 399998976,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.285916990833357,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "안녕하세요",
"actual": "안녕하세요"
},
"runtime": {
"durationMs": 81.19341600104235,
"inferenceMs": 81.19341600104235,
"forwardMs": 73.71324999257922,
"charactersPerSecond": 61.581347925253084,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 391331840,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 1732.11412501405,
"totalMs": 1813.3075410150923,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "안녕하세요",
"actual": "안녕하세요"
},
"runtime": {
"durationMs": 84.25437498954125,
"inferenceMs": 84.25437498954125,
"forwardMs": 76.1078330106102,
"charactersPerSecond": 59.34409934938886,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 390676480,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 1887.4198329867795,
"totalMs": 1971.6742079763208,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "안녕하세요",
"actual": "안녕하세요"
},
"runtime": {
"durationMs": 205.72670898400247,
"inferenceMs": 205.72670898400247,
"forwardMs": 197.7447499812115,
"charactersPerSecond": 24.304087809953764,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 392167424,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 1785.1154590025544,
"totalMs": 1990.842167986557,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "안녕하세요",
"actual": "안녕하세요"
},
"runtime": {
"durationMs": 188.19545800215565,
"inferenceMs": 188.19545800215565,
"forwardMs": 186.6109579859767,
"charactersPerSecond": 26.568122594875422,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 392462336,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 188.19545800215565,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "가격 12,500",
"actual": "가격 12,500"
},
"runtime": {
"durationMs": 191.12049997784197,
"inferenceMs": 191.12049997784197,
"forwardMs": 189.6078749850858,
"charactersPerSecond": 47.090709793263606,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 392478720,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 191.12049997784197,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "가격 12,500",
"actual": "가격 12,500"
},
"runtime": {
"durationMs": 196.1639580258634,
"inferenceMs": 196.1639580258634,
"forwardMs": 194.48745899717323,
"charactersPerSecond": 45.87998779476803,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 392511488,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 196.1639580258634,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "서울 2026",
"actual": "서울 2026"
},
"runtime": {
"durationMs": 193.1045830133371,
"inferenceMs": 193.1045830133371,
"forwardMs": 191.60620900220238,
"charactersPerSecond": 36.249786984685564,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 393527296,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 193.1045830133371,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "영수증 4821",
"actual": "영수증 4821"
},
"runtime": {
"durationMs": 188.83679201826453,
"inferenceMs": 188.83679201826453,
"forwardMs": 187.37920801504515,
"charactersPerSecond": 42.36462563516876,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 395755520,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 188.83679201826453,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "좋은 하루",
"actual": "좋은 하루"
},
"runtime": {
"durationMs": 190.6698749808129,
"inferenceMs": 190.6698749808129,
"forwardMs": 189.19829098740593,
"charactersPerSecond": 26.22333496837479,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 395755520,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 190.6698749808129,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "한국어 문장",
"actual": "한국어 문장"
},
"runtime": {
"durationMs": 199.28062497638166,
"inferenceMs": 199.28062497638166,
"forwardMs": 197.68512499285862,
"charactersPerSecond": 30.10829577993901,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 395755520,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 199.28062497638166,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Corner Cafe",
"actual": "Corner Cafe"
},
"runtime": {
"durationMs": 206.34562498889863,
"inferenceMs": 206.34562498889863,
"forwardMs": 203.59591700253077,
"charactersPerSecond": 53.30861752262399,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 398835712,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 206.34562498889863,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Espresso 3.20",
"actual": "Espresso 3.20"
},
"runtime": {
"durationMs": 195.83045798935927,
"inferenceMs": 195.83045798935927,
"forwardMs": 193.05929201073013,
"charactersPerSecond": 66.38395341293831,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 398835712,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 195.83045798935927,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.3962499904446304,
"inferenceMs": 0.3962499904446304,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 398835712,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.3962499904446304,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.2883329871110618,
"inferenceMs": 0.2883329871110618,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 398835712,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.2883329871110618,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.2871659817174077,
"inferenceMs": 0.2871659817174077,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 398835712,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.2871659817174077,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "안녕하세요",
"actual": "안녕하세요"
},
"runtime": {
"durationMs": 194.0462079946883,
"inferenceMs": 194.0462079946883,
"forwardMs": 187.25591601105407,
"charactersPerSecond": 25.76705853554668,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 389316608,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 1815.5864170112181,
"totalMs": 2009.6326250059064,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "안녕하세요",
"actual": "안녕하세요"
},
"runtime": {
"durationMs": 211.6353749879636,
"inferenceMs": 211.6353749879636,
"forwardMs": 203.53516700561158,
"charactersPerSecond": 23.625539918760587,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 395886592,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 1914.7630410152487,
"totalMs": 2126.3984160032123,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "안녕하세요",
"actual": "안녕하세요"
},
"runtime": {
"durationMs": 491.6001670062542,
"inferenceMs": 491.6001670062542,
"forwardMs": 467.4516670056619,
"charactersPerSecond": 10.170867171280658,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 472760320,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 28011264,
"mpsDriverAllocatedBytes": 98566144,
"loadMs": 2104.0834999876097,
"totalMs": 2595.683666993864,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "안녕하세요",
"actual": "안녕하세요"
},
"runtime": {
"durationMs": 30.24787499452941,
"inferenceMs": 30.24787499452941,
"forwardMs": 26.46312498836778,
"charactersPerSecond": 165.30086827270654,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 472858624,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 28011264,
"mpsDriverAllocatedBytes": 98566144,
"loadMs": 0,
"totalMs": 30.24787499452941,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "가격 12,500",
"actual": "가격 12,500"
},
"runtime": {
"durationMs": 26.92262499476783,
"inferenceMs": 26.92262499476783,
"forwardMs": 23.42845799284987,
"charactersPerSecond": 334.29132566936056,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 472891392,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 28011264,
"mpsDriverAllocatedBytes": 98566144,
"loadMs": 0,
"totalMs": 26.92262499476783,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "가격 12,500",
"actual": "가격 12,500"
},
"runtime": {
"durationMs": 26.75508300308138,
"inferenceMs": 26.75508300308138,
"forwardMs": 24.072000000160187,
"charactersPerSecond": 336.3846787155723,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 472924160,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 28011264,
"mpsDriverAllocatedBytes": 98566144,
"loadMs": 0,
"totalMs": 26.75508300308138,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "서울 2026",
"actual": "서울 2026"
},
"runtime": {
"durationMs": 24.80783298960887,
"inferenceMs": 24.80783298960887,
"forwardMs": 22.297957999398932,
"charactersPerSecond": 282.16894248409585,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 473038848,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 28011264,
"mpsDriverAllocatedBytes": 98566144,
"loadMs": 0,
"totalMs": 24.80783298960887,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "영수증 4821",
"actual": "영수증 4821"
},
"runtime": {
"durationMs": 24.652208987390622,
"inferenceMs": 24.652208987390622,
"forwardMs": 21.788625017507,
"charactersPerSecond": 324.5145294724674,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 473055232,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 28011264,
"mpsDriverAllocatedBytes": 98566144,
"loadMs": 0,
"totalMs": 24.652208987390622,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "좋은 하루",
"actual": "좋은 하루"
},
"runtime": {
"durationMs": 24.509625014616176,
"inferenceMs": 24.509625014616176,
"forwardMs": 21.57520901528187,
"charactersPerSecond": 204.0014890892161,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 473055232,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 28011264,
"mpsDriverAllocatedBytes": 98566144,
"loadMs": 0,
"totalMs": 24.509625014616176,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "한국어 문장",
"actual": "한국어 문장"
},
"runtime": {
"durationMs": 25.194625020958483,
"inferenceMs": 25.194625020958483,
"forwardMs": 22.499790997244418,
"charactersPerSecond": 238.14603293396192,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 473071616,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 28011264,
"mpsDriverAllocatedBytes": 98566144,
"loadMs": 0,
"totalMs": 25.194625020958483,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Corner Cafe",
"actual": "Corner Cafe"
},
"runtime": {
"durationMs": 26.08020801562816,
"inferenceMs": 26.08020801562816,
"forwardMs": 21.172584005398676,
"charactersPerSecond": 421.7757769956597,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 476266496,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 28011264,
"mpsDriverAllocatedBytes": 98566144,
"loadMs": 0,
"totalMs": 26.08020801562816,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Espresso 3.20",
"actual": "Espresso 3.20"
},
"runtime": {
"durationMs": 23.897250008303672,
"inferenceMs": 23.897250008303672,
"forwardMs": 20.457333012018353,
"charactersPerSecond": 543.9956478457914,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 476282880,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 28011264,
"mpsDriverAllocatedBytes": 98566144,
"loadMs": 0,
"totalMs": 23.897250008303672,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.3826669999398291,
"inferenceMs": 0.3826669999398291,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 476282880,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 28011264,
"mpsDriverAllocatedBytes": 98566144,
"loadMs": 0,
"totalMs": 0.3826669999398291,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.33383400295861065,
"inferenceMs": 0.33383400295861065,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 476282880,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 28011264,
"mpsDriverAllocatedBytes": 98566144,
"loadMs": 0,
"totalMs": 0.33383400295861065,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.2873330086003989,
"inferenceMs": 0.2873330086003989,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 476282880,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 28011264,
"mpsDriverAllocatedBytes": 98566144,
"loadMs": 0,
"totalMs": 0.2873330086003989,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "안녕하세요",
"actual": "안녕하세요"
},
"runtime": {
"durationMs": 218.94754099776037,
"inferenceMs": 218.94754099776037,
"forwardMs": 201.3088749954477,
"charactersPerSecond": 22.83652046154355,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 470433792,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 28011264,
"mpsDriverAllocatedBytes": 98566144,
"loadMs": 1951.1561669933144,
"totalMs": 2170.1037079910748,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "안녕하세요",
"actual": "안녕하세요"
},
"runtime": {
"durationMs": 211.76508298958652,
"inferenceMs": 211.76508298958652,
"forwardMs": 194.33841700083576,
"charactersPerSecond": 23.611069064893353,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 469843968,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 28011264,
"mpsDriverAllocatedBytes": 98566144,
"loadMs": 1979.7459999972489,
"totalMs": 2191.5110829868354,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "안녕하세요",
"actual": "안녕하세요"
},
"runtime": {
"durationMs": 358.7084579921793,
"inferenceMs": 358.7084579921793,
"forwardMs": 338.8137920119334,
"charactersPerSecond": 13.938896305893662,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 488751104,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 14063360,
"mpsDriverAllocatedBytes": 81707008,
"loadMs": 1952.1218750160187,
"totalMs": 2310.830333008198,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "안녕하세요",
"actual": "안녕하세요"
},
"runtime": {
"durationMs": 28.172500024084002,
"inferenceMs": 28.172500024084002,
"forwardMs": 24.310832988703623,
"charactersPerSecond": 177.47803694118798,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 488898560,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 14063360,
"mpsDriverAllocatedBytes": 81707008,
"loadMs": 0,
"totalMs": 28.172500024084002,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "가격 12,500",
"actual": "가격 12,500"
},
"runtime": {
"durationMs": 24.944875010987744,
"inferenceMs": 24.944875010987744,
"forwardMs": 21.648416994139552,
"charactersPerSecond": 360.7955540380808,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 488947712,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 14063360,
"mpsDriverAllocatedBytes": 81707008,
"loadMs": 0,
"totalMs": 24.944875010987744,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "가격 12,500",
"actual": "가격 12,500"
},
"runtime": {
"durationMs": 25.247667013900355,
"inferenceMs": 25.247667013900355,
"forwardMs": 22.373667015926912,
"charactersPerSecond": 356.46857965312046,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 489013248,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 14063360,
"mpsDriverAllocatedBytes": 81707008,
"loadMs": 0,
"totalMs": 25.247667013900355,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "서울 2026",
"actual": "서울 2026"
},
"runtime": {
"durationMs": 25.50012501887977,
"inferenceMs": 25.50012501887977,
"forwardMs": 21.607125003356487,
"charactersPerSecond": 274.5084580886307,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 489029632,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 14063360,
"mpsDriverAllocatedBytes": 81707008,
"loadMs": 0,
"totalMs": 25.50012501887977,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "영수증 4821",
"actual": "영수증 4821"
},
"runtime": {
"durationMs": 24.893124995287508,
"inferenceMs": 24.893124995287508,
"forwardMs": 21.098541998071596,
"charactersPerSecond": 321.37387336923234,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 489029632,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 14063360,
"mpsDriverAllocatedBytes": 81707008,
"loadMs": 0,
"totalMs": 24.893124995287508,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "좋은 하루",
"actual": "좋은 하루"
},
"runtime": {
"durationMs": 26.301750011043623,
"inferenceMs": 26.301750011043623,
"forwardMs": 22.895375004736707,
"charactersPerSecond": 190.10141902727352,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 489029632,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 14063360,
"mpsDriverAllocatedBytes": 81707008,
"loadMs": 0,
"totalMs": 26.301750011043623,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "한국어 문장",
"actual": "한국어 문장"
},
"runtime": {
"durationMs": 24.390124977799132,
"inferenceMs": 24.390124977799132,
"forwardMs": 20.628167025279254,
"charactersPerSecond": 246.0011994797665,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 489046016,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 14063360,
"mpsDriverAllocatedBytes": 81707008,
"loadMs": 0,
"totalMs": 24.390124977799132,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Corner Cafe",
"actual": "Corner Cafe"
},
"runtime": {
"durationMs": 24.015832983423024,
"inferenceMs": 24.015832983423024,
"forwardMs": 20.301083015510812,
"charactersPerSecond": 458.03116667211884,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 492126208,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 14063360,
"mpsDriverAllocatedBytes": 81707008,
"loadMs": 0,
"totalMs": 24.015832983423024,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Espresso 3.20",
"actual": "Espresso 3.20"
},
"runtime": {
"durationMs": 25.336166989291087,
"inferenceMs": 25.336166989291087,
"forwardMs": 20.685833995230496,
"charactersPerSecond": 513.1005019620667,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 492142592,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 14063360,
"mpsDriverAllocatedBytes": 81707008,
"loadMs": 0,
"totalMs": 25.336166989291087,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.39408402517437935,
"inferenceMs": 0.39408402517437935,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float16",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 492142592,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 14063360,
"mpsDriverAllocatedBytes": 81707008,
"loadMs": 0,
"totalMs": 0.39408402517437935,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.3171660064253956,
"inferenceMs": 0.3171660064253956,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float16",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 492142592,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 14063360,
"mpsDriverAllocatedBytes": 81707008,
"loadMs": 0,
"totalMs": 0.3171660064253956,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.2928329922724515,
"inferenceMs": 0.2928329922724515,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float16",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 492142592,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 14063360,
"mpsDriverAllocatedBytes": 81707008,
"loadMs": 0,
"totalMs": 0.2928329922724515,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "안녕하세요",
"actual": "안녕하세요"
},
"runtime": {
"durationMs": 219.6323329990264,
"inferenceMs": 219.6323329990264,
"forwardMs": 201.16316599887796,
"charactersPerSecond": 22.765318437983193,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 485523456,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 14063360,
"mpsDriverAllocatedBytes": 81707008,
"loadMs": 1996.0324589919765,
"totalMs": 2215.664791991003,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "안녕하세요",
"actual": "안녕하세요"
},
"runtime": {
"durationMs": 217.17945899581537,
"inferenceMs": 217.17945899581537,
"forwardMs": 198.44141701469198,
"charactersPerSecond": 23.022435100993324,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 484491264,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 14063360,
"mpsDriverAllocatedBytes": 81707008,
"loadMs": 1925.773791008396,
"totalMs": 2142.9532500042114,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "6ef525a357645ce46495c7ed1fef622c4e009e7a",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
}
]PP-OCR 5 Server Text Recognizer Desktop
64 configurations testedQuality criteria
No explicit quality gate recorded. Review per-case evidence; full certification is pending.
| Precision | Device | Result | Platform | Inference / load | |
|---|---|---|---|---|---|
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 19 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 23 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 24 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 24 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 29 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 161 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 178 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 208 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 215 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 248 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 259 ms / 2123 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 266 ms / 2025 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 273 ms / 2152 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 282 ms / 2070 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 284 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 299 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 306 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 788 ms / 2035 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 799 ms / 2097 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 40 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 40 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 41 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 42 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 42 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 43 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 45 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 46 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 49 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 53 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 54 ms / 1891 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 54 ms / 1933 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 138 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 141 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 142 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 142 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 143 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 147 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 148 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 148 ms / 2277 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 151 ms / 1983 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 151 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 152 ms / 1913 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 163 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 167 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 181 ms / 3541 ms |
Test setup & sample details
- Quality gate
- No explicit quality gate recorded. Review the per-case quality evidence; full certification is pending.
- Tested
- 2026-11-11T16:25:07.208699+00:00
- Environment
- { "hardware": "Apple M3 Max", "os": "macOS27.2", "python": "3.13.18", "runtime": "Transformers5.22.1/Torch2.10.0/Pillow12.0.0", "interpreterScope": "Sequential independent helper processes;existing privatevenv based on app-ownedCPython3.13.18,Transformers5.22.1/Torch2.10/Pillow12.0.StrictMPSnoCPUfallback;verifiedlocal snapshot notnetwork transfer.Writable percase caches removed onlyunder their isolated roots.No concurrent builds/uploads launched.Windows/otherMacs unverified." }
- Runtime
- transformers 5.22.1
- Artifact revision
- 542979d7cc3791732bb12af35313a6840952d79f
- Fixture
{ "file": "model-samples/ppocrv5-menu.png", "url": "https://f005.backblazeb2.com/file/hubters-webai-public/assets/benchmarks/ppocrv5-menu.png", "size": 16719, "sha1": "a238414c0632eb69535a9b5307b61cfea4da5421" }- Rerun when
- artifact revision; runtime version; fixture checksum; quality gate; backend behavior; adapter preprocessing or inference changes
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Corner Cafe",
"actual": "Corner Cafe"
},
"runtime": {
"durationMs": 180.5246250005439,
"inferenceMs": 180.5246250005439,
"forwardMs": 151.7424579942599,
"charactersPerSecond": 60.93351530278409,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 472481792,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 3541.3395409996156,
"totalMs": 3721.8641660001595,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Espresso 3.20",
"actual": "Espresso 3.20"
},
"runtime": {
"durationMs": 48.94466701080091,
"inferenceMs": 48.94466701080091,
"forwardMs": 44.995667005423456,
"charactersPerSecond": 265.60605667479996,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 478412800,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 48.94466701080091,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Espresso 3.20",
"actual": "Espresso 3.20"
},
"runtime": {
"durationMs": 41.93933398346417,
"inferenceMs": 41.93933398346417,
"forwardMs": 38.989583001239225,
"charactersPerSecond": 309.97154139657147,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 480411648,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 41.93933398346417,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Cappuccino 4.10",
"actual": "Cappuccino 4.10"
},
"runtime": {
"durationMs": 45.91604199958965,
"inferenceMs": 45.91604199958965,
"forwardMs": 41.697500011650845,
"charactersPerSecond": 326.68321019773555,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
338
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 490242048,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 45.91604199958965,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Green tea 3.50",
"actual": "Green tea 3.50"
},
"runtime": {
"durationMs": 44.58316700765863,
"inferenceMs": 44.58316700765863,
"forwardMs": 40.712291025556624,
"charactersPerSecond": 314.01986309306017,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
347
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 508248064,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 44.58316700765863,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Open 8:00-18:00",
"actual": "Open 8:00-18:00"
},
"runtime": {
"durationMs": 43.003958999179304,
"inferenceMs": 43.003958999179304,
"forwardMs": 39.07629201421514,
"charactersPerSecond": 348.8050949050124,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
334
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 508248064,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 43.003958999179304,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Open 8:00-18:00",
"actual": "Open 8:00-18:00"
},
"runtime": {
"durationMs": 40.985832980368286,
"inferenceMs": 40.985832980368286,
"forwardMs": 37.93645798577927,
"charactersPerSecond": 365.98011823219053,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 508379136,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 40.985832980368286,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Free Wi-Fi inside",
"actual": "Free Wi-Fi inside"
},
"runtime": {
"durationMs": 53.30416600918397,
"inferenceMs": 53.30416600918397,
"forwardMs": 49.25604199524969,
"charactersPerSecond": 318.92441572148425,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
393
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 528891904,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 53.30416600918397,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "LocalAI Tools",
"actual": "LocalAI Tools"
},
"runtime": {
"durationMs": 39.8017080151476,
"inferenceMs": 39.8017080151476,
"forwardMs": 36.9805840018671,
"charactersPerSecond": 326.6191489835689,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 528990208,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 39.8017080151476,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.44350000098347664,
"inferenceMs": 0.44350000098347664,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 528990208,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.44350000098347664,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.32225000904873013,
"inferenceMs": 0.32225000904873013,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 528990208,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.32225000904873013,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.34483399940654635,
"inferenceMs": 0.34483399940654635,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 528990208,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.34483399940654635,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Invoice 4821",
"actual": "Invoice 4821"
},
"runtime": {
"durationMs": 40.48541700467467,
"inferenceMs": 40.48541700467467,
"forwardMs": 37.693917023716494,
"charactersPerSecond": 296.403023306254,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 529039360,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 40.48541700467467,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Backup complete",
"actual": "Backup complete"
},
"runtime": {
"durationMs": 42.093041993211955,
"inferenceMs": 42.093041993211955,
"forwardMs": 38.98708298220299,
"charactersPerSecond": 356.3534325321259,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
333
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 529350656,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 42.093041993211955,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Corner Cafe",
"actual": "Corner Cafe"
},
"runtime": {
"durationMs": 54.28654100978747,
"inferenceMs": 54.28654100978747,
"forwardMs": 43.87212501023896,
"charactersPerSecond": 202.6284930921788,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 469778432,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 1933.3096659975126,
"totalMs": 1987.5962070073,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Corner Cafe",
"actual": "Corner Cafe"
},
"runtime": {
"durationMs": 53.50995800108649,
"inferenceMs": 53.50995800108649,
"forwardMs": 42.95912501402199,
"charactersPerSecond": 205.5692138606547,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 468271104,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 1891.4831249858253,
"totalMs": 1944.9930829869118,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Corner Cafe",
"actual": "Corner Cafe"
},
"runtime": {
"durationMs": 150.5218749807682,
"inferenceMs": 150.5218749807682,
"forwardMs": 139.83775000087917,
"charactersPerSecond": 73.07907904685244,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 466960384,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 1983.2976250036154,
"totalMs": 2133.8194999843836,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Espresso 3.20",
"actual": "Espresso 3.20"
},
"runtime": {
"durationMs": 147.0120419980958,
"inferenceMs": 147.0120419980958,
"forwardMs": 143.6762500088662,
"charactersPerSecond": 88.42813026274666,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 471597056,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 147.0120419980958,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Espresso 3.20",
"actual": "Espresso 3.20"
},
"runtime": {
"durationMs": 143.43070800532587,
"inferenceMs": 143.43070800532587,
"forwardMs": 141.0240000113845,
"charactersPerSecond": 90.636100042937,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 471613440,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 143.43070800532587,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Cappuccino 4.10",
"actual": "Cappuccino 4.10"
},
"runtime": {
"durationMs": 138.08024997706525,
"inferenceMs": 138.08024997706525,
"forwardMs": 134.89625000511296,
"charactersPerSecond": 108.63248004324629,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
338
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 481280000,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 138.08024997706525,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Green tea 3.50",
"actual": "Green tea 3.50"
},
"runtime": {
"durationMs": 151.17595900665037,
"inferenceMs": 151.17595900665037,
"forwardMs": 148.12979201087728,
"charactersPerSecond": 92.60731727446245,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
347
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 498728960,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 151.17595900665037,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Open 8:00-18:00",
"actual": "Open 8:00-18:00"
},
"runtime": {
"durationMs": 147.83404098125175,
"inferenceMs": 147.83404098125175,
"forwardMs": 144.55083300708793,
"charactersPerSecond": 101.46512873785473,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
334
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 503267328,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 147.83404098125175,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Open 8:00-18:00",
"actual": "Open 8:00-18:00"
},
"runtime": {
"durationMs": 142.0799579937011,
"inferenceMs": 142.0799579937011,
"forwardMs": 139.59400000749156,
"charactersPerSecond": 105.5743555376403,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 504889344,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 142.0799579937011,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Free Wi-Fi inside",
"actual": "Free Wi-Fi inside"
},
"runtime": {
"durationMs": 142.43358399835415,
"inferenceMs": 142.43358399835415,
"forwardMs": 139.18170900433324,
"charactersPerSecond": 119.35387373385505,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
393
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 524369920,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 142.43358399835415,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "LocalAI Tools",
"actual": "LocalAI Tools"
},
"runtime": {
"durationMs": 141.15583398961462,
"inferenceMs": 141.15583398961462,
"forwardMs": 138.98004198563285,
"charactersPerSecond": 92.09679566596206,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 524402688,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 141.15583398961462,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.40091597475111485,
"inferenceMs": 0.40091597475111485,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 524402688,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.40091597475111485,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.31712499912828207,
"inferenceMs": 0.31712499912828207,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 524402688,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.31712499912828207,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.29991698102094233,
"inferenceMs": 0.29991698102094233,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 524402688,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.29991698102094233,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Invoice 4821",
"actual": "Invoice 4821"
},
"runtime": {
"durationMs": 166.81704198708758,
"inferenceMs": 166.81704198708758,
"forwardMs": 164.55895800027065,
"charactersPerSecond": 71.93509642095714,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 524402688,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 166.81704198708758,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Backup complete",
"actual": "Backup complete"
},
"runtime": {
"durationMs": 163.4806249930989,
"inferenceMs": 163.4806249930989,
"forwardMs": 160.9650000173133,
"charactersPerSecond": 91.75399225830708,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
333
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 524681216,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 163.4806249930989,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Corner Cafe",
"actual": "Corner Cafe"
},
"runtime": {
"durationMs": 147.88999999291264,
"inferenceMs": 147.88999999291264,
"forwardMs": 138.59287500963546,
"charactersPerSecond": 74.3796064678285,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 465371136,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 2276.912708999589,
"totalMs": 2424.8027089925017,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Corner Cafe",
"actual": "Corner Cafe"
},
"runtime": {
"durationMs": 151.56016699620523,
"inferenceMs": 151.56016699620523,
"forwardMs": 141.7597499967087,
"charactersPerSecond": 72.57843678857532,
"placement": {
"cpu/torch.float32": 286
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 470204416,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 1913.0747500166763,
"totalMs": 2064.6349170128815,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Corner Cafe",
"actual": "Corner Cafe"
},
"runtime": {
"durationMs": 798.5787080251612,
"inferenceMs": 798.5787080251612,
"forwardMs": 769.1038339980878,
"charactersPerSecond": 13.774471933020054,
"placement": {
"mps:0/torch.float32": 286
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 475103232,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 84409088,
"mpsDriverAllocatedBytes": 1181384704,
"loadMs": 2097.0029169984628,
"totalMs": 2895.581625023624,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Espresso 3.20",
"actual": "Espresso 3.20"
},
"runtime": {
"durationMs": 26.14762500161305,
"inferenceMs": 26.14762500161305,
"forwardMs": 20.96620897646062,
"charactersPerSecond": 497.177085842329,
"placement": {
"mps:0/torch.float32": 286
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 475463680,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 84409088,
"mpsDriverAllocatedBytes": 1181384704,
"loadMs": 0,
"totalMs": 26.14762500161305,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Espresso 3.20",
"actual": "Espresso 3.20"
},
"runtime": {
"durationMs": 24.908125022193417,
"inferenceMs": 24.908125022193417,
"forwardMs": 20.47975000459701,
"charactersPerSecond": 521.9180483644134,
"placement": {
"mps:0/torch.float32": 286
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 475496448,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 84409088,
"mpsDriverAllocatedBytes": 1181368320,
"loadMs": 0,
"totalMs": 24.908125022193417,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Cappuccino 4.10",
"actual": "Cappuccino 4.10"
},
"runtime": {
"durationMs": 248.11745798797347,
"inferenceMs": 248.11745798797347,
"forwardMs": 235.46591599006206,
"charactersPerSecond": 60.45523810229858,
"placement": {
"mps:0/torch.float32": 286
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
338
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 549502976,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 84409088,
"mpsDriverAllocatedBytes": 1194033152,
"loadMs": 0,
"totalMs": 248.11745798797347,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Green tea 3.50",
"actual": "Green tea 3.50"
},
"runtime": {
"durationMs": 215.10524998302571,
"inferenceMs": 215.10524998302571,
"forwardMs": 202.51520900637843,
"charactersPerSecond": 65.08441798191704,
"placement": {
"mps:0/torch.float32": 286
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
347
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 623640576,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 84409088,
"mpsDriverAllocatedBytes": 1198407680,
"loadMs": 0,
"totalMs": 215.10524998302571,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Open 8:00-18:00",
"actual": "Open 8:00-18:00"
},
"runtime": {
"durationMs": 178.38933298480697,
"inferenceMs": 178.38933298480697,
"forwardMs": 173.97874998277985,
"charactersPerSecond": 84.08574520135414,
"placement": {
"mps:0/torch.float32": 286
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
334
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 679641088,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 84409088,
"mpsDriverAllocatedBytes": 1199357952,
"loadMs": 0,
"totalMs": 178.38933298480697,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Open 8:00-18:00",
"actual": "Open 8:00-18:00"
},
"runtime": {
"durationMs": 24.29933301755227,
"inferenceMs": 24.29933301755227,
"forwardMs": 19.736000016564503,
"charactersPerSecond": 617.3008941918268,
"placement": {
"mps:0/torch.float32": 286
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 679673856,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 84409088,
"mpsDriverAllocatedBytes": 1199357952,
"loadMs": 0,
"totalMs": 24.29933301755227,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Free Wi-Fi inside",
"actual": "Free Wi-Fi inside"
},
"runtime": {
"durationMs": 305.994374997681,
"inferenceMs": 305.994374997681,
"forwardMs": 291.7032499972265,
"charactersPerSecond": 55.556576816579835,
"placement": {
"mps:0/torch.float32": 286
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
393
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 753844224,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 84409088,
"mpsDriverAllocatedBytes": 1204191232,
"loadMs": 0,
"totalMs": 305.994374997681,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "LocalAI Tools",
"actual": "LocalAI Tools"
},
"runtime": {
"durationMs": 24.585457984358072,
"inferenceMs": 24.585457984358072,
"forwardMs": 20.33037500223145,
"charactersPerSecond": 528.7678597759273,
"placement": {
"mps:0/torch.float32": 286
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 753975296,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 84409088,
"mpsDriverAllocatedBytes": 1204191232,
"loadMs": 0,
"totalMs": 24.585457984358072,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.43333301437087357,
"inferenceMs": 0.43333301437087357,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float32": 286
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 753975296,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 84409088,
"mpsDriverAllocatedBytes": 1204191232,
"loadMs": 0,
"totalMs": 0.43333301437087357,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.3330839972477406,
"inferenceMs": 0.3330839972477406,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float32": 286
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 753975296,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 84409088,
"mpsDriverAllocatedBytes": 1204191232,
"loadMs": 0,
"totalMs": 0.3330839972477406,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.3082500188611448,
"inferenceMs": 0.3082500188611448,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float32": 286
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 753975296,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 84409088,
"mpsDriverAllocatedBytes": 1204191232,
"loadMs": 0,
"totalMs": 0.3082500188611448,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Invoice 4821",
"actual": "Invoice 4821"
},
"runtime": {
"durationMs": 22.55691701429896,
"inferenceMs": 22.55691701429896,
"forwardMs": 19.04154202202335,
"charactersPerSecond": 531.9875935347517,
"placement": {
"mps:0/torch.float32": 286
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 753991680,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 84409088,
"mpsDriverAllocatedBytes": 1204191232,
"loadMs": 0,
"totalMs": 22.55691701429896,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Backup complete",
"actual": "Backup complete"
},
"runtime": {
"durationMs": 26.774541998747736,
"inferenceMs": 26.774541998747736,
"forwardMs": 22.2209999919869,
"charactersPerSecond": 560.2336727441149,
"placement": {
"mps:0/torch.float32": 286
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
333
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 754860032,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 84409088,
"mpsDriverAllocatedBytes": 1204207616,
"loadMs": 0,
"totalMs": 26.774541998747736,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Corner Cafe",
"actual": "Corner Cafe"
},
"runtime": {
"durationMs": 272.6964999746997,
"inferenceMs": 272.6964999746997,
"forwardMs": 250.46329200267792,
"charactersPerSecond": 40.337884795076434,
"placement": {
"mps:0/torch.float32": 286
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 475398144,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 84409088,
"mpsDriverAllocatedBytes": 1181384704,
"loadMs": 2151.577416982036,
"totalMs": 2424.273916956736,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Corner Cafe",
"actual": "Corner Cafe"
},
"runtime": {
"durationMs": 258.8635419961065,
"inferenceMs": 258.8635419961065,
"forwardMs": 236.78395798197016,
"charactersPerSecond": 42.49343076734014,
"placement": {
"mps:0/torch.float32": 286
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 476659712,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 84409088,
"mpsDriverAllocatedBytes": 1181384704,
"loadMs": 2123.3129579923116,
"totalMs": 2382.176499988418,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Corner Cafe",
"actual": "Corner Cafe"
},
"runtime": {
"durationMs": 788.4712920058519,
"inferenceMs": 788.4712920058519,
"forwardMs": 763.2715000072494,
"charactersPerSecond": 13.951046932877247,
"placement": {
"mps:0/torch.float16": 286
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 514195456,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 42243584,
"mpsDriverAllocatedBytes": 128548864,
"loadMs": 2035.0359169824515,
"totalMs": 2823.5072089883033,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Espresso 3.20",
"actual": "Espresso 3.20"
},
"runtime": {
"durationMs": 28.597750002518296,
"inferenceMs": 28.597750002518296,
"forwardMs": 23.295874998439103,
"charactersPerSecond": 454.5812170137591,
"placement": {
"mps:0/torch.float16": 286
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 514457600,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 42243584,
"mpsDriverAllocatedBytes": 128548864,
"loadMs": 0,
"totalMs": 28.597750002518296,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Espresso 3.20",
"actual": "Espresso 3.20"
},
"runtime": {
"durationMs": 19.180625007720664,
"inferenceMs": 19.180625007720664,
"forwardMs": 16.25066698761657,
"charactersPerSecond": 677.767277905031,
"placement": {
"mps:0/torch.float16": 286
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 514457600,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 42243584,
"mpsDriverAllocatedBytes": 128548864,
"loadMs": 0,
"totalMs": 19.180625007720664,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Cappuccino 4.10",
"actual": "Cappuccino 4.10"
},
"runtime": {
"durationMs": 284.23704201122746,
"inferenceMs": 284.23704201122746,
"forwardMs": 271.74558298429474,
"charactersPerSecond": 52.77285428338892,
"placement": {
"mps:0/torch.float16": 286
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
338
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 585662464,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 42243584,
"mpsDriverAllocatedBytes": 132743168,
"loadMs": 0,
"totalMs": 284.23704201122746,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Green tea 3.50",
"actual": "Green tea 3.50"
},
"runtime": {
"durationMs": 207.66612500301562,
"inferenceMs": 207.66612500301562,
"forwardMs": 194.45441602147184,
"charactersPerSecond": 67.41590618015672,
"placement": {
"mps:0/torch.float16": 286
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
347
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 657244160,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 42243584,
"mpsDriverAllocatedBytes": 137052160,
"loadMs": 0,
"totalMs": 207.66612500301562,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Open 8:00-18:00",
"actual": "Open 8:00-18:00"
},
"runtime": {
"durationMs": 160.95062499516644,
"inferenceMs": 160.95062499516644,
"forwardMs": 156.53966699028388,
"charactersPerSecond": 93.19628302437764,
"placement": {
"mps:0/torch.float16": 286
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
334
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 713097216,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 42243584,
"mpsDriverAllocatedBytes": 137936896,
"loadMs": 0,
"totalMs": 160.95062499516644,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Open 8:00-18:00",
"actual": "Open 8:00-18:00"
},
"runtime": {
"durationMs": 25.820833019679412,
"inferenceMs": 25.820833019679412,
"forwardMs": 21.28374998574145,
"charactersPerSecond": 580.9262616960388,
"placement": {
"mps:0/torch.float16": 286
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 713211904,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 42243584,
"mpsDriverAllocatedBytes": 137936896,
"loadMs": 0,
"totalMs": 25.820833019679412,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Free Wi-Fi inside",
"actual": "Free Wi-Fi inside"
},
"runtime": {
"durationMs": 299.0106249926612,
"inferenceMs": 299.0106249926612,
"forwardMs": 283.77241699490696,
"charactersPerSecond": 56.85416697288681,
"placement": {
"mps:0/torch.float16": 286
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
393
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 784269312,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 42243584,
"mpsDriverAllocatedBytes": 142704640,
"loadMs": 0,
"totalMs": 299.0106249926612,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "LocalAI Tools",
"actual": "LocalAI Tools"
},
"runtime": {
"durationMs": 23.683417006395757,
"inferenceMs": 23.683417006395757,
"forwardMs": 19.74283400340937,
"charactersPerSecond": 548.9072795741139,
"placement": {
"mps:0/torch.float16": 286
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 784433152,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 42243584,
"mpsDriverAllocatedBytes": 142704640,
"loadMs": 0,
"totalMs": 23.683417006395757,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.46170802670530975,
"inferenceMs": 0.46170802670530975,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float16": 286
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float16",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 784433152,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 42243584,
"mpsDriverAllocatedBytes": 142704640,
"loadMs": 0,
"totalMs": 0.46170802670530975,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.3608330152928829,
"inferenceMs": 0.3608330152928829,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float16": 286
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float16",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 784433152,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 42243584,
"mpsDriverAllocatedBytes": 142704640,
"loadMs": 0,
"totalMs": 0.3608330152928829,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.320708000799641,
"inferenceMs": 0.320708000799641,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float16": 286
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float16",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 784433152,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 42243584,
"mpsDriverAllocatedBytes": 142704640,
"loadMs": 0,
"totalMs": 0.320708000799641,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Invoice 4821",
"actual": "Invoice 4821"
},
"runtime": {
"durationMs": 26.33162500569597,
"inferenceMs": 26.33162500569597,
"forwardMs": 22.753083991119638,
"charactersPerSecond": 455.7257669211148,
"placement": {
"mps:0/torch.float16": 286
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 784465920,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 42243584,
"mpsDriverAllocatedBytes": 142704640,
"loadMs": 0,
"totalMs": 26.33162500569597,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Backup complete",
"actual": "Backup complete"
},
"runtime": {
"durationMs": 26.00129198981449,
"inferenceMs": 26.00129198981449,
"forwardMs": 21.59012501942925,
"charactersPerSecond": 576.894409934551,
"placement": {
"mps:0/torch.float16": 286
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
333
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 785285120,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 42243584,
"mpsDriverAllocatedBytes": 142721024,
"loadMs": 0,
"totalMs": 26.00129198981449,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Corner Cafe",
"actual": "Corner Cafe"
},
"runtime": {
"durationMs": 282.416917005321,
"inferenceMs": 282.416917005321,
"forwardMs": 257.6682500075549,
"charactersPerSecond": 38.94950811247879,
"placement": {
"mps:0/torch.float16": 286
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 514588672,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 42243584,
"mpsDriverAllocatedBytes": 128548864,
"loadMs": 2070.1099580037408,
"totalMs": 2352.5268750090618,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Corner Cafe",
"actual": "Corner Cafe"
},
"runtime": {
"durationMs": 266.4765829977114,
"inferenceMs": 266.4765829977114,
"forwardMs": 243.23399999411777,
"charactersPerSecond": 41.27942454175973,
"placement": {
"mps:0/torch.float16": 286
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 515932160,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 42243584,
"mpsDriverAllocatedBytes": 128548864,
"loadMs": 2025.09008301422,
"totalMs": 2291.5666660119314,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "542979d7cc3791732bb12af35313a6840952d79f",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
}
]PP-OCR 5 Tamil Mobile Text Recognizer Desktop
60 configurations testedQuality criteria
No explicit quality gate recorded. Review per-case evidence; full certification is pending.
| Precision | Device | Result | Platform | Inference / load | |
|---|---|---|---|---|---|
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 28 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 28 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 28 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 28 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 28 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 28 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 30 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 30 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 30 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 31 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 33 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 34 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 34 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 282 ms / 2294 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 284 ms / 2413 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 293 ms / 2378 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 309 ms / 2407 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 369 ms / 2483 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 424 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 454 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 472 ms / 2292 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 75 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 76 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 76 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 77 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 78 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 78 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 80 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 81 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 89 ms / 2092 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 90 ms / 2066 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 91 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 151 ms / 3602 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 200 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 200 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 202 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 212 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 217 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 221 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 226 ms / 2059 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 228 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 229 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 233 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 235 ms / 2055 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 261 ms / 2162 ms |
Test setup & sample details
- Quality gate
- No explicit quality gate recorded. Review the per-case quality evidence; full certification is pending.
- Tested
- 2026-11-11T15:54:13.302695+00:00
- Environment
- { "hardware": "Apple M3 Max", "os": "macOS27.2", "python": "3.13.18", "runtime": "Transformers5.22.1/Torch2.10.0/Pillow12.0.0", "interpreterScope": "Sequential independent helper processes;existing privatevenv based on app-ownedCPython3.13.18,Transformers5.22.1/Torch2.10/Pillow12.0.StrictMPSnoCPUfallback;verifiedlocal snapshot notnetwork transfer.Writable percase caches removed onlyunder their isolated roots.No concurrent builds/uploads launched.Windows/otherMacs unverified." }
- Runtime
- transformers 5.22.1
- Artifact revision
- d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1
- Fixture
{ "file": "research/ppocrv5-tamil-telugu-onboarding/fixtures/ta-0-normal.png", "url": "https://assets.localai.tools/samples/v1/files/a424d59acc5fca60629a5c3e5b53209687b70011d0a59c7fdd8e3e93e4817bab/ta-0-normal.png", "size": 3105, "sha1": "c8b0018962f4c78701b07c0584f4c2a2c9fa8b56" }- Rerun when
- artifact revision; runtime version; fixture checksum; quality gate; backend behavior; adapter preprocessing or inference changes
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "வணக்கம்",
"actual": "வணக்கம்"
},
"runtime": {
"durationMs": 151.48724999744445,
"inferenceMs": 151.48724999744445,
"forwardMs": 125.3716670034919,
"charactersPerSecond": 46.20850929776657,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 388268032,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 3601.7438750131987,
"totalMs": 3753.231125010643,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "வணக்கம்",
"actual": "வணக்கம்"
},
"runtime": {
"durationMs": 79.67075001215562,
"inferenceMs": 79.67075001215562,
"forwardMs": 78.20650000940077,
"charactersPerSecond": 87.86160540640056,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 391462912,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 79.67075001215562,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "விலை 12,500",
"actual": "விலை 12,500"
},
"runtime": {
"durationMs": 76.588083000388,
"inferenceMs": 76.588083000388,
"forwardMs": 74.88124998053536,
"charactersPerSecond": 143.625477607845,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 391479296,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 76.588083000388,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "விலை 12,500",
"actual": "விலை 12,500"
},
"runtime": {
"durationMs": 75.02704201033339,
"inferenceMs": 75.02704201033339,
"forwardMs": 73.33908299915493,
"charactersPerSecond": 146.61380357344999,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 391512064,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 75.02704201033339,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "சென்னை 2026",
"actual": "சென்னை 2026"
},
"runtime": {
"durationMs": 81.22987498063594,
"inferenceMs": 81.22987498063594,
"forwardMs": 79.80054197832942,
"charactersPerSecond": 135.4181574528121,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
340
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 392577024,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 81.22987498063594,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "ரசீது 4821",
"actual": "ரசீது 4821"
},
"runtime": {
"durationMs": 76.39995898352936,
"inferenceMs": 76.39995898352936,
"forwardMs": 75.00237500062212,
"charactersPerSecond": 130.8901226263203,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 392691712,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 76.39995898352936,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "நன்றி",
"actual": "நன்றி"
},
"runtime": {
"durationMs": 78.13270899350755,
"inferenceMs": 78.13270899350755,
"forwardMs": 76.72004101914354,
"charactersPerSecond": 63.99368541561097,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 393641984,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 78.13270899350755,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "தமிழ் உரை",
"actual": "தமிழ் உரை"
},
"runtime": {
"durationMs": 75.61874997918494,
"inferenceMs": 75.61874997918494,
"forwardMs": 74.07104200683534,
"charactersPerSecond": 119.01810070223812,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 393641984,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 75.61874997918494,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Corner Cafe",
"actual": "Corner Cafe"
},
"runtime": {
"durationMs": 77.54904200555757,
"inferenceMs": 77.54904200555757,
"forwardMs": 74.22945901635103,
"charactersPerSecond": 141.84572388672038,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 396722176,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 77.54904200555757,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Espresso 3.20",
"actual": "Espresso 3.20"
},
"runtime": {
"durationMs": 90.54958299384452,
"inferenceMs": 90.54958299384452,
"forwardMs": 87.91587498853914,
"charactersPerSecond": 143.56775117212553,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 396722176,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 90.54958299384452,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.4722920130006969,
"inferenceMs": 0.4722920130006969,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 396722176,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.4722920130006969,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.371750007616356,
"inferenceMs": 0.371750007616356,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 396722176,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.371750007616356,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.32629098859615624,
"inferenceMs": 0.32629098859615624,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 396722176,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.32629098859615624,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "வணக்கம்",
"actual": "வணக்கம்"
},
"runtime": {
"durationMs": 88.59212501556613,
"inferenceMs": 88.59212501556613,
"forwardMs": 80.05249997950159,
"charactersPerSecond": 79.01379494814084,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 390316032,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 2091.662416991312,
"totalMs": 2180.254542006878,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "வணக்கம்",
"actual": "வணக்கம்"
},
"runtime": {
"durationMs": 89.64625000953674,
"inferenceMs": 89.64625000953674,
"forwardMs": 79.9094160029199,
"charactersPerSecond": 78.08469399729856,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 392069120,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 2065.896874992177,
"totalMs": 2155.5431250017136,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "வணக்கம்",
"actual": "வணக்கம்"
},
"runtime": {
"durationMs": 226.08691701316275,
"inferenceMs": 226.08691701316275,
"forwardMs": 218.33750000223517,
"charactersPerSecond": 30.96154387205192,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 387399680,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 2058.944791991962,
"totalMs": 2285.031709005125,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "வணக்கம்",
"actual": "வணக்கம்"
},
"runtime": {
"durationMs": 212.40891702473164,
"inferenceMs": 212.40891702473164,
"forwardMs": 210.37158399121836,
"charactersPerSecond": 32.955301962134484,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 391544832,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 212.40891702473164,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "விலை 12,500",
"actual": "விலை 12,500"
},
"runtime": {
"durationMs": 217.09862499847077,
"inferenceMs": 217.09862499847077,
"forwardMs": 215.27954199700616,
"charactersPerSecond": 50.66821588610929,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 392593408,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 217.09862499847077,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "விலை 12,500",
"actual": "விலை 12,500"
},
"runtime": {
"durationMs": 228.1618750130292,
"inferenceMs": 228.1618750130292,
"forwardMs": 226.49408300640061,
"charactersPerSecond": 48.21138500624543,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 397033472,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 228.1618750130292,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "சென்னை 2026",
"actual": "சென்னை 2026"
},
"runtime": {
"durationMs": 220.88416700717062,
"inferenceMs": 220.88416700717062,
"forwardMs": 219.27104197675362,
"charactersPerSecond": 49.79985731454851,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
340
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 399835136,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 220.88416700717062,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "ரசீது 4821",
"actual": "ரசீது 4821"
},
"runtime": {
"durationMs": 202.14304100954905,
"inferenceMs": 202.14304100954905,
"forwardMs": 200.44324998161756,
"charactersPerSecond": 49.46991966707184,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 399982592,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 202.14304100954905,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "நன்றி",
"actual": "நன்றி"
},
"runtime": {
"durationMs": 199.66466698679142,
"inferenceMs": 199.66466698679142,
"forwardMs": 198.13091700780205,
"charactersPerSecond": 25.04198702482883,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 400015360,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 199.66466698679142,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "தமிழ் உரை",
"actual": "தமிழ் உரை"
},
"runtime": {
"durationMs": 200.24204201763496,
"inferenceMs": 200.24204201763496,
"forwardMs": 198.7007919815369,
"charactersPerSecond": 44.94560637374736,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 400015360,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 200.24204201763496,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Corner Cafe",
"actual": "Corner Cafe"
},
"runtime": {
"durationMs": 233.0646250047721,
"inferenceMs": 233.0646250047721,
"forwardMs": 229.65616700821556,
"charactersPerSecond": 47.197209785804134,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 403079168,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 233.0646250047721,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Espresso 3.20",
"actual": "Espresso 3.20"
},
"runtime": {
"durationMs": 228.61137500149198,
"inferenceMs": 228.61137500149198,
"forwardMs": 225.78091602190398,
"charactersPerSecond": 56.865061941537945,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 403079168,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 228.61137500149198,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.4969160072505474,
"inferenceMs": 0.4969160072505474,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 403079168,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.4969160072505474,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.3663340175990015,
"inferenceMs": 0.3663340175990015,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 403079168,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.3663340175990015,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.3880840085912496,
"inferenceMs": 0.3880840085912496,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 403079168,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.3880840085912496,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "வணக்கம்",
"actual": "வணக்கம்"
},
"runtime": {
"durationMs": 260.620499990182,
"inferenceMs": 260.620499990182,
"forwardMs": 248.18349999259226,
"charactersPerSecond": 26.858976942580117,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 387858432,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 2162.4199590005446,
"totalMs": 2423.0404589907266,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "வணக்கம்",
"actual": "வணக்கம்"
},
"runtime": {
"durationMs": 235.17116700531915,
"inferenceMs": 235.17116700531915,
"forwardMs": 227.5291669939179,
"charactersPerSecond": 29.765553699198477,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 390021120,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 2054.5642499928363,
"totalMs": 2289.7354169981554,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "வணக்கம்",
"actual": "வணக்கம்"
},
"runtime": {
"durationMs": 471.59375000046566,
"inferenceMs": 471.59375000046566,
"forwardMs": 438.77116599469446,
"charactersPerSecond": 14.843284076587292,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 469352448,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22478336,
"mpsDriverAllocatedBytes": 63193088,
"loadMs": 2291.9155420095194,
"totalMs": 2763.509292009985,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "வணக்கம்",
"actual": "வணக்கம்"
},
"runtime": {
"durationMs": 33.45233399886638,
"inferenceMs": 33.45233399886638,
"forwardMs": 30.127417005132884,
"charactersPerSecond": 209.2529627450573,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 470056960,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22478336,
"mpsDriverAllocatedBytes": 63193088,
"loadMs": 0,
"totalMs": 33.45233399886638,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "விலை 12,500",
"actual": "விலை 12,500"
},
"runtime": {
"durationMs": 34.45837498293258,
"inferenceMs": 34.45837498293258,
"forwardMs": 30.282958992756903,
"charactersPerSecond": 319.2257326542055,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 470171648,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22478336,
"mpsDriverAllocatedBytes": 63193088,
"loadMs": 0,
"totalMs": 34.45837498293258,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "விலை 12,500",
"actual": "விலை 12,500"
},
"runtime": {
"durationMs": 29.643290996318683,
"inferenceMs": 29.643290996318683,
"forwardMs": 25.737624993780628,
"charactersPerSecond": 371.07890623095994,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 470286336,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22478336,
"mpsDriverAllocatedBytes": 63193088,
"loadMs": 0,
"totalMs": 29.643290996318683,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "சென்னை 2026",
"actual": "சென்னை 2026"
},
"runtime": {
"durationMs": 454.49687499785796,
"inferenceMs": 454.49687499785796,
"forwardMs": 441.9938749924768,
"charactersPerSecond": 24.20258665156244,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
340
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 531103744,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22478336,
"mpsDriverAllocatedBytes": 73121792,
"loadMs": 0,
"totalMs": 454.49687499785796,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "ரசீது 4821",
"actual": "ரசீது 4821"
},
"runtime": {
"durationMs": 29.978167003719136,
"inferenceMs": 29.978167003719136,
"forwardMs": 26.02458299952559,
"charactersPerSecond": 333.5760988575247,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 531185664,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22478336,
"mpsDriverAllocatedBytes": 73121792,
"loadMs": 0,
"totalMs": 29.978167003719136,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "நன்றி",
"actual": "நன்றி"
},
"runtime": {
"durationMs": 27.94454200193286,
"inferenceMs": 27.94454200193286,
"forwardMs": 24.7020410024561,
"charactersPerSecond": 178.92581669988226,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 531251200,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22478336,
"mpsDriverAllocatedBytes": 73121792,
"loadMs": 0,
"totalMs": 27.94454200193286,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "தமிழ் உரை",
"actual": "தமிழ் உரை"
},
"runtime": {
"durationMs": 27.155957999639213,
"inferenceMs": 27.155957999639213,
"forwardMs": 23.84670899482444,
"charactersPerSecond": 331.41898363959655,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 531283968,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22478336,
"mpsDriverAllocatedBytes": 73121792,
"loadMs": 0,
"totalMs": 27.155957999639213,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Corner Cafe",
"actual": "Corner Cafe"
},
"runtime": {
"durationMs": 28.01858398015611,
"inferenceMs": 28.01858398015611,
"forwardMs": 22.70762500120327,
"charactersPerSecond": 392.5965711825638,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 535117824,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22478336,
"mpsDriverAllocatedBytes": 73121792,
"loadMs": 0,
"totalMs": 28.01858398015611,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Espresso 3.20",
"actual": "Espresso 3.20"
},
"runtime": {
"durationMs": 27.841041010105982,
"inferenceMs": 27.841041010105982,
"forwardMs": 23.478457995224744,
"charactersPerSecond": 466.9365630143337,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 535134208,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22478336,
"mpsDriverAllocatedBytes": 73121792,
"loadMs": 0,
"totalMs": 27.841041010105982,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.4216250090394169,
"inferenceMs": 0.4216250090394169,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 535134208,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22478336,
"mpsDriverAllocatedBytes": 73121792,
"loadMs": 0,
"totalMs": 0.4216250090394169,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.34974998561665416,
"inferenceMs": 0.34974998561665416,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 535134208,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22478336,
"mpsDriverAllocatedBytes": 73121792,
"loadMs": 0,
"totalMs": 0.34974998561665416,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.37141601205803454,
"inferenceMs": 0.37141601205803454,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 535134208,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22478336,
"mpsDriverAllocatedBytes": 73121792,
"loadMs": 0,
"totalMs": 0.37141601205803454,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "வணக்கம்",
"actual": "வணக்கம்"
},
"runtime": {
"durationMs": 282.47174998978153,
"inferenceMs": 282.47174998978153,
"forwardMs": 262.4598749971483,
"charactersPerSecond": 24.781239186761955,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 470745088,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22478336,
"mpsDriverAllocatedBytes": 63193088,
"loadMs": 2293.646042002365,
"totalMs": 2576.1177919921465,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "வணக்கம்",
"actual": "வணக்கம்"
},
"runtime": {
"durationMs": 309.08174999058247,
"inferenceMs": 309.08174999058247,
"forwardMs": 282.35766701982357,
"charactersPerSecond": 22.64772992974605,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 468729856,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22478336,
"mpsDriverAllocatedBytes": 63193088,
"loadMs": 2406.7606249882374,
"totalMs": 2715.84237497882,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "வணக்கம்",
"actual": "வணக்கம்"
},
"runtime": {
"durationMs": 368.60283400164917,
"inferenceMs": 368.60283400164917,
"forwardMs": 342.8037500125356,
"charactersPerSecond": 18.99062989832759,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 480772096,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11296768,
"mpsDriverAllocatedBytes": 46333952,
"loadMs": 2483.258374995785,
"totalMs": 2851.861208997434,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "வணக்கம்",
"actual": "வணக்கம்"
},
"runtime": {
"durationMs": 28.340333985397592,
"inferenceMs": 28.340333985397592,
"forwardMs": 24.824333988362923,
"charactersPerSecond": 246.9977948603839,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 480919552,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11296768,
"mpsDriverAllocatedBytes": 46333952,
"loadMs": 0,
"totalMs": 28.340333985397592,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "விலை 12,500",
"actual": "விலை 12,500"
},
"runtime": {
"durationMs": 29.68037500977516,
"inferenceMs": 29.68037500977516,
"forwardMs": 26.02966598351486,
"charactersPerSecond": 370.6152633306411,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 481001472,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11296768,
"mpsDriverAllocatedBytes": 46333952,
"loadMs": 0,
"totalMs": 29.68037500977516,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "விலை 12,500",
"actual": "விலை 12,500"
},
"runtime": {
"durationMs": 33.715875004418194,
"inferenceMs": 33.715875004418194,
"forwardMs": 30.07241600425914,
"charactersPerSecond": 326.2558067544899,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 481116160,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11296768,
"mpsDriverAllocatedBytes": 46333952,
"loadMs": 0,
"totalMs": 33.715875004418194,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "சென்னை 2026",
"actual": "சென்னை 2026"
},
"runtime": {
"durationMs": 423.7899169966113,
"inferenceMs": 423.7899169966113,
"forwardMs": 410.9917919849977,
"charactersPerSecond": 25.956257001008257,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
340
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 540114944,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11296768,
"mpsDriverAllocatedBytes": 47792128,
"loadMs": 0,
"totalMs": 423.7899169966113,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "ரசீது 4821",
"actual": "ரசீது 4821"
},
"runtime": {
"durationMs": 30.518583982484415,
"inferenceMs": 30.518583982484415,
"forwardMs": 26.87962498748675,
"charactersPerSecond": 327.6692000434659,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 540262400,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11296768,
"mpsDriverAllocatedBytes": 47792128,
"loadMs": 0,
"totalMs": 30.518583982484415,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "நன்றி",
"actual": "நன்றி"
},
"runtime": {
"durationMs": 28.063458012184128,
"inferenceMs": 28.063458012184128,
"forwardMs": 25.132041017059237,
"charactersPerSecond": 178.1676369971649,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 540295168,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11296768,
"mpsDriverAllocatedBytes": 47792128,
"loadMs": 0,
"totalMs": 28.063458012184128,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "தமிழ் உரை",
"actual": "தமிழ் உரை"
},
"runtime": {
"durationMs": 25.530624989187345,
"inferenceMs": 25.530624989187345,
"forwardMs": 22.344375000102445,
"charactersPerSecond": 352.5178096427978,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 540344320,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11296768,
"mpsDriverAllocatedBytes": 47792128,
"loadMs": 0,
"totalMs": 25.530624989187345,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Corner Cafe",
"actual": "Corner Cafe"
},
"runtime": {
"durationMs": 27.721500024199486,
"inferenceMs": 27.721500024199486,
"forwardMs": 22.15304199489765,
"charactersPerSecond": 396.80392440515664,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 543490048,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11296768,
"mpsDriverAllocatedBytes": 47792128,
"loadMs": 0,
"totalMs": 27.721500024199486,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Espresso 3.20",
"actual": "Espresso 3.20"
},
"runtime": {
"durationMs": 26.837082987185568,
"inferenceMs": 26.837082987185568,
"forwardMs": 22.15704199625179,
"charactersPerSecond": 484.4043596767714,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 543506432,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11296768,
"mpsDriverAllocatedBytes": 47792128,
"loadMs": 0,
"totalMs": 26.837082987185568,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.4027090035378933,
"inferenceMs": 0.4027090035378933,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float16",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 543506432,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11296768,
"mpsDriverAllocatedBytes": 47792128,
"loadMs": 0,
"totalMs": 0.4027090035378933,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.46841599396429956,
"inferenceMs": 0.46841599396429956,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float16",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 543522816,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11296768,
"mpsDriverAllocatedBytes": 47792128,
"loadMs": 0,
"totalMs": 0.46841599396429956,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.48954199883155525,
"inferenceMs": 0.48954199883155525,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float16",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 543522816,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11296768,
"mpsDriverAllocatedBytes": 47792128,
"loadMs": 0,
"totalMs": 0.48954199883155525,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "வணக்கம்",
"actual": "வணக்கம்"
},
"runtime": {
"durationMs": 283.80641699186526,
"inferenceMs": 283.80641699186526,
"forwardMs": 258.42275001923554,
"charactersPerSecond": 24.664699530739085,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 481607680,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11296768,
"mpsDriverAllocatedBytes": 46333952,
"loadMs": 2413.2042079872917,
"totalMs": 2697.010624979157,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "வணக்கம்",
"actual": "வணக்கம்"
},
"runtime": {
"durationMs": 292.9472500109114,
"inferenceMs": 292.9472500109114,
"forwardMs": 270.91420799843036,
"charactersPerSecond": 23.895086913221654,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 482869248,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11296768,
"mpsDriverAllocatedBytes": 46333952,
"loadMs": 2378.0804999987595,
"totalMs": 2671.027750009671,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "d1a8d42f3938fc52e2c88b7ca1b8cb62856820d1",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
}
]PP-OCR 5 Thai Mobile Text Recognizer Desktop
60 configurations testedQuality criteria
No explicit quality gate recorded. Review per-case evidence; full certification is pending.
| Precision | Device | Result | Platform | Inference / load | |
|---|---|---|---|---|---|
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 24 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 24 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 25 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 26 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 27 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 28 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 28 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 29 ms / 0 ms |
FP16 | mpsAccelerated | Passed | Very fast | macos · aarch64 | 33 ms / 0 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 236 ms / 2104 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 250 ms / 2062 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 262 ms / 2069 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 264 ms / 2101 ms |
FP16 | mpsAccelerated | Passed | Fast | macos · aarch64 | 278 ms / 2082 ms |
FP32 | mpsAccelerated | Passed | Fast | macos · aarch64 | 369 ms / 2323 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 0 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 1 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 72 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 73 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 73 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 73 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 75 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 75 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 76 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 76 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 77 ms / 0 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 85 ms / 1901 ms |
FP32 | cpu | Passed | Very fast | macos · aarch64 | 87 ms / 2073 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 137 ms / 3115 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 190 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 200 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 207 ms / 2119 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 213 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 219 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 222 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 225 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 228 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 229 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 235 ms / 0 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 254 ms / 2044 ms |
FP32 | cpu | Passed | Fast | macos · aarch64 | 258 ms / 2182 ms |
Test setup & sample details
- Quality gate
- No explicit quality gate recorded. Review the per-case quality evidence; full certification is pending.
- Tested
- 2026-11-11T16:10:00.971130+00:00
- Environment
- { "hardware": "Apple M3 Max", "os": "macOS27.2", "python": "3.13.18", "runtime": "Transformers5.22.1/Torch2.10.0/Pillow12.0.0", "interpreterScope": "Sequential independent helper processes;existing privatevenv based on app-ownedCPython3.13.18,Transformers5.22.1/Torch2.10/Pillow12.0.StrictMPSnoCPUfallback;verifiedlocal snapshot notnetwork transfer.Writable percase caches removed onlyunder their isolated roots.No concurrent builds/uploads launched.Windows/otherMacs unverified." }
- Runtime
- transformers 5.22.1
- Artifact revision
- 4cc4c996b8690bd623683e8d2be06eaf5919584b
- Fixture
{ "file": "research/ppocrv5-indic-thai-onboarding/fixtures/th-0-normal.png", "url": "https://assets.localai.tools/samples/v1/files/58aad3af3dbaf85c5c495a6387c5e5d8243ef1862a236325b50be5f27c152721/th-0-normal.png", "size": 3484, "sha1": "59201a55caa9884bee96a3b48030a0e6902df1c3" }- Rerun when
- artifact revision; runtime version; fixture checksum; quality gate; backend behavior; adapter preprocessing or inference changes
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "สวัสดีครับ",
"actual": "สวัสดีครับ"
},
"runtime": {
"durationMs": 136.58795799710788,
"inferenceMs": 136.58795799710788,
"forwardMs": 112.49404100817628,
"charactersPerSecond": 73.21289626580214,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 385122304,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 3114.7209999908227,
"totalMs": 3251.3089579879306,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "สวัสดีครับ",
"actual": "สวัสดีครับ"
},
"runtime": {
"durationMs": 72.91579199954867,
"inferenceMs": 72.91579199954867,
"forwardMs": 71.53087499318644,
"charactersPerSecond": 137.14450225078673,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 385695744,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 72.91579199954867,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "ราคา 12,500",
"actual": "ราคา 12,500"
},
"runtime": {
"durationMs": 75.56300002033822,
"inferenceMs": 75.56300002033822,
"forwardMs": 74.14662497467361,
"charactersPerSecond": 145.5738919449901,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 390512640,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 75.56300002033822,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "ราคา 12,500",
"actual": "ราคา 12,500"
},
"runtime": {
"durationMs": 73.18899998790585,
"inferenceMs": 73.18899998790585,
"forwardMs": 71.67795900022611,
"charactersPerSecond": 150.2958095044023,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 390643712,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 73.18899998790585,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "กรุงเทพ 2026",
"actual": "กรุงเทพ 2026"
},
"runtime": {
"durationMs": 72.33175000874326,
"inferenceMs": 72.33175000874326,
"forwardMs": 70.76241698814556,
"charactersPerSecond": 165.90224899230938,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 390643712,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 72.33175000874326,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "ใบเสร็จ 4821",
"actual": "ใบเสร็จ 4821"
},
"runtime": {
"durationMs": 72.57970899809152,
"inferenceMs": 72.57970899809152,
"forwardMs": 71.15275002433918,
"charactersPerSecond": 165.3354658712608,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 390725632,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 72.57970899809152,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "ขอบคุณ",
"actual": "ขอบคุณ"
},
"runtime": {
"durationMs": 76.64829201530665,
"inferenceMs": 76.64829201530665,
"forwardMs": 75.24633299908601,
"charactersPerSecond": 78.27963079466664,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 390742016,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 76.64829201530665,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "ภาษาไทย",
"actual": "ภาษาไทย"
},
"runtime": {
"durationMs": 74.51333399512805,
"inferenceMs": 74.51333399512805,
"forwardMs": 72.91912499931641,
"charactersPerSecond": 93.94291765897476,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 394838016,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 74.51333399512805,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Corner Cafe",
"actual": "Corner Cafe"
},
"runtime": {
"durationMs": 75.83191699814051,
"inferenceMs": 75.83191699814051,
"forwardMs": 72.7643340069335,
"charactersPerSecond": 145.05765428915285,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 397901824,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 75.83191699814051,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Espresso 3.20",
"actual": "Espresso 3.20"
},
"runtime": {
"durationMs": 74.99100000131875,
"inferenceMs": 74.99100000131875,
"forwardMs": 72.41466699633747,
"charactersPerSecond": 173.35413582658438,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 398163968,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 74.99100000131875,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.4414580180309713,
"inferenceMs": 0.4414580180309713,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 398163968,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.4414580180309713,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.46716700308024883,
"inferenceMs": 0.46716700308024883,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 398213120,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.46716700308024883,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.36837501102127135,
"inferenceMs": 0.36837501102127135,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 398213120,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.36837501102127135,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "สวัสดีครับ",
"actual": "สวัสดีครับ"
},
"runtime": {
"durationMs": 85.1083750021644,
"inferenceMs": 85.1083750021644,
"forwardMs": 76.52579201385379,
"charactersPerSecond": 117.49724982700809,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 389644288,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 1901.282834005542,
"totalMs": 1986.3912090077065,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "สวัสดีครับ",
"actual": "สวัสดีครับ"
},
"runtime": {
"durationMs": 87.48091699089855,
"inferenceMs": 87.48091699089855,
"forwardMs": 79.71491699572653,
"charactersPerSecond": 114.31064446935773,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 389840896,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 2072.5552499934565,
"totalMs": 2160.036166984355,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "สวัสดีครับ",
"actual": "สวัสดีครับ"
},
"runtime": {
"durationMs": 253.99854098213837,
"inferenceMs": 253.99854098213837,
"forwardMs": 245.39716602885164,
"charactersPerSecond": 39.37030488967737,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 390348800,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 2044.193332985742,
"totalMs": 2298.1918739678804,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "สวัสดีครับ",
"actual": "สวัสดีครับ"
},
"runtime": {
"durationMs": 235.3176249889657,
"inferenceMs": 235.3176249889657,
"forwardMs": 233.83675000513904,
"charactersPerSecond": 42.4957544105288,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 390840320,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 235.3176249889657,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "ราคา 12,500",
"actual": "ราคา 12,500"
},
"runtime": {
"durationMs": 222.18424998573028,
"inferenceMs": 222.18424998573028,
"forwardMs": 220.29595798812807,
"charactersPerSecond": 49.50845976124083,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 390905856,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 222.18424998573028,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "ราคา 12,500",
"actual": "ราคา 12,500"
},
"runtime": {
"durationMs": 224.63124999194406,
"inferenceMs": 224.63124999194406,
"forwardMs": 222.79983400949277,
"charactersPerSecond": 48.96914387643969,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 390971392,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 224.63124999194406,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "กรุงเทพ 2026",
"actual": "กรุงเทพ 2026"
},
"runtime": {
"durationMs": 228.816666000057,
"inferenceMs": 228.816666000057,
"forwardMs": 227.09633299382403,
"charactersPerSecond": 52.44373239839536,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 390971392,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 228.816666000057,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "ใบเสร็จ 4821",
"actual": "ใบเสร็จ 4821"
},
"runtime": {
"durationMs": 213.27199999359436,
"inferenceMs": 213.27199999359436,
"forwardMs": 211.5544169791974,
"charactersPerSecond": 56.26617652744111,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 395214848,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 213.27199999359436,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "ขอบคุณ",
"actual": "ขอบคุณ"
},
"runtime": {
"durationMs": 218.53183399070986,
"inferenceMs": 218.53183399070986,
"forwardMs": 217.16254198690876,
"charactersPerSecond": 27.455954084268885,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 395231232,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 218.53183399070986,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "ภาษาไทย",
"actual": "ภาษาไทย"
},
"runtime": {
"durationMs": 189.70620800973848,
"inferenceMs": 189.70620800973848,
"forwardMs": 188.09954202151857,
"charactersPerSecond": 36.899161463607236,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 395264000,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 189.70620800973848,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Corner Cafe",
"actual": "Corner Cafe"
},
"runtime": {
"durationMs": 200.35162498243153,
"inferenceMs": 200.35162498243153,
"forwardMs": 197.5087919854559,
"charactersPerSecond": 54.90347283664193,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 398344192,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 200.35162498243153,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Espresso 3.20",
"actual": "Espresso 3.20"
},
"runtime": {
"durationMs": 227.98441699706018,
"inferenceMs": 227.98441699706018,
"forwardMs": 225.17945797881112,
"charactersPerSecond": 57.021441075806656,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 398606336,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 227.98441699706018,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.5225829954724759,
"inferenceMs": 0.5225829954724759,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 398606336,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.5225829954724759,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.3358340181875974,
"inferenceMs": 0.3358340181875974,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 398606336,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.3358340181875974,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.31254198984242976,
"inferenceMs": 0.31254198984242976,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 398606336,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 0,
"totalMs": 0.31254198984242976,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "สวัสดีครับ",
"actual": "สวัสดีครับ"
},
"runtime": {
"durationMs": 258.21404199814424,
"inferenceMs": 258.21404199814424,
"forwardMs": 249.5109580049757,
"charactersPerSecond": 38.727560757799026,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 386793472,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 2181.57237500418,
"totalMs": 2439.786417002324,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "cpu",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "สวัสดีครับ",
"actual": "สวัสดีครับ"
},
"runtime": {
"durationMs": 207.49633299419656,
"inferenceMs": 207.49633299419656,
"forwardMs": 199.6402090007905,
"charactersPerSecond": 48.193622777322474,
"placement": {
"cpu/torch.float32": 582
},
"inputPlacement": "cpu",
"outputPlacement": "cpu",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "cpu",
"fallback": false,
"peakRssBytes": 386695168,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"loadMs": 2118.7599590048194,
"totalMs": 2326.256291999016,
"requestedDevice": "cpu",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "cpu"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "สวัสดีครับ",
"actual": "สวัสดีครับ"
},
"runtime": {
"durationMs": 369.4275839952752,
"inferenceMs": 369.4275839952752,
"forwardMs": 346.38520900625736,
"charactersPerSecond": 27.06890452481181,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 468697088,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22483712,
"mpsDriverAllocatedBytes": 63193088,
"loadMs": 2322.5154999818187,
"totalMs": 2691.943083977094,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "สวัสดีครับ",
"actual": "สวัสดีครับ"
},
"runtime": {
"durationMs": 29.133958014426753,
"inferenceMs": 29.133958014426753,
"forwardMs": 24.624000012408942,
"charactersPerSecond": 343.2420680721834,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 469254144,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22483712,
"mpsDriverAllocatedBytes": 63193088,
"loadMs": 0,
"totalMs": 29.133958014426753,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "ราคา 12,500",
"actual": "ราคา 12,500"
},
"runtime": {
"durationMs": 26.153957995120436,
"inferenceMs": 26.153957995120436,
"forwardMs": 23.1764999916777,
"charactersPerSecond": 420.58643674706053,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 469254144,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22483712,
"mpsDriverAllocatedBytes": 63193088,
"loadMs": 0,
"totalMs": 26.153957995120436,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "ราคา 12,500",
"actual": "ราคา 12,500"
},
"runtime": {
"durationMs": 26.52483299607411,
"inferenceMs": 26.52483299607411,
"forwardMs": 22.40604200051166,
"charactersPerSecond": 414.70572130003944,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 469434368,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22483712,
"mpsDriverAllocatedBytes": 63193088,
"loadMs": 0,
"totalMs": 26.52483299607411,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "กรุงเทพ 2026",
"actual": "กรุงเทพ 2026"
},
"runtime": {
"durationMs": 25.618541025323793,
"inferenceMs": 25.618541025323793,
"forwardMs": 22.842250007670373,
"charactersPerSecond": 468.410749391937,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 469434368,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22483712,
"mpsDriverAllocatedBytes": 63193088,
"loadMs": 0,
"totalMs": 25.618541025323793,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "ใบเสร็จ 4821",
"actual": "ใบเสร็จ 4821"
},
"runtime": {
"durationMs": 26.739666995126754,
"inferenceMs": 26.739666995126754,
"forwardMs": 22.81108300667256,
"charactersPerSecond": 448.7714825389177,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 469434368,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22483712,
"mpsDriverAllocatedBytes": 63193088,
"loadMs": 0,
"totalMs": 26.739666995126754,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "ขอบคุณ",
"actual": "ขอบคุณ"
},
"runtime": {
"durationMs": 23.776083980919793,
"inferenceMs": 23.776083980919793,
"forwardMs": 21.19208298972808,
"charactersPerSecond": 252.35442492611375,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 469467136,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22483712,
"mpsDriverAllocatedBytes": 63193088,
"loadMs": 0,
"totalMs": 23.776083980919793,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "ภาษาไทย",
"actual": "ภาษาไทย"
},
"runtime": {
"durationMs": 23.604000016348436,
"inferenceMs": 23.604000016348436,
"forwardMs": 20.881292002741247,
"charactersPerSecond": 296.55990489542916,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 469483520,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22483712,
"mpsDriverAllocatedBytes": 63193088,
"loadMs": 0,
"totalMs": 23.604000016348436,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Corner Cafe",
"actual": "Corner Cafe"
},
"runtime": {
"durationMs": 27.736415999243036,
"inferenceMs": 27.736415999243036,
"forwardMs": 22.604167024837807,
"charactersPerSecond": 396.59053283236756,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 473563136,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22483712,
"mpsDriverAllocatedBytes": 63193088,
"loadMs": 0,
"totalMs": 27.736415999243036,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Espresso 3.20",
"actual": "Espresso 3.20"
},
"runtime": {
"durationMs": 27.132624993100762,
"inferenceMs": 27.132624993100762,
"forwardMs": 22.846250009024516,
"charactersPerSecond": 479.1279871853762,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 473759744,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22483712,
"mpsDriverAllocatedBytes": 63193088,
"loadMs": 0,
"totalMs": 27.132624993100762,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.40179200004786253,
"inferenceMs": 0.40179200004786253,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 473759744,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22483712,
"mpsDriverAllocatedBytes": 63193088,
"loadMs": 0,
"totalMs": 0.40179200004786253,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.31575001776218414,
"inferenceMs": 0.31575001776218414,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 473759744,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22483712,
"mpsDriverAllocatedBytes": 63193088,
"loadMs": 0,
"totalMs": 0.31575001776218414,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.32970900065265596,
"inferenceMs": 0.32970900065265596,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float32",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 473759744,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22483712,
"mpsDriverAllocatedBytes": 63193088,
"loadMs": 0,
"totalMs": 0.32970900065265596,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "สวัสดีครับ",
"actual": "สวัสดีครับ"
},
"runtime": {
"durationMs": 261.5021249803249,
"inferenceMs": 261.5021249803249,
"forwardMs": 240.9228750038892,
"charactersPerSecond": 38.2406070342732,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 466944000,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22483712,
"mpsDriverAllocatedBytes": 63193088,
"loadMs": 2069.2256249894854,
"totalMs": 2330.7277499698102,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp32",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "สวัสดีครับ",
"actual": "สวัสดีครับ"
},
"runtime": {
"durationMs": 236.49141698842868,
"inferenceMs": 236.49141698842868,
"forwardMs": 217.44320800644346,
"charactersPerSecond": 42.2848326900984,
"placement": {
"mps:0/torch.float32": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float32",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp32",
"device": "mps",
"fallback": false,
"peakRssBytes": 465616896,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 22483712,
"mpsDriverAllocatedBytes": 63193088,
"loadMs": 2104.3973329942673,
"totalMs": 2340.888749982696,
"requestedDevice": "mps",
"requestedPrecision": "fp32",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "สวัสดีครับ",
"actual": "สวัสดีครับ"
},
"runtime": {
"durationMs": 278.37270800955594,
"inferenceMs": 278.37270800955594,
"forwardMs": 257.2727080259938,
"charactersPerSecond": 35.92306182420987,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 479526912,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11299584,
"mpsDriverAllocatedBytes": 46333952,
"loadMs": 2081.7496250092518,
"totalMs": 2360.1223330188077,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "สวัสดีครับ",
"actual": "สวัสดีครับ"
},
"runtime": {
"durationMs": 28.402124997228384,
"inferenceMs": 28.402124997228384,
"forwardMs": 24.25708298687823,
"charactersPerSecond": 352.0863316028589,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 479805440,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11299584,
"mpsDriverAllocatedBytes": 46333952,
"loadMs": 0,
"totalMs": 28.402124997228384,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "ราคา 12,500",
"actual": "ราคา 12,500"
},
"runtime": {
"durationMs": 25.832375016761944,
"inferenceMs": 25.832375016761944,
"forwardMs": 21.91316700191237,
"charactersPerSecond": 425.8222479683882,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 480100352,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11299584,
"mpsDriverAllocatedBytes": 46333952,
"loadMs": 0,
"totalMs": 25.832375016761944,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "ราคา 12,500",
"actual": "ราคา 12,500"
},
"runtime": {
"durationMs": 32.93225000379607,
"inferenceMs": 32.93225000379607,
"forwardMs": 27.549541991902515,
"charactersPerSecond": 334.01908459737916,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 480542720,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11299584,
"mpsDriverAllocatedBytes": 46333952,
"loadMs": 0,
"totalMs": 32.93225000379607,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "กรุงเทพ 2026",
"actual": "กรุงเทพ 2026"
},
"runtime": {
"durationMs": 27.036917017539963,
"inferenceMs": 27.036917017539963,
"forwardMs": 23.81829099613242,
"charactersPerSecond": 443.83758666770717,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 480542720,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11299584,
"mpsDriverAllocatedBytes": 46333952,
"loadMs": 0,
"totalMs": 27.036917017539963,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "ใบเสร็จ 4821",
"actual": "ใบเสร็จ 4821"
},
"runtime": {
"durationMs": 25.60937500675209,
"inferenceMs": 25.60937500675209,
"forwardMs": 21.146457991562784,
"charactersPerSecond": 468.57840134076355,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 480542720,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11299584,
"mpsDriverAllocatedBytes": 46333952,
"loadMs": 0,
"totalMs": 25.60937500675209,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "ขอบคุณ",
"actual": "ขอบคุณ"
},
"runtime": {
"durationMs": 25.111458002356812,
"inferenceMs": 25.111458002356812,
"forwardMs": 22.17275000293739,
"charactersPerSecond": 238.93475239218986,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 480591872,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11299584,
"mpsDriverAllocatedBytes": 46333952,
"loadMs": 0,
"totalMs": 25.111458002356812,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "ภาษาไทย",
"actual": "ภาษาไทย"
},
"runtime": {
"durationMs": 25.82612499827519,
"inferenceMs": 25.82612499827519,
"forwardMs": 22.268875007284805,
"charactersPerSecond": 271.04337179764667,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 480624640,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11299584,
"mpsDriverAllocatedBytes": 46333952,
"loadMs": 0,
"totalMs": 25.82612499827519,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Corner Cafe",
"actual": "Corner Cafe"
},
"runtime": {
"durationMs": 27.366833004634827,
"inferenceMs": 27.366833004634827,
"forwardMs": 22.879957978148013,
"charactersPerSecond": 401.9463997948556,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 484868096,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11299584,
"mpsDriverAllocatedBytes": 46333952,
"loadMs": 0,
"totalMs": 27.366833004634827,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "Espresso 3.20",
"actual": "Espresso 3.20"
},
"runtime": {
"durationMs": 26.729625009465963,
"inferenceMs": 26.729625009465963,
"forwardMs": 22.018791001755744,
"charactersPerSecond": 486.3517537337771,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 485539840,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11299584,
"mpsDriverAllocatedBytes": 46333952,
"loadMs": 0,
"totalMs": 26.729625009465963,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.4818339948542416,
"inferenceMs": 0.4818339948542416,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float16",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 485539840,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11299584,
"mpsDriverAllocatedBytes": 46333952,
"loadMs": 0,
"totalMs": 0.4818339948542416,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.31162501545622945,
"inferenceMs": 0.31162501545622945,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float16",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 485539840,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11299584,
"mpsDriverAllocatedBytes": 46333952,
"loadMs": 0,
"totalMs": 0.31162501545622945,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "",
"actual": ""
},
"runtime": {
"durationMs": 0.29633400845341384,
"inferenceMs": 0.29633400845341384,
"forwardMs": 0,
"charactersPerSecond": 0,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": null,
"outputPlacement": null,
"parameterDtype": "torch.float16",
"modelInputShape": null,
"neuralExecuted": false,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 485539840,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11299584,
"mpsDriverAllocatedBytes": 46333952,
"loadMs": 0,
"totalMs": 0.29633400845341384,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "สวัสดีครับ",
"actual": "สวัสดีครับ"
},
"runtime": {
"durationMs": 250.08779097697698,
"inferenceMs": 250.08779097697698,
"forwardMs": 230.79095801222138,
"charactersPerSecond": 39.98595837459573,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 478887936,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11299584,
"mpsDriverAllocatedBytes": 46333952,
"loadMs": 2061.8205840000883,
"totalMs": 2311.9083749770653,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
},
{
"precision": "fp16",
"device": "mps",
"status": "pass",
"quality": {
"passed": true,
"metric": "characterErrorRate",
"score": 0,
"expected": "สวัสดีครับ",
"actual": "สวัสดีครับ"
},
"runtime": {
"durationMs": 264.24591601244174,
"inferenceMs": 264.24591601244174,
"forwardMs": 242.85016700741835,
"charactersPerSecond": 37.84353662264041,
"placement": {
"mps:0/torch.float16": 582
},
"inputPlacement": "mps",
"outputPlacement": "mps:0",
"parameterDtype": "torch.float16",
"modelInputShape": [
1,
3,
48,
320
],
"neuralExecuted": true,
"precision": "fp16",
"device": "mps",
"fallback": false,
"peakRssBytes": 480722944,
"resourceScope": "Whole isolated helper process high-water RSS,including imports/runtime;not validated minimumRAM.",
"mpsAllocatedBytes": 11299584,
"mpsDriverAllocatedBytes": 46333952,
"loadMs": 2101.4293750049546,
"totalMs": 2365.6752910173964,
"requestedDevice": "mps",
"requestedPrecision": "fp16",
"artifactRevision": "4cc4c996b8690bd623683e8d2be06eaf5919584b",
"runtimeVersion": "5.22.1",
"grade": "good",
"engine": "transformers",
"version": "5.22.1",
"torchVersion": "2.10.0",
"acceleration": "partial"
}
}
]Release validation still required
- Fixture/output publication,complete dependency backup and forced model/runtime source recovery deferred by user scope