RuBERT Tiny Russian Toxicity
12 configurations testedQuality criteria
The sourced toxic and safe examples must cross their respective aggregate-toxicity thresholds; every score must be finite and within zero to one.
| Precision | Device | Result | |
|---|---|---|---|
Q4 | GPU · WebGPUAccelerated | Passed | Very fast |
FP32 | GPU · WebGPUAccelerated | Passed | Very fast |
BNB4 | GPU · WebGPUAccelerated | Passed | Very fast |
INT8 | GPU · WebGPUAccelerated | Passed | Very fast |
Q8 | GPU · WebGPUAccelerated | Passed | Fast |
UINT8 | GPU · WebGPUAccelerated | Passed | Fast |
FP32 | CPU · WASM | Passed | Very fast |
INT8 | CPU · WASM | Passed | Very fast |
Q8 | CPU · WASM | Passed | Very fast |
Q4 | CPU · WASM | Passed | Very fast |
BNB4 | CPU · WASM | Passed | Very fast |
UINT8 | CPU · WASM | Passed | Very fast |
Test setup & sample details
- Quality gate
- The sourced toxic and safe examples must cross their respective aggregate-toxicity thresholds; every score must be finite and within zero to one.
- Tested
- 2026-09-15T13:09:47.219Z
- Environment
- Isolated headless Chrome on macOS; Transformers.js 4.2.0
- Runtime
- Transformers.js 4.2.0
- Artifact revision
- 3c117322c91030ff04846b72e15509ae7f5232f1
- Fixture
{ "file": "rubert-tiny-toxicity.json", "url": "https://f005.backblazeb2.com/file/hubters-webai-public/assets/benchmarks/rubert-tiny-toxicity.json", "size": 700, "sha1": "f136212c8f17ea8b87f6c567580ddae3ad924bcc", "source": "Russian examples from the pinned source model card and widget metadata.", "sourceUrl": "https://huggingface.co/cointegrated/rubert-tiny-toxicity/blob/5d37eff844868e243467e4c38898bad46c271af2/README.md", "license": "MIT", "licenseUrl": "https://huggingface.co/cointegrated/rubert-tiny-toxicity/blob/5d37eff844868e243467e4c38898bad46c271af2/README.md", "preprocessing": "Pinned tokenizer truncates each Russian string to max_length." }- Rerun when
- artifact revision change; runtime version change; fixture or quality-gate change; browser/backend behavior change
Per-case quality & failure details
[
{
"precision": "fp32",
"device": "wasm",
"status": "pass",
"quality": {
"grade": "toxicity-regression-pass"
},
"runtime": {
"loadMs": 12711,
"inferenceMs": 23.5,
"totalMs": 13994.5,
"textsPerSecond": 85.1063829787234,
"grade": "excellent"
}
},
{
"precision": "fp32",
"device": "webgpu",
"status": "pass",
"quality": {
"grade": "toxicity-regression-pass"
},
"runtime": {
"loadMs": 10926.9,
"inferenceMs": 67.5,
"totalMs": 12316.299999982119,
"textsPerSecond": 29.62962962962963,
"grade": "excellent"
}
},
{
"precision": "int8",
"device": "wasm",
"status": "pass",
"quality": {
"grade": "toxicity-regression-pass"
},
"runtime": {
"loadMs": 7104.7,
"inferenceMs": 27,
"totalMs": 8447.59999999404,
"textsPerSecond": 74.07407407407408,
"grade": "excellent"
}
},
{
"precision": "int8",
"device": "webgpu",
"status": "pass",
"quality": {
"grade": "toxicity-regression-pass"
},
"runtime": {
"loadMs": 6963.3,
"inferenceMs": 92.1,
"totalMs": 8382.09999999404,
"textsPerSecond": 21.715526595898602,
"grade": "excellent"
}
},
{
"precision": "uint8",
"device": "wasm",
"status": "pass",
"quality": {
"grade": "toxicity-regression-pass"
},
"runtime": {
"loadMs": 7128.8,
"inferenceMs": 30.2,
"totalMs": 8386.59999999404,
"textsPerSecond": 66.22516558905515,
"grade": "excellent"
}
},
{
"precision": "uint8",
"device": "webgpu",
"status": "pass",
"quality": {
"grade": "toxicity-regression-pass"
},
"runtime": {
"loadMs": 7330.5,
"inferenceMs": 104.9,
"totalMs": 8656.799999982119,
"textsPerSecond": 19.065776934743216,
"grade": "good"
}
},
{
"precision": "q8",
"device": "wasm",
"status": "pass",
"quality": {
"grade": "toxicity-regression-pass"
},
"runtime": {
"loadMs": 6940.3,
"inferenceMs": 27.7,
"totalMs": 8171.299999982119,
"textsPerSecond": 72.20216601837274,
"grade": "excellent"
}
},
{
"precision": "q8",
"device": "webgpu",
"status": "pass",
"quality": {
"grade": "toxicity-regression-pass"
},
"runtime": {
"loadMs": 7364.6,
"inferenceMs": 103.8,
"totalMs": 8777.299999982119,
"textsPerSecond": 19.267822739350052,
"grade": "good"
}
},
{
"precision": "q4",
"device": "wasm",
"status": "pass",
"quality": {
"grade": "toxicity-regression-pass"
},
"runtime": {
"loadMs": 9238.1,
"inferenceMs": 28.2,
"totalMs": 10615.399999976158,
"textsPerSecond": 70.92198577063178,
"grade": "excellent"
}
},
{
"precision": "q4",
"device": "webgpu",
"status": "pass",
"quality": {
"grade": "toxicity-regression-pass"
},
"runtime": {
"loadMs": 9954.1,
"inferenceMs": 65.8,
"totalMs": 11337.59999999404,
"textsPerSecond": 30.39513677260884,
"grade": "excellent"
}
},
{
"precision": "bnb4",
"device": "wasm",
"status": "pass",
"quality": {
"grade": "toxicity-regression-pass"
},
"runtime": {
"loadMs": 9791.5,
"inferenceMs": 29.4,
"totalMs": 11250.299999982119,
"textsPerSecond": 68.02721093952024,
"grade": "excellent"
}
},
{
"precision": "bnb4",
"device": "webgpu",
"status": "pass",
"quality": {
"grade": "toxicity-regression-pass"
},
"runtime": {
"loadMs": 11344.1,
"inferenceMs": 88.4,
"totalMs": 12691.300000011921,
"textsPerSecond": 22.624434387614794,
"grade": "excellent"
}
}
]