Show combined averages with clear test hardware #9

Merged
kleb merged 2 commits from feat/combined-dataset-averages into main 2026-11-03 19:05:28 +01:00
Owner

Dataset-specific rankings and repeated runs made the benchmark site harder to scan. Each suite now has one combined ranking per engine, averaging only the newest run per model and dataset. Older measurements remain archived; missing metrics are excluded rather than counted as zero.

The dataset selector, best-run toggle and run-count labels are removed. Hardware labels identify the CPU, shared-memory iGPU and RTX 5050 with 8 GB VRAM without machine names. The seven RTX 4070 Ti runs are excluded from pages, downloads and public evidence routes, while their original records remain unchanged. Source runs and metric coverage remain available in average details and exports. Coverage, protocols and precision can differ between models; the averages are not a pooled evaluation.

decision-desktop.png

decision-mobile.png

Proven with 60 Bun tests, type checks, a production build verifying 355 published results and excluded evidence, plus desktop/mobile browser checks of every populated engine, newest-run selection, computed means, exports and hardware labels.

Dataset-specific rankings and repeated runs made the benchmark site harder to scan. Each suite now has one combined ranking per engine, averaging only the newest run per model and dataset. Older measurements remain archived; missing metrics are excluded rather than counted as zero. The dataset selector, best-run toggle and run-count labels are removed. Hardware labels identify the CPU, shared-memory iGPU and RTX 5050 with 8 GB VRAM without machine names. The seven RTX 4070 Ti runs are excluded from pages, downloads and public evidence routes, while their original records remain unchanged. Source runs and metric coverage remain available in average details and exports. Coverage, protocols and precision can differ between models; the averages are not a pooled evaluation. ![decision-desktop.png](https://git.kleb.sh/attachments/80a6a921-b873-443a-a02a-8d45347c40bf) ![decision-mobile.png](https://git.kleb.sh/attachments/343aaf6f-095c-49fa-86b2-1bb151a7a34c) Proven with 60 Bun tests, type checks, a production build verifying 355 published results and excluded evidence, plus desktop/mobile browser checks of every populated engine, newest-run selection, computed means, exports and hardware labels.
First-time contributor

kReview review

Verdict: no findings

No specific defects were verified in the reviewed changes.

kReview checked only the PR diff, metadata, and supplied repository context at b64592fc0c. It reports only issues supported by this material.

Estimated cost: ~$0.10 total (164.6k in / 1.2k out); this run ~$0.05 (83.6k in / 326 out) / gpt-6.1-terra.

Run time: 1:55 total; this run 0:12.

<!-- codex-forgejo-review --> <!-- codex-forgejo-review-head:b64592fc0c7e76e6b20df06b7096a2ab0bce330a --> <!-- codex-forgejo-review-comparison:v1:38c46f55b8473c5db283be190a1635b0e6e74f4a3e49d66ca13a070ce88d891d --> ## kReview review **Verdict:** no findings No specific defects were verified in the reviewed changes. _kReview checked only the PR diff, metadata, and supplied repository context at `b64592fc0c`. It reports only issues supported by this material._ _Estimated cost: ~$0.10 total (164.6k in / 1.2k out); this run ~$0.05 (83.6k in / 326 out) / gpt-6.1-terra._ _Run time: 1:55 total; this run 0:12._ <!-- codex-forgejo-review-state:eyJoZWFkU2hhIjoiYjY0NTkyZmMwYzdlNzZlNmIyMGRmMDZiNzA5NmEyYWIwYmNlMzMwYSIsImNvbXBhcmlzb25LZXkiOiJ2MTozOGM0NmY1NWI4NDczYzVkYjI4M2JlMTkwYTE2MzViMGU2ZTc0ZjRhM2U0OWQ2NmNhMTNhMDcwY2U4OGQ4OTFkIiwic3VtbWFyeSI6Ik5vIHNwZWNpZmljIGRlZmVjdHMgd2VyZSB2ZXJpZmllZCBpbiB0aGUgcmV2aWV3ZWQgY2hhbmdlcy4iLCJmaW5kaW5ncyI6W10sImN1bXVsYXRpdmVDb3N0Ijp7InVzZCI6MC4xMDQzNjI0LCJpbnB1dFRva2VucyI6MTY0NjMxLCJvdXRwdXRUb2tlbnMiOjEyMjUsIm1vZGVsIjoiZ3B0LTYuMS10ZXJyYSJ9LCJjdW11bGF0aXZlRHVyYXRpb25NcyI6MTE1NDQzfQ== -->
kleb merged commit b717472883 into main 2026-11-03 19:05:28 +01:00
Sign in to join this conversation.
No reviewers
No labels
No milestone
No project
No assignees
2 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
kleb/benchmark!9
No description provided.