Repository navigation

[case] domux-4057-full-eval - 97.58% accuracy on full 4057-sample official eval - #22

Merged

FenjuFu merged 16 commits into

iflytek:mainfrom

gebibd00-jpg:case/domux-4057-full-eval

Sep 27, 2026

Merged

[case] domux-4057-full-eval - 97.58% accuracy on full 4057-sample official eval#22
FenjuFu merged 16 commits into
iflytek:mainfrom
gebibd00-jpg:case/domux-4057-full-eval

Commits on Aug 24, 2026
- add Domux 4057-sample eval case
  gebibd00-jpg
  committed
  db4144e
- add evidence preview
  gebibd00-jpg
  committed
  cbd8b3e
Commits on Aug 25, 2026
- docs: document vLLM heterogeneous Gemma-4 load failure in gotchas
  gebibd00-jpg
  committed
  9be21f7
Commits on Aug 26, 2026
- docs: note high-risk-device coverage boundary of the official test set
  gebibd00-jpg
  committed
  c86c2c5
- docs: spell out full GPU model and VRAM per review feedback
  gebibd00-jpg
  committed
  6a3c293
- docs: add reproduction runbook
  gebibd00-jpg
  committed
  5620b99
- feat: add eval script (official-metrics, local transformers)
  gebibd00-jpg
  committed
  4646f60
- data: add eval summary
  gebibd00-jpg
  committed
  08b14ad
- data: add environment/method metadata
  gebibd00-jpg
  committed
  cf9483a
- data: add eval console log
  gebibd00-jpg
  committed
  85ac81a
- data: add pinned revision
  gebibd00-jpg
  committed
  57176b3
- docs: reference reproduction kit
  gebibd00-jpg
  committed
  adde985
- data: add failure cluster analysis
  gebibd00-jpg
  committed
  788c7f4
Commits on Aug 27, 2026
- docs: add NF4 4-bit quantization comparison (4057 full run)
  gebibd00-jpg
  committed
  88a2e75
- data: add BF16 vs NF4 quantization comparison
  gebibd00-jpg
  committed
  9ea41fd
- data: add 4-bit eval summary
  gebibd00-jpg
  committed
  878e7a2