noonghunnaandClaude Opus 4.8
6cfcbc6bc0
consolidate(gemma-31b): single bf16 dual slug on v0.24.0, retire v0.22.0 composes
vllm/gemma-31b-dual now serves cyankiwi QAT-AWQ-int4 + bf16 KV @224K on stock
vLLM v0.24.0 (base.yml), OVERLAY-FREE — folds onto vllm-stable, retiring the
31b's vllm-gemma-stable dependence. Promoted to ⚠️ Production w/ caveats
(validated 2026-07-02: verify-full 9/9, verify-stress→210K @ 1162MB VRAM
margin, bench ~59 TPS, soak PASS).
bf16 not int8-PTH: on v0.24.0 int8-PTH allocates 262K but silently craters
recall past ~32K (needs PR #40391, open/unmerged upstream — the same cyankiwi
weights recall clean to 112K+ on v0.22.0+#40391). int8-PTH 262K returns free
when #40391 merges. MTP disabled (Gemma-4 MTP x tools broken on v0.24.0,
vLLM #39043 / #42006 closed-unmerged).
- remove the broken #537 int8.yml (recall cliff); base.yml replaces it
- DEFAULTS (gemma-4-31b,vllm,dual) -> vllm/gemma-31b-dual
- deprecate gemma-int8-mtp / gemma-bf16-mtp / qat-w4a16 (registry + header)
- fix 2 false "gemma int8-PTH native @262K" claims in vllm-stable.yml
- repoint launch/preflight/setup/switch hints off the deprecated slugs
- update resolver + setup-picker fixtures; add BENCHMARKS row
Suite: 59 pass / 1 pre-existing (test-submit-bench worktree-fixture-absent).
Co-Authored-By: Claude Opus 4.8 <[email protected]>
Claude-Session: https://claude.ai/code/session_01EfF565T9eSLaqGzidyJ1Pm
2026-07-02 07:58:13 +00:00
..
2026-06-13 18:53:54 +05:00
2026-07-01 05:58:19 +05:00
2026-06-05 11:27:17 +00:00
2026-06-18 17:45:45 +00:00
2026-07-01 10:28:29 +00:00
2026-05-31 22:13:52 +05:00
2026-07-02 07:58:13 +00:00
2026-06-20 23:41:47 +00:00
2026-06-24 14:07:06 +00:00
2026-06-21 04:38:46 +05:00
2026-06-01 01:21:51 +05:00
2026-06-18 08:43:00 +00:00
2026-06-05 14:02:38 +00:00
2026-06-06 11:30:27 +00:00
2026-06-25 09:01:46 +05:00
2026-06-18 08:43:00 +00:00
2026-06-15 06:35:39 +05:00
2026-06-18 18:34:21 +00:00
2026-06-06 00:46:13 +00:00
2026-07-01 01:23:06 +05:00
2026-06-05 15:26:29 +00:00
2026-06-21 20:03:56 +00:00
2026-06-10 00:47:10 +00:00
2026-07-02 07:58:13 +00:00
2026-06-05 06:36:15 +00:00
2026-05-31 22:13:52 +05:00
2026-06-14 00:21:35 +05:00
2026-06-26 08:54:51 +05:00
2026-06-18 08:43:00 +00:00
2026-06-05 15:26:29 +00:00
2026-06-06 00:46:13 +00:00
2026-06-18 01:10:01 +05:00
2026-06-13 19:11:35 +05:00
2026-06-18 05:57:19 +05:00
2026-06-22 13:41:27 +00:00
2026-07-02 07:58:13 +00:00
2026-06-14 04:17:04 +05:00
2026-06-29 23:54:53 +00:00
2026-06-06 00:46:13 +00:00
2026-06-18 08:43:00 +00:00
2026-05-31 22:13:52 +05:00
2026-06-04 05:37:16 +00:00
2026-06-15 06:35:43 +05:00