From ffbcb64dcff86ef873506c6e10d88a0b2bf87bab Mon Sep 17 00:00:00 2001
From: noonghunna <10742901+noonghunna@users.noreply.github.com>
Date: Mon, 6 Jul 2026 15:00:52 +0000
Subject: [PATCH] =?UTF-8?q?docs(multi-max):=20caveat=20=E2=80=94=20fp8=20K?=
 =?UTF-8?q?V=20flip=20needs=20fresh=204-card=20re-validation?=
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit

The prior 4-card validation (@Whamp #446) was on the OLD int8-PTH KV. #595 flips
to fp8/e4m3; the fp8 config is validated on the 2-card dual-max proxy (all gates
green) but not yet re-confirmed at TP=4. Request a fresh 4-card report before
upgrading ⚠️ caveats -> ✅.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01EfF565T9eSLaqGzidyJ1Pm
---
 models/qwen3.6-27b/vllm/compose/multi4/fp8/mtp.yml | 9 +++++++--
 1 file changed, 7 insertions(+), 2 deletions(-)

diff --git a/models/qwen3.6-27b/vllm/compose/multi4/fp8/mtp.yml b/models/qwen3.6-27b/vllm/compose/multi4/fp8/mtp.yml
index 1e0213ff..812a131d 100644
--- a/models/qwen3.6-27b/vllm/compose/multi4/fp8/mtp.yml
+++ b/models/qwen3.6-27b/vllm/compose/multi4/fp8/mtp.yml
@@ -12,8 +12,13 @@
 #              tight on 2 cards, comfortable on 4.
 #   Genesis:   none — intentionally Genesis-free
 #   Status:    ⚠️ Production w/ caveats
-#   Caveats:   Cross-rig validation only (this dev rig has 2 cards). Promoted on @Whamp's 4× 3090
-#                full chain — #446: verify-full + verify-stress 7/7 + soak-continuous PASS (85/102) —
+#   Caveats:   ⚠️ #595 (2026-07-06) flipped KV int8-PTH → fp8/e4m3. The fp8 KV is validated on the
+#                2-card dual-max proxy (all gates green: 8-pack 109 ties int8-PTH's 107, soak PASS,
+#                decode 2.3× at depth) — but the prior 4-card validation (@Whamp #446) was on the OLD
+#                int8-PTH KV. A fresh TP=4 report on the fp8 config is requested (@Whamp / @ryanmpelletier)
+#                to re-confirm at 4 cards and upgrade toward ✅.
+#              Cross-rig validation only (this dev rig has 2 cards). Prior int8-PTH promotion on @Whamp's
+#                4× 3090 full chain — #446: verify-full + verify-stress 7/7 + soak-continuous PASS (85/102) —
 #                BUT on an OLDER engine (pre-v0.24.0 pin) + a non-standard rig (aikitoria P2P kernel,
 #                mixed x4/x16/x8/x16 lanes), single report. No clean v0.24.0 4-card datapoint yet →
 #                a fresh one upgrades this to ✅. Byte-identical to the production dual-max @TP=4.