Files
club-3090/scripts
noonghunna 7174ad91c4 Promote vllm/qwen-27b-dual-max to Production (soak completes the gate)
The FP8 max-accuracy tier had bench (83.1/108.2) + quality (107/150) on the
2x3090 reference rig but no soak-continuous run — the one missing gate item.
Ran the full operational gate fresh on the v0.24.0 pin:
  - verify-full 9/9
  - verify-stress: all 6 rungs, fillable to 240,636 tok clean (91%)
  - soak-continuous PASS: 0 err / 0 growth / 100% retention, p50 decode 85
That clears the production bar.

- registry + compose header: status experimental -> production (drift guard
  green). status_note also de-staled: dropped the '~56 TPS' probe / 'slowest of
  the three' framing (corrected to decode 83/108, the slow axis is PREFILL/TTFT
  from MarlinFP8 W8A16 on Ampere, not decode) + the full-gate results.
- baselines.yml: row comment notes the soak PASS completing the gate.
- No DEFAULTS[(qwen,vllm,dual)] change -> vllm/dual (fast) stays the dual
  default; dual-max just joins the actionable list as the max-fidelity tier.

Bonus for the 5090 crowd: dual-max is now a non-experimental config, so the
launch command drops --force (bash scripts/switch.sh vllm/qwen-27b-dual-max).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01EfF565T9eSLaqGzidyJ1Pm
2026-07-06 01:12:42 +00:00
..