noonghunnaandClaude Opus 4.8 90c67dcc9f gemma-4-12b: promote the two vLLM MTP composes to ⚠️ Production w/ caveats ...

vllm/gemma-12b-dual-bf16-mtp + vllm/gemma-12b-single-int8-mtp → status="caveats"
(🧪 → ⚠️). Both cleared the gates:
  - dual-bf16-mtp: rebench-full (verify-full + bench + verify-stress + 8-pack
    94/150 + soak PASS), 256K NIAH overlay-free.
  - single-int8-mtp: bench + 256K NIAH + 8-pack 105/150 + soak PASS (fresh 20x5:
    0/100 silent-empty, 0 MiB growth, 95.1% retention).

CAVEAT (both): the gemma4-unified image is an ephemeral arch-preview tag (0.1.dev)
— pin a digest; promotes to ✅ Production when gemma4_unified ships in a STABLE
vLLM release.

Withheld at 🧪 (deliberate): beellama/gemma-12b-single-q8kxl + llamacpp/...-q8kxl
— no MTP/spec-dec for Gemma-4 on llama.cpp yet (blocked on llama.cpp#23398).

Header Status+Caveats, registry status, and BENCHMARKS markers all flipped
together; test-compose-status-drift + full guard suite 41/41 green.

Co-Authored-By: Claude Opus 4.8 (1M context) <[email protected]>

2026-06-04 20:02:44 +00:00

..

calibration

gemma-4-12b: normalize gemma-12b slug naming + prune the no-MTP bases

2026-06-04 18:56:59 +00:00

drafters

Wire gemma-4-12b into curated catalog (vLLM gemma4-unified, bf16 + MTP)

2026-06-04 01:17:19 +00:00

engines

gemma-4-12b: add single-card vLLM INT8 compose (full 256K on one 3090)

2026-06-04 17:16:00 +00:00

hardware

feat(beellama): add beellama.cpp DFlash as first-class compose engine (#268)

2026-05-30 22:47:19 +05:00

models

gemma-4-12b: add single-card vLLM INT8 compose (full 256K on one 3090)

2026-06-04 17:16:00 +00:00

workloads

…

__init__.py

…

arch_patches.yml

feat(gemma): gemma duals → vLLM v0.22.0 (rebase #40391 lean + re-instate #42006) (#287)

2026-06-01 01:21:51 +05:00

booter.py

v0.8.0 [F] F3: G6-A 3-part additive [E] touch (pt1.predicted_b_breakdown, pt3.failure_log_excerpt+actual, container-log capture) + §6.1 Tier-1 (CONTRACT-2)

2026-05-17 04:19:53 +00:00

calibration_seed.yml

Add v0.8 Phase A patch attribution data

2026-05-16 05:13:00 +00:00

canonical_scenarios.py

feat(compat): add profile validator and estate self-test

2026-05-14 15:25:28 +00:00

capture.py

feat(pull): v0.8.2 STEP V1 — capture-on-hard-block pt1-gate emitter + BaseCaptureBundle protocol lift

2026-05-18 16:43:28 +00:00

classifier.py

feat(pull): v0.8.2 STEP V1 — capture-on-hard-block pt1-gate emitter + BaseCaptureBundle protocol lift

2026-05-18 16:43:28 +00:00

compat.py

gemma-4-12b: add single-card vLLM INT8 compose (full 256K on one 3090)

2026-06-04 17:16:00 +00:00

compose_registry.py

gemma-4-12b: promote the two vLLM MTP composes to ⚠️ Production w/ caveats

2026-06-04 20:02:44 +00:00

dedup.py

feat(pull): v0.8.2 STEP V1 — capture-on-hard-block pt1-gate emitter + BaseCaptureBundle protocol lift

2026-05-18 16:43:28 +00:00

deriver.py

fix(deriver): correct stale "GGUF not supported until v0.8.1" message — now misleading post-v0.8.1-ship

2026-05-18 11:38:12 +00:00

diagnose_profile_cli.py

gemma-4-12b: drop vendored p-RoPE overlay — upstream config fix supersedes it

2026-06-04 16:04:24 +00:00

downloader.py

v0.8.0 [E] E2-fix-2: verify *.safetensors against HF API lfs.sha256 (not Xet-redirect-fragile HEAD x-linked-etag) — on-rig E5 caught false no-etag

2026-05-17 01:28:22 +00:00

einput.py

v0.8.0 [E] E1: generate_from_profile + derived-vllm template + EInput + CONTRACT-5 gate

2026-05-17 00:12:26 +00:00

estate_cli.py

feat(estate): add parallel boot mode

2026-05-15 22:18:09 +05:00

failure_fingerprints.yml

feat(pull): v0.8.2 STEP V1 — capture-on-hard-block pt1-gate emitter + BaseCaptureBundle protocol lift

2026-05-18 16:43:28 +00:00

gates.py

llama.cpp single: thinking-off policy alignment + MTP profile family

2026-05-20 01:01:26 +00:00

hwdetect.py

feat(pull): v0.8.2 STEP V4 — optional whichllm hw-detect subprocess (CONTRACT-3, hw-detect-only)

2026-05-18 19:29:43 +00:00

launch_compat.py

feat(beellama): release v0.3.0 Q8_K_XL dual composes (experimental) + centralize image pin (#296)

2026-06-02 16:35:48 +05:00

loop_input.py

feat(pull): v0.8.2 STEP V1 — capture-on-hard-block pt1-gate emitter + BaseCaptureBundle protocol lift

2026-05-18 16:43:28 +00:00

measurement_record.py

Fail loud on hollow measured records in measurement_record (#251)

2026-05-29 03:31:25 +05:00

patch_attribution.py

feat(pull): v0.8.2 STEP V3 — arch-registry expansion + chat-template attribution/drift_guard

2026-05-18 18:29:58 +00:00

patches.yml

gemma-4-12b: drop vendored p-RoPE overlay — upstream config fix supersedes it

2026-06-04 16:04:24 +00:00

profile_runtime.yml

refactor(gemma): rename dual slugs + ladder gemma-bf16-mtp to 131K (#286)

2026-06-01 01:20:46 +05:00

pull.py

fix(pull): v0.8.2 STEP V5 — recommend must not label a fits-clean model "DOES NOT FIT"

2026-05-18 21:05:12 +00:00

submit_pull.py

fix(pull): v0.8.2 STEP V2 — gh-less issue body must not carry the absolute capture path

2026-05-18 17:49:00 +00:00

trust_pipeline.py

v0.8.0 [review] pre-tag fixes: scrub internal-path leaks from shipped source + make .pull-captures-corpus tests CI-safe (skip-when-absent)

2026-05-17 12:01:25 +00:00

weights.py

refactor(compose): insert <quant> layer + make the registry the single source of truth

2026-05-26 15:58:08 +00:00