8eff77e2be
Add Tess-4-27B to the catalog (llama.cpp dual, external MTP, 262K) (#661)
Qwen3.5-based dense 27B (migtissera Q4_K_M GGUF); arch qwen35-dense,
64 layers, standard GQA — confirmed from the GGUF header. First
EXTERNAL-MTP compose in the catalog: the nextn draft ships as a
separate mtp-*.gguf, engaged via --spec-draft-model + --spec-type
draft-mtp (vs Deckard's embedded head).
Live-validated on dual 3090 (2026-07-09): serves at 262K, decode
~52 narr / 68 code, verify-stress 8/8 (NIAH clean to 240,634 tok),
soak-continuous PASS, 8-pack 115/150 think-off / 118/150 think-on —
ties/edges the qwen3.6-27b dual-max (109) and leads the agentic packs
(hermes 15/20 vs 9, cli-40 25/40 vs 20). Ships as caveats: streaming
tool-calls + thinking-ON -> finish=length (thinking-off for tools).
- models/tess-4-27b.yml + drafters/tess-mtp-gguf.yml (spec_method mtp_gguf)
- add mtp_gguf to llama-cpp-mainline supported_drafters (live-validated,
additive — mainline serves external draft-mtp on b9246)
- compose dual/migtissera-q4km/mtp.yml + registry entry + DEFAULTS row
- bump catalog counts (registry 62, disk 63, models 12, drafters 12)
- BENCHMARKS.md: Tess dual-card section with dual-max comparison
Claude-Session: https://claude.ai/code/session_01EfF565T9eSLaqGzidyJ1Pm
Co-authored-by: noonghunna <[email protected]>
Co-authored-by: Claude Opus 4.8 (1M context) <[email protected]>
2026-07-09 21:45:38 +05:00
..
2026-07-05 03:23:49 +00:00
2026-07-05 17:12:10 +00:00
2026-07-05 09:55:54 +00:00
2026-06-13 18:53:54 +05:00
2026-07-05 09:55:54 +00:00
2026-05-18 16:43:28 +00:00
2026-07-01 05:58:19 +05:00
2026-07-07 01:02:48 +00:00
2026-06-05 11:27:17 +00:00
2026-05-29 07:59:42 +05:00
2026-06-18 17:45:45 +00:00
2026-07-09 21:45:38 +05:00
2026-05-31 22:13:52 +05:00
2026-05-30 21:10:49 +05:00
2026-07-05 06:41:07 +00:00
2026-05-18 16:43:28 +00:00
2026-07-07 22:05:09 +00:00
2026-07-02 07:58:13 +00:00
2026-06-20 23:41:47 +00:00
2026-06-24 14:07:06 +00:00
2026-06-21 04:38:46 +05:00
2026-06-01 01:21:51 +05:00
2026-07-09 02:53:50 +05:00
2026-07-05 05:56:27 +00:00
2026-07-04 10:35:00 +00:00
2026-06-05 14:02:38 +00:00
2026-06-06 11:30:27 +00:00
2026-06-25 09:01:46 +05:00
2026-07-07 01:02:48 +00:00
2026-06-18 08:43:00 +00:00
2026-07-09 04:40:20 +05:00
2026-06-15 06:35:39 +05:00
2026-05-18 19:29:43 +00:00
2026-07-06 21:49:01 +00:00
2026-06-06 00:46:13 +00:00
2026-05-17 04:50:50 +00:00
2026-07-07 22:05:09 +00:00
2026-05-30 21:10:49 +05:00
2026-06-05 15:26:29 +00:00
2026-06-21 20:03:56 +00:00
2026-05-29 07:59:42 +05:00
2026-06-10 00:47:10 +00:00
2026-07-02 07:58:13 +00:00
2026-07-03 17:44:17 -07:00
2026-06-05 06:36:15 +00:00
2026-07-05 00:08:03 +00:00
2026-05-15 22:18:09 +05:00
2026-05-18 18:29:58 +00:00
2026-07-07 02:10:17 +00:00
2026-05-31 22:13:52 +05:00
2026-06-14 00:21:35 +05:00
2026-07-02 12:31:35 +00:00
2026-07-09 21:45:38 +05:00
2026-07-09 16:58:13 +05:00
2026-06-05 15:26:29 +00:00
2026-06-06 00:46:13 +00:00
2026-07-02 23:24:28 +00:00
2026-07-09 03:05:15 +05:00
2026-06-18 01:10:01 +05:00
2026-06-13 19:11:35 +05:00
2026-06-18 05:57:19 +05:00
2026-07-06 21:15:02 +00:00
2026-07-06 21:49:01 +00:00
2026-05-30 17:52:09 +05:00
2026-07-02 07:58:13 +00:00
2026-06-14 04:17:04 +05:00
2026-06-29 23:54:53 +00:00
2026-05-23 08:24:58 +05:00
2026-06-06 00:46:13 +00:00
2026-06-18 08:43:00 +00:00
2026-05-31 22:13:52 +05:00
2026-06-04 05:37:16 +00:00
2026-05-26 15:58:08 +00:00
2026-07-04 22:22:54 +00:00
2026-06-15 06:35:43 +05:00