Commit Graph
4 Commits
Author SHA1 Message Date
noonghunnaandnoonghunna 6291ce5081 feat(eval): expose request-level thinking toggles (#196)
Closes #195.

Add ENABLE_THINKING support to bench.sh and pass --enable-thinking / --thinking-max-tokens through quality-test.sh. Propagate the same env through rebench-full.sh, warn on likely reasoning-on server/request-off mismatches, and document the workflow for reasoning-model evals.

Co-authored-by: noonghunna <[email protected]>
2026-05-23 08:24:58 +05:00
noonghunna 2a148d702b feat(bench): surface prompt processing throughput
Build vLLM Club3090 Image / Build and push dated image (push) Failing after 1m23s
Release / release (push) Failing after 45s
Build vLLM Club3090 Image / Promote latest and nightly-stable (push) Canceled after 0s
Build vLLM Club3090 Image / Retain four weeks of dated nightlies (push) Canceled after 0s
2026-05-15 09:03:10 +00:00
noonghunna 22bf2e9398 fix(scripts): make submit-bench issue-first
Release / release (push) Failing after 53s
2026-05-13 18:40:43 +00:00
noonghunna ef770322f4 feat(scripts): add submit-bench flow
Release / release (push) Failing after 51s
2026-05-13 18:24:14 +00:00