ce40996e79
Symlink direction: repo convention is AGENTS.md canonical, CLAUDE.md a symlink -> AGENTS.md (opposite of the maintainer system, where AGENTS.md -> CLAUDE.md). The repo had it backwards (CLAUDE.md real, AGENTS.md -> CLAUDE.md); flip so AGENTS.md is the real file and CLAUDE.md symlinks to it. Localhost gotcha: HermesAgent-20 runs its agent INSIDE the Docker sandbox and calls the model over the network, so a localhost endpoint is the container's own loopback, not the host. scripts/quality-test.sh already auto-sets BENCHLOCAL_HERMES_RESOLVE_LOCALHOST=1 for localhost URLs, but invoking benchlocal-cli directly bypasses that guard and hermes silently scores ~0/20. - AGENTS.md (now canonical): "run quality via the wrapper, not raw benchlocal-cli." - docs/QUALITY_TEST.md: new Limitations item + annotate the direct-CLI example (its localhost example was the exact trap). Failure signature is uniform ~timeout-length latencies + flat GPU, not turn_count (0 for hermes regardless). Surfaced 2026-05-27: Gemma-4 8-pack hermes 1/20 (artifact) -> 13/20 with the var set. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Symbolic link
9 B
Symbolic link
9 B
AGENTS.md