Local: raise LMCache shm_size 32→64 for LMCACHE_L1_GB=60 (124 GB rig)
Rig-specific tuning — this rig has 124 GB RAM (110 free), so L1=60 clears the preflight gate (L1+28=88) with headroom. shm_size must be >= L1 or the MP connector falls back to slow pickle. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
This commit is contained in:
@@ -87,7 +87,7 @@ services:
|
||||
# incident). Raise these AND shm_size + LMCACHE_L1_GB together for a bigger cache.
|
||||
mem_limit: ${CLUB3090_MEM_LIMIT:-70g}
|
||||
memswap_limit: ${CLUB3090_MEM_LIMIT:-70g}
|
||||
shm_size: "32gb" # MUST be >= LMCACHE_L1_GB (default 30). Raise if you raise the cache.
|
||||
shm_size: "64gb" # MUST be >= LMCACHE_L1_GB. Raised 32→64 for LMCACHE_L1_GB=60 (this rig, 124 GB RAM).
|
||||
ipc: host
|
||||
volumes:
|
||||
- ${MODEL_DIR:-../../../../../../models-cache}:/root/.cache/huggingface
|
||||
|
||||
Reference in New Issue
Block a user