tangled-fork/spindle/engine/ at 194e80f30ce1d437cae77e44528975a79205e2bf · willdot.net/tangled-fork · Tangled

willdot.net / tangled-fork

forked from tangled.org/core

0

Monorepo for Tangled

0

tangled-fork / spindle / engine /

at 194e80f30ce1d437cae77e44528975a79205e2bf 2 files

Anirudh Oppiliappan spindle: limit concurrent workflows to cap total memory usage 7w ago

spindle: limit concurrent workflows to cap total memory usage Add a channel-based semaphore (SPINDLE_SERVER_MAX_CONCURRENT_WORKFLOWS, default 8) that blocks workflow goroutines from starting a container until a slot is free. Each workflow acquires a slot before SetupWorkflow and releases it on exit via defer. Combined with the 6 GiB per-container limit (MAX_JOB_MEMORY_MB), this bounds total container memory to ~48 GiB on the current 64 GiB host. MAX_JOB_COUNT still controls pipeline-level concurrency at the queue. Without this semaphore, max workflows were effectively unbounded and (wrongly) assumed to be capped at MAX_JOB_COUNT. Signed-off-by: Anirudh Oppiliappan <anirudh@tangled.org>

1 month ago

spindle/engine: read secrets from environment file

3 months ago