Two changes that multiply effective queue throughput:
- In-flight dedup: POST /v1/clones now attaches identical submits (same
cacheKey) to the already queued/running job instead of enqueueing a
duplicate capture. Retry-spam previously multiplied queue load (observed
4x same-URL submissions in prod); now it's free. Best-effort — a
same-instant race can still double-submit. Gated on !noCache.
- WORKER_CONCURRENCY (default 1): the worker registers N independent
pg-boss pollers, running up to N captures concurrently per process with
no head-of-line blocking. Each slot gets its own verify harness dir
(harnessDir/slot-i) so concurrent framework builds never collide;
concurrency 1 keeps the flat harnessDir layout.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
