Finding / opencode
2026-10-24-opencode-compaction-gains-an-opt-in-background-summary-with-real-latency-and-inference-tradeoffs
Compaction gains an opt-in background summary with real latency and inference tradeoffs. 2.1.0 summarizes the whole conversation while retaining recent text verbatim; the documented defaults keep about 15,000 tokens and reserve a larger response buffer. In 2.1.4, experimental.background_compaction: true precomputes a summary before it is needed, only for compatible automatic summary compaction. Source triggers at 85 percent of the normal compaction threshold only after measured prompt tokens total at least 64,000. The work and cached result live in memory; an unfinished precomputation can still be awaited when compaction is required. This is not a guarantee that no foreground wait occurs. Another 2.1.4 repair shortens older tool output before dropping history when summarization itself overflows. Automatic compaction is enabled, but background precomputation remains off by default.
Channel: tagged-release. Half: both. Date: 2026-10-23.
Operator consequence: Try background compaction on a bounded long task and record summary requests, billed tokens, actual stalls and any lost constraints. Do not describe it as free latency reduction: a speculative summary may consume inference without being reused, and no restart durability for that in-memory precomputation was established. Persistent constraints still belong in explicit instructions and verification. This replaces some manual context bookkeeping, while the scarce judgment moves to whether the compressed state is sufficient to continue correctly.
Receipt
Finding metadata
Run: 2026-10-24-weekly-digest-2026-10-13_2026-10-24-frontier-v0
Finding ID: 2026-10-24-opencode-compaction-gains-an-opt-in-background-summary-with-real-latency-and-inference-tradeoffs
Source links
Primary links, including exact changelog lines when available.
- tagged commit file2026-10-24-opencode-compaction-gains-an-opt-in-background-summary-with-real-latency-and-inference-tradeoffsanomalyco/opencode / packages/core/src/session/compaction.tstagged commit file2026-10-24-opencode-compaction-gains-an-opt-in-background-summary-with-real-latency-and-inference-tradeoffsanomalyco/opencode / services/www/src/docs/content/compaction.mdxtagged commit file2026-10-24-opencode-compaction-gains-an-opt-in-background-summary-with-real-latency-and-inference-tradeoffsanomalyco/opencode / CHANGELOG.md