Evidence record / unreal-agent

A dated record of one change, kept so the writing that cites it can be checked. Compiled from the sources listed below by the research run, not written for reading. The judgment lives in the issues that cite it, below.

2026-10-13-unreal-agent-v0-3-1-attempts-automatic-compaction-at-catalog-thresholds-uncataloged-models-get-a-zero

v0.3.1 attempts automatic compaction at catalog thresholds; uncataloged models get a zero threshold. The v0.3.0 Go tag adds compaction, first shipped as binaries and an image in v0.3.1. When the last response’s input plus output usage reaches the configured threshold and eligible history exists, a subsequently scheduled model request attempts a summary call to the same model without tools. The rebuilt context retains whole turns from the last 20,000 tokens, pending tool calls with their latest running results, and the summary. Append-only history preserves the full record for replay. The bundled catalog, merged with ~/.config/unreal-agent/settings.json, sets thresholds of 244,800 tokens for OpenAI and Codex models, 500,000 for the seven Anthropic models, and 524,288 for the two Fireworks GLM models. Its stated context windows are repository settings, not independently verified provider limits. A listed model without a threshold gets context_window/2; a model or provider missing from the catalog gets threshold 0. Eligibility also requires a cutoff beyond the retained-history condition. The source-based inference is that an uncataloged model can attempt summaries once that condition is met, provided usage is reported. OpenRouter and custom model IDs are not listed; Ollama usage reporting was not checked. If compaction request construction fails, the coordinator builds an ordinary request, and it does not apply an incomplete summary. New tool output is not continuously counted as a hard input budget. The summary prompt treats instructions in history as data. The maintainer’s 2026-09-23 comment on #7 said compaction was being explored; it is now implemented.

Channel: tagged-release. Half: both. Date: 2026-10-06.

Operator consequence: The harness attempts automatic summaries when the last usage checkpoint reaches the configured threshold and eligible history exists. This can extend runs, but does not guarantee avoiding context-limit errors or preserving task accuracy. Uncataloged models have a zero threshold and can attempt compaction once the retained-history condition is met. Before a long run, configure the intended threshold for any model outside default_settings.json and account for extra summary calls and lossy context. The catalog needs maintenance as models change. The two SWE-Marathon links in item 9 were not publicly readable at inspection; no compaction pass-rate result is established.

Receipt

Finding metadata

Run: 2026-10-13-profile-refresh-2026-09-21_2026-10-13-frontier-v0

Finding ID: 2026-10-13-unreal-agent-v0-3-1-attempts-automatic-compaction-at-catalog-thresholds-uncataloged-models-get-a-zero

Profile citations

Source links

Primary links, including exact changelog lines when available.

Versioned source: run artifact