End-to-end dataflow telemetry, token mechanics, prompt budgeting, and the architectural transition from arbitrary hardware leashes to natural epistemic prompting.
max_output_tokens: 8192. The ~1,500 word ceiling was an artificial English prompt leash ("in no more than 1,500 words") authored to prevent Sol from reprinting Terra's report verbatim.
max_output_tokens covers both invisible reasoning tokens and visible output. In our Sept 10 run, Sol burned 3,514 reasoning tokens before generating 1,196 visible tokens. An 8k limit leaves only ~4k for text!
16,384+). Never let an arbitrary integer limit truncate high-value trade counter-arguments or multi-player waiver ledgers.
Who hands off what to whom, at what stage, and where data boundaries are enforced.
Pulls live platform data (Sleeper/ESPN/Yahoo), ESPN/FantasyPros projections, and previous day's audit markdown from disk.
gpt-5.6-terra executes 2–3 autonomous tool-calling turns evaluating rosters, matchups, and waiver deltas. Produces the primary draft.
gemini-3.8-flash takes Terra's full draft, performs Google Searches, challenges premises, and classifies issues (FACTS, STRATEGY, PROJECTION).
gpt-5.6-sol takes both Terra's draft & Gemini's critique. Uses OpenAI Web Search to settle disputed facts, issuing binding Add/Drop rulings.
assemble_consensus_report unites Sol rulings + Provenance Manifest + Gemini Critique + Terra Draft into HTML/MD and sends mobile push alerts.
Parsed directly from run trace logs: out/run-traces/advisor-run-2026-09-10_234502-1981894.jsonl
Comprehensive audit of every bottleneck, why it was implemented, and the exact proposed modernization.
| Handoff Stage & Component | Current Hard Limit | Why It Existed | Observed Bottleneck / Risk | Proposed Uncapped State |
|---|---|---|---|---|
|
Previous Day Audit Ingestion
DEFAULT_PREV_AUDIT_CONTEXT_CHARS
|
12,000 chars (~2,400 tokens) |
Kept context lean for initial prototype testing when context window was presumed small. | Cut off the bottom 60% of yesterday's audit. Yesterday's audit was 35,000 chars, so 23,000 chars of baseline reasoning were thrown away! |
60,000 chars (or Uncapped)
Terra takes 128k+ tokens; a 60k char audit is only ~12k tokens (less than 10% of window).
|
|
Waiver Wire Pool Retrieval
AdvisoryEngine.get_waiver_wire()
|
top_n: 15 per pos (Total ~60 players) |
Prevented tool output from overflowing standard chat completion token buffers. | Models cannot see contingent handcuff stashes (e.g. Isaac Guerendo, Braelon Allen, Blake Corum) if ranked beyond #15 on raw projections. |
top_n: 40–50 per pos
Gives full visibility into true handcuff and option-value wire depth.
|
|
Sol Prompt Word Cap
engine/adjudication.py:232
|
"in no more than 1,500 words" | Intended to keep Sol from re-writing Terra's full 3,000-word draft since it's already appended below. | Prompting "under 1,500 words" forced Sol to be terse (721 words in live run), skipping detailed player-by-player trade veto logic. |
Prompt for Structure, Not Word Count
Replace with: "Render an exhaustive, rigorous final review without filler or repetition. Prioritize thorough transaction justifications."
|
|
Sol API Token Ceiling
payload["max_output_tokens"]
|
8,192 tokens (Reasoning + Output) |
Default safety limit in OpenAI responses prototype. | High risk of catastrophic truncation! Sol spent 3,514 tokens on reasoning in our run. If reasoning took 5,500 tokens, visible text would cut off midway. |
16,384 tokens
Doubles the headroom so reasoning never eats the transaction ledger quota.
|
|
Gemini Grounded Review
run_gemini_review()
|
No hard token cap (Thinking Level: MEDIUM) |
Already unconstrained on token output. | Currently healthy (used 2,856 candidate tokens and 6,777 thinking tokens with zero truncation). |
Maintain Unconstrained Headroom
Keep temperature 0.3 and thinkingLevel MEDIUM; allow full candidate depth.
|
|
Terra Autonomous Turn Cap
run_openai_responses_advisor()
|
range(12) turns | Circuit breaker against runaway autonomous tool calling loops. | Terra used 3 turns and 19 tool calls in live run. 12 is sufficient, but 16 gives headroom for deep trade target scans. |
16 turns (Safety Ceiling Only)
Terra naturally completes in 2–4 turns; bump turn limit to 16 just in case.
|
In legacy LLMs (GPT-4, Claude 3.5), max_tokens only limited visible words. If you set 2,000 tokens, you got up to 1,500 words of output.
In reasoning models (GPT-5.x, o-series, Gemini with Thinking), the API budget combines hidden chain-of-thought tokens and visible output into a single pool.
Setting a low max_tokens does not make the model more concise—it makes the model run out of ink halfway through the page.
Reasoning models respond exceptionally well to qualitative criteria:
Verdict:, Why:, What is being forfeited:, Net roster impact:, Evidence:) forces high-density signal.Immediate code adjustments to apply across fantasy-daily-advisor and fantasy-2026.