lnd/simulation/lab/experiments
Olaoluwa Osuntokun 5200d1fc07 simulation/lab: close exp-010 with the Opus 5 reflection A/B verdict
In this commit, we land the verdict for the two Opus 5 reflection
arms and close exp-010. The headline: opus-default produced the first
evolved candidate to statistically tie a champion on any tier
(split-val +0.005 vs mx_c3, higher raw success), evolving persistent
parallel flow plans, concurrency-first dispatch, and residual-aware
shard budgeting across 1,931 lines -- then paid for that corridor
depth with a collapse on every off-corpus tier (hard test 0.303 vs
0.583). The medium-effort arm is the cautionary tale: best val score
of the family, worst held-out -- caught by the sealed sweep exactly
as intended. Champions remain hb1 + mx_c3, now validated against
three proposer lineages on this corpus. At fixed eval budget,
reflection quality beats reflection throughput; proposer strength
moves candidates along the specialist-generalist axis rather than
lifting the curve. Both winners are archived, exploit-grep clean.
2026-07-25 17:07:02 -07:00
..
exp-001-param-smoke.md simulation: add evolved router champions and lab notebook 2026-07-24 13:01:06 -07:00
exp-002-param-run1.md simulation: add evolved router champions and lab notebook 2026-07-24 13:01:06 -07:00
exp-003-seed-router-vs-lnd.md simulation: add evolved router champions and lab notebook 2026-07-24 13:01:06 -07:00
exp-004-code-evolution.md simulation: add evolved router champions and lab notebook 2026-07-24 13:01:06 -07:00
exp-004-sim-audit.md simulation: add evolved router champions and lab notebook 2026-07-24 13:01:06 -07:00
exp-005-sim-audit.md simulation: add evolved router champions and lab notebook 2026-07-24 13:01:06 -07:00
exp-006-breakthrough.md simulation: add evolved router champions and lab notebook 2026-07-24 13:01:06 -07:00
exp-007-mix-followup.md simulation: add evolved router champions and lab notebook 2026-07-24 13:01:06 -07:00
exp-008-drift-evolution.md simulation/lab: close exp-008 -- time-awareness re-evolves, loses anyway 2026-07-24 20:08:33 -07:00
exp-008-drift1-best-candidate.go simulation/lab: close exp-008 -- time-awareness re-evolves, loses anyway 2026-07-24 20:08:33 -07:00
exp-008-drift1-best-candidate.md simulation: document the drift1 winner, resolve exp-008 in the docs 2026-07-24 20:26:46 -07:00
exp-009-mainnet-validation.md simulation/lab: add mainnet-graph validation results 2026-07-24 13:24:22 -07:00
exp-010-opus1-best-candidate.go simulation/lab: close exp-010 with the Opus 5 reflection A/B verdict 2026-07-25 17:07:02 -07:00
exp-010-opusmed1-best-candidate.go simulation/lab: close exp-010 with the Opus 5 reflection A/B verdict 2026-07-25 17:07:02 -07:00
exp-010-split2-best-candidate.go simulation/lab: record the exp-010 codex-arm verdict 2026-07-25 03:11:51 -07:00
exp-010-splitting-pressure.md simulation/lab: close exp-010 with the Opus 5 reflection A/B verdict 2026-07-25 17:07:02 -07:00
exp-011-code-gen2.md simulation/lab: add exp-011, the code_gen2 insight-transfer run 2026-07-24 16:37:25 -07:00
exp-011-gen2-best-candidate.go simulation/lab: add exp-011, the code_gen2 insight-transfer run 2026-07-24 16:37:25 -07:00