lnd/simulation/lab
Olaoluwa Osuntokun 5200d1fc07 simulation/lab: close exp-010 with the Opus 5 reflection A/B verdict
In this commit, we land the verdict for the two Opus 5 reflection
arms and close exp-010. The headline: opus-default produced the first
evolved candidate to statistically tie a champion on any tier
(split-val +0.005 vs mx_c3, higher raw success), evolving persistent
parallel flow plans, concurrency-first dispatch, and residual-aware
shard budgeting across 1,931 lines -- then paid for that corridor
depth with a collapse on every off-corpus tier (hard test 0.303 vs
0.583). The medium-effort arm is the cautionary tale: best val score
of the family, worst held-out -- caught by the sealed sweep exactly
as intended. Champions remain hb1 + mx_c3, now validated against
three proposer lineages on this corpus. At fixed eval budget,
reflection quality beats reflection throughput; proposer strength
moves candidates along the specialist-generalist axis rather than
lifting the curve. Both winners are archived, exploit-grep clean.
2026-07-25 17:07:02 -07:00
..
experiments simulation/lab: close exp-010 with the Opus 5 reflection A/B verdict 2026-07-25 17:07:02 -07:00
DECISIONS.md simulation/lab: add decisions log 2026-07-24 13:31:17 -07:00
IDEAS.md simulation: prep exp-010 prompt and design exp-012 cold-cache study 2026-07-24 21:08:40 -07:00
NOTEBOOK.md simulation/lab: close exp-010 with the Opus 5 reflection A/B verdict 2026-07-25 17:07:02 -07:00