// readme

What you can run

A run is one point in a harness ร— method ร— benchmark space: a harness solves tasks, a method proposes edits to that harness between rounds, and a benchmark scores each candidate. HarnessGrad supplies the three middle layers that every RSI paper re-implements badly โ€” tasks and scoring, an isolated sandbox, and version control over the candidate harness โ€” so an experiment is one command and a curve.

axiswhat shipswhere
harnesses8: loop, codex, opencode, deepseek-harness, openclaw, miniagent, miniswe, oraclebase_harness/<name>/
RSI methods19: dgm, rrsi, adas, ahe, ace, skillopt, evoprompt, evo_harness, opro, tthe, dream_rsi, sica_ci, gepa, darwinx, arbor, hyperagents, meta_harness, harnessx, modular_rsiexperiments/method-<name>.json
benchmarks56 declared, 56 runnable, none refused โ€” every one listed: agentdojo, aime, alfworld, appworld, authored_example_fix_bug, bbeh, bfcl_v3, bird_minidev, browsecomp, chessbench_puzzles, cooperbench, costbench, costbench_dynamic, deepsearchqa, deepswe, ds1000,โ€ฆ