Evidaxis

SWE-bench

repo reference measurement
Coding Agents · n = 20 · SWE-bench/SWE-bench
2 of 3 axes measurable · conf medium
convergence gate
Convergence gate: Gate: not computable — reference measurement Development velocity: rising vote Citation momentum: not measurable ∅ Direct-dependents momentum (deps.dev): measured ×
gate
1 of 3 axes

Gate: not computable — reference measurement

Gate: not computable — reference measurement
position in cohort distribution one of 20 in cohort
percentile 84 within cohort p25 p50 p75 p0 p100
percentile
p84
momentum averages present-axis z-scores; two- and three-axis scores are not strictly comparable
velocity z
velocity z gaugevelocity z+1.69 within cohort, log-slope +0.064/wk.0+1.69
velocity z
+1.69 σ
slope
+0.064/wk
log-slope +0.064/wk
citation z Citation source: not measured.
direct-dependents z
direct-dependents z gaugedirect-dependents z-0.20 within cohort, log-slope +0.020/point.0-0.20
direct-dependents z
-0.20 σ
slope
+0.020/point
Direct-dependents axis: measured.
cohort
20
systems measured
weekly commits
8.2
Development velocity axis: measured.
total citations
n/a
Citation source: not measured.
momentum
59.3
percentile p84
commit heatmap, last 26 weeks8.2/wk
weekly commits, 26 weeks26 weeks of commits, peak 53 in a week, 8 active weeks, 99 total.week 1: 0 commitsweek 2: 0 commitsweek 3: 0 commitsweek 4: 0 commitsweek 5: 0 commitsweek 6: 0 commitsweek 7: 0 commitsweek 8: 0 commitsweek 9: 0 commitsweek 10: 1 commitsweek 11: 0 commitsweek 12: 0 commitsweek 13: 0 commitsweek 14: 0 commitsweek 15: 1 commitsweek 16: 1 commitsweek 17: 0 commitsweek 18: 0 commitsweek 19: 10 commitsweek 20: 53 commitsweek 21: 16 commitsweek 22: 1 commitsweek 23: 16 commitsweek 24: 0 commitsweek 25: 0 commitsweek 26: 0 commits
weeks
26
peak/wk
53
active
8
total
99
citations by yearCitation source: not measured.
Daily dependents count (unscored) 6 dependents 5 direct, 1 indirect · pypi/swebench · deps.dev · the scored m3 axis uses weekly partitions

SWE-bench holds an Evidaxis momentum score of 59.3 of 100 on methodology m3, snapshot 2026-09-26, measured within the Coding Agents cohort (n = 20). Axis coverage: 2 of 3 axes measurable. Gate: not computable — reference measurement

Derived signals

second-order reads, computed from the published series

Three signals ship when the commit series is statistically sufficient; the rest are held in a reserved state until the data supports them. A reserved signal shows its reason, never a fabricated number. How these are computed.

recency-weighted swing trailing 13-week vs prior 39-week log-slope ratio -2.46, regime recent slope sign differs from prior window. prior slope -0.009, recent slope +0.022 per week. -0.009prior 39w+0.022recent 13w-2.46×
swing
-2.46×
regime
recent slope sign differs from prior window
windows
13w vs 39w
snapshot 1 of 1 · · m3
commit Sharpereserved: <26 non-zero commit weeks
commit changepoint52 weekly commit points. Changepoint at week 46 (2026-08-15), slope change -6.875 commits per week.2026-08-15
date
week
46 of 52
Δslope
-6.875/wk
snapshot 1 of 1 · · m3
code-leads-citation lag reserved

reserved: citation series too short / axis absent for cross-correlation

status
reserved
value
insufficient data
snapshot 1 of 1 · · m3
axis alpha vs cohort reserved

reserved: cohort N too small for regression (power ~0)

status
reserved
value
insufficient data
snapshot 1 of 1 · · m3
gate ETA reserved

reserved: needs snapshot history (1 snapshot exists)

status
reserved
value
insufficient history
snapshot 1 of 1 · · m3
methodology gate snapshot 1 of 1 · · m3
commit weeks
52
citation years
0
shipped
2
reserved
4

shipped

  • recency-swing
  • commit-changepoint

reserved

  • commit-sharpe
  • code-leads-citation-lag
  • axis-alpha
  • gate-eta
snapshot 1 of 1 · · m3

Daily dependents count (unscored)

SWE-bench dependents over time13 points, range 6 to 7 dependents.
min
6 dependents
max
7 dependents
latest
6 dependents
points
13

Downstream packages depending on pypi/swebench (deps.dev), captured point-in-time each snapshot. This daily series is unscored. The scored axis in m3 uses weekly partitions.

Measurement states

SWE-bench is under weekly measurement. History: 13 weekly observations; minimum 4. Development velocity axis: measured. Citation source: not measured. Direct-dependents axis: measured. Gate: not computable — reference measurement

Sources

SWE-bench/SWE-bench development-velocity axis

Others in Coding Agents

Agentless Coding Agents
1 of 3 axes measurable
38
p11
vel -0.97 cit no axis deps no axis
axis dials
-0.97 n/a n/a
Aider Coding Agents
2 of 3 axes measurable
44
p16
vel -0.52 cit no axis deps -0.37
axis dials
-0.52 n/a -0.37
ChatDev Coding Agents
1 of 3 axes measurable
35
p0
vel -1.17 cit no axis deps no axis
axis dials
-1.17 n/a n/a
Cline Coding Agents
2 of 3 axes measurable
54
p63
vel +1.30 cit no axis deps -0.70
axis dials
+1.30 n/a -0.70
Codex CLI Coding Agents
1 of 3 axes measurable
73
p95
vel +1.87 cit no axis deps no axis
axis dials
+1.87 n/a n/a
Continue Coding Agents
2 of 3 axes measurable
46
p21
vel -0.73 cit no axis deps +0.00
axis dials
-0.73 n/a +0.00

Full Coding Agents cohort →

Direct-dependents momentum (deps.dev)

Direct-dependents axis: measured.

Coverage state
scored
Cohort z
-0.20
OLS slope
+0.020
Theil-Sen slope
+0.018
Latest direct dependents
6
Confirmed-clean points
23
Reconstructed history points
15
As-of partition
2026-09-07
Fragility veto
inactive
Rising vote
no

This axis measures the frozen-panel trajectory of the package set selected and linkage-verified as of 2026-07-21. Systems outside that panel are not measured on this axis. Residual survivorship beyond the frozen universe is disclosed, not denied.

The earliest weekly points of each series were read from deps.dev's BigQuery history on 2026-07-21; later points are weekly captures. Each record reports how many of its points are reconstructed history.

Source: deps.dev (Google), CC-BY 4.0. Modified: aggregated to system-level counts and momentum scores.

Axis definition · Snapshot axis correlations

entity_id e_EF7QKB37YJK methodology m3 snapshot 9d2fe956adbc period 2026-w39 record JSON ↓ source snapshot

Score derived from public data on Evidaxis methodology m3, never edited by hand. Cite as: “Evidaxis, SWE-bench, entity e_EF7QKB37YJK, snapshot 2026-w39.”

Durable reference (format-independent): urn:evidaxis:claim:e_EF7QKB37YJK:m3:2026-09-26