Daily goal metrics
hd is built for programs written by coding agents, so we judge it with the Agentic Programming Language Arena: three pillars that ask what agent-driven development actually costs and produces. Each pillar is kept on its own and compared on a Pareto frontier rather than folded into one score, because a faster compiler that makes agents retry more is not a win. Compiler correctness is a gate in front of all three. Every metric is a script with a fixed target; no AI or agent run is involved, and the same scripts run against any hd binary. They run twice a day, at 00:00 and 12:00 UTC.
First: correctness
- Correctness gate2 of 3 met
- Is the compiler right? Conformance and incremental soundness. A faster wrong result is not better, so this is a prerequisite rather than a pillar.
The three pillars
- Single-agent development cost226 of 230 met
- How cheaply does one agent get a correct program? Compile and test latency is agent wait time; clear, short, well-placed diagnostics and fix-its that resolve mistakes are fewer retries and fewer tokens.
- Agent scalability38 of 47 met
- How much useful work do N agents do on one machine? CPU, memory and disk per check, startup, behaviour under concurrency, and caches that are shared, bounded and safe to write at once.
- Artifact quality20 of 35 met
- How good is the program the agents produced? The user's program, not the compiler: test speed, runtime against Node, allocations, binary size, host-call and serde cost, memory over time.
Trend
The share of each pillar's targets that the run met. A line going up is progress; a drop after a commit is a regression worth reading. Hover a point for its run.
Single-agent development cost
How cheaply does one agent get a correct program? Each bar is one metric, drawn at its worst target's distance from the goal: left of the dashed line meets it, right of it misses by that multiple. Metrics without a numeric goal show only met or missed. The full list of targets is in the table below.
Agent scalability
How much useful work do N agents do on one machine? Each bar is one metric, drawn at its worst target's distance from the goal: left of the dashed line meets it, right of it misses by that multiple. Metrics without a numeric goal show only met or missed. The full list of targets is in the table below.
Artifact quality
How good is the program the agents produced? Each bar is one metric, drawn at its worst target's distance from the goal: left of the dashed line meets it, right of it misses by that multiple. Metrics without a numeric goal show only met or missed. The full list of targets is in the table below.
Correctness gate
Is the compiler right? Each bar is one metric, drawn at its worst target's distance from the goal: left of the dashed line meets it, right of it misses by that multiple. Metrics without a numeric goal show only met or missed. The full list of targets is in the table below.
All targets
Latest run: 2026-11-19 05:24 UTC. History and raw data: the metrics-data branch.
Every target, latest run
| Pillar | Metric | Target | Value | Goal | Status |
|---|---|---|---|---|---|
| Single-agent development cost | edit-latency | p50 check after an edit | 43 ms | ≤ 50 ms | ✓ met |
| Single-agent development cost | edit-latency | p95 check after an edit | 44 ms | ≤ 200 ms | ✓ met |
| Single-agent development cost | cold-check | median cold check, 10k lines | 234 ms | ≤ 1000 ms | ✓ met |
| Single-agent development cost | test-latency | median edit-then-test | 153 ms | ≤ 300 ms | ✓ met |
| Single-agent development cost | mistakes | programs with exactly one diagnostic | 100.0% | ≥ 95.0% | ✓ met |
| Single-agent development cost | mistakes | one diagnostic with the expected code | 100.0% | ≥ 95.0% | ✓ met |
| Single-agent development cost | mistakes | fix-it makes hd check pass | 52.9% | ≥ 80.0% | ✗ missed |
| Single-agent development cost | mistakes | largest diagnostic text (bytes / 4) | 85 tokens | ≤ 60 tokens | ✗ missed |
| Single-agent development cost | answer-size | hd doc of a data type | 153 B | ≤ 1000 B | ✓ met |
| Single-agent development cost | answer-size | one failing hd test, text | 318 B | ≤ 800 B | ✓ met |
| Single-agent development cost | answer-size | one failing test, JSON object | 139 B | ≤ 400 B | ✓ met |
| Single-agent development cost | answer-size | one diagnostic, JSON object | 170 B | ≤ 600 B | ✓ met |
| Single-agent development cost | determinism | inputs with byte-identical output | 8 of 8 | all identical | ✓ met |
| Single-agent development cost | pathological | overlapping-from: time at 4x | 54 ms | ≤ 2000 ms | ✓ met |
| Single-agent development cost | pathological | overlapping-from: peak RSS at 4x | 28.5 MB | ≤ 200.0 MB | ✓ met |
| Single-agent development cost | pathological | overlapping-from: growth exponent | noise | ≤ 1.3 | ✓ met |
| Single-agent development cost | pathological | deep-blocks: time at 4x | 25 ms | ≤ 2000 ms | ✓ met |
| Single-agent development cost | pathological | deep-blocks: peak RSS at 4x | 23.0 MB | ≤ 200.0 MB | ✓ met |
| Single-agent development cost | pathological | deep-blocks: growth exponent | noise | ≤ 1.3 | ✓ met |
| Single-agent development cost | pathological | deep-parens: time at 4x | 25 ms | ≤ 2000 ms | ✓ met |
| Single-agent development cost | pathological | deep-parens: peak RSS at 4x | 23.2 MB | ≤ 200.0 MB | ✓ met |
| Single-agent development cost | pathological | deep-parens: growth exponent | noise | ≤ 1.3 | ✓ met |
| Single-agent development cost | pathological | method-chain: time at 4x | 31 ms | ≤ 2000 ms | ✓ met |
| Single-agent development cost | pathological | method-chain: peak RSS at 4x | 24.8 MB | ≤ 200.0 MB | ✓ met |
| Single-agent development cost | pathological | method-chain: growth exponent | noise | ≤ 1.3 | ✓ met |
| Single-agent development cost | pathological | iterator-chain: time at 4x | 35 ms | ≤ 2000 ms | ✓ met |
| Single-agent development cost | pathological | iterator-chain: peak RSS at 4x | 24.7 MB | ≤ 200.0 MB | ✓ met |
| Single-agent development cost | pathological | iterator-chain: growth exponent | noise | ≤ 1.3 | ✓ met |
| Single-agent development cost | pathological | wide-list-literal: time at 4x | 58 ms | ≤ 2000 ms | ✓ met |
| Single-agent development cost | pathological | wide-list-literal: peak RSS at 4x | 28.4 MB | ≤ 200.0 MB | ✓ met |
| Single-agent development cost | pathological | wide-list-literal: growth exponent | noise | ≤ 1.3 | ✓ met |
| Single-agent development cost | pathological | large-enum-match: time at 4x | 37 ms | ≤ 2000 ms | ✓ met |
| Single-agent development cost | pathological | large-enum-match: peak RSS at 4x | 26.5 MB | ≤ 200.0 MB | ✓ met |
| Single-agent development cost | pathological | large-enum-match: growth exponent | noise | ≤ 1.3 | ✓ met |
| Single-agent development cost | pathological | deep-generic: time at 4x | 26 ms | ≤ 2000 ms | ✓ met |
| Single-agent development cost | pathological | deep-generic: peak RSS at 4x | 23.7 MB | ≤ 200.0 MB | ✓ met |
| Single-agent development cost | pathological | deep-generic: growth exponent | noise | ≤ 1.3 | ✓ met |
| Single-agent development cost | pathological | question-chain: time at 4x | 33 ms | ≤ 2000 ms | ✓ met |
| Single-agent development cost | pathological | question-chain: peak RSS at 4x | 27.0 MB | ≤ 200.0 MB | ✓ met |
| Single-agent development cost | pathological | question-chain: growth exponent | noise | ≤ 1.3 | ✓ met |
| Single-agent development cost | pathological | big-file: time at 4x | 185 ms | ≤ 2000 ms | ✓ met |
| Single-agent development cost | pathological | big-file: peak RSS at 4x | 56.8 MB | ≤ 200.0 MB | ✓ met |
| Single-agent development cost | pathological | big-file: growth exponent | 1.11 | ≤ 1.30 | ✓ met |
| Single-agent development cost | recheck-precision | modules rechecked, private body edit | 1 | ≤ 1 | ✓ met |
| Single-agent development cost | recheck-precision | modules rechecked, public signature edit | 9 | ≤ 3 | ✗ missed |
| Single-agent development cost | errors-per-run | semantic: 10 mistakes reported once | 10 of 10 | all, once | ✓ met |
| Single-agent development cost | errors-per-run | mixed: 10 mistakes reported once | 10 of 10 | all, once | ✓ met |
| Single-agent development cost | diag-location | diagnostics on the mistake's line | 98.6% | ≥ 95.0% | ✓ met |
| Single-agent development cost | fixit-safety | fix-its that add no error | 100.0% | ≥ 100.0% | ✓ met |
| Other | lookup-latency | p95 hd callers | - | – n/a | |
| Other | lookup-latency | p95 hd needs | - | – n/a | |
| Single-agent development cost | fmt | hd fmt, 10k lines | 37 ms | ≤ 200 ms | ✓ met |
| Single-agent development cost | fmt | second hd fmt changes nothing | no change | idempotent | ✓ met |
| Single-agent development cost | check-cost | checked run time / unchecked run time | 1.83x | ≤ 1.30x | ✗ missed |
| Single-agent development cost | dev-speed | geomean dev / optimized | 1.81x | ≤ 4.00x | ✓ met |
| Single-agent development cost | dev-speed | worst case dev / optimized | 3.65x | ≤ 10.00x | ✓ met |
| Agent scalability | resources | warm check, 10k lines: CPU time | 40 ms | ≤ 200 ms | ✓ met |
| Agent scalability | resources | warm check, 10k lines: peak RSS | 28.1 MB | ≤ 50.0 MB | ✓ met |
| Agent scalability | resources | check, small, cold | 0.20 CPU-s, 39.1 MB | completes ≤ 30 s | ✓ met |
| Agent scalability | resources | check, small, warm | 0.01 CPU-s, 20.0 MB | completes ≤ 30 s | ✓ met |
| Agent scalability | resources | test, small, cold | 1.20 CPU-s, 118.3 MB | completes ≤ 30 s | ✓ met |
| Agent scalability | resources | test, small, warm | 0.08 CPU-s, 54.5 MB | completes ≤ 30 s | ✓ met |
| Agent scalability | resources | build, small, cold | 1.01 CPU-s, 90.7 MB | completes ≤ 30 s | ✓ met |
| Agent scalability | resources | build, small, warm | 0.03 CPU-s, 33.2 MB | completes ≤ 30 s | ✓ met |
| Agent scalability | resources | check, 10k, cold | 0.54 CPU-s, 61.5 MB | completes ≤ 30 s | ✓ met |
| Agent scalability | resources | check, 10k, warm | 0.04 CPU-s, 28.1 MB | completes ≤ 30 s | ✓ met |
| Agent scalability | resources | test, 10k, cold | 1.98 CPU-s, 166.2 MB | completes ≤ 30 s | ✓ met |
| Agent scalability | resources | test, 10k, warm | 0.19 CPU-s, 72.3 MB | completes ≤ 30 s | ✓ met |
| Agent scalability | resources | build, 10k, cold | 1.40 CPU-s, 113.7 MB | completes ≤ 30 s | ✓ met |
| Agent scalability | resources | build, 10k, warm | 0.06 CPU-s, 36.7 MB | completes ≤ 30 s | ✓ met |
| Agent scalability | resources | check, 50k, cold | 2.07 CPU-s, 166.7 MB | completes ≤ 150 s | ✓ met |
| Agent scalability | resources | check, 50k, warm | 0.17 CPU-s, 58.3 MB | completes ≤ 150 s | ✓ met |
| Agent scalability | resources | test, 50k, cold | 5.16 CPU-s, 375.7 MB | completes ≤ 150 s | ✓ met |
| Agent scalability | resources | test, 50k, warm | 0.58 CPU-s, 156.1 MB | completes ≤ 150 s | ✓ met |
| Agent scalability | resources | build, 50k, cold | 2.97 CPU-s, 215.2 MB | completes ≤ 150 s | ✓ met |
| Agent scalability | resources | build, 50k, warm | 0.18 CPU-s, 67.0 MB | completes ≤ 150 s | ✓ met |
| Agent scalability | long-session | RSS growth, REPL inputs 100 to 1000 | 70.7 MB | ≤ 22.0 MB | ✗ missed |
| Agent scalability | startup | hd help (no version command): wall time | 4.4 ms | ≤ 20 ms | ✓ met |
| Agent scalability | startup | hd help (no version command): CPU time | 0.0 ms | ≤ 20 ms | ✓ met |
| Agent scalability | startup | hd help (no version command): peak RSS | 5.0 MB | ≤ 10.0 MB | ✓ met |
| Agent scalability | startup | hd check empty.hd: wall time | 21 ms | ✗ missed | |
| Agent scalability | startup | hd check empty.hd: CPU time | 10 ms | ✓ met | |
| Agent scalability | startup | hd check empty.hd: peak RSS | 17.4 MB | ✗ missed | |
| Agent scalability | concurrency | p95 latency at N = 4 vs N = 1 | 1.39x | ≤ 1.50x | ✓ met |
| Agent scalability | concurrency | p95 latency at N = 16 vs N = 1 | 1.95x | ≤ 6.00x | ✓ met |
| Agent scalability | concurrency | total CPU growth exponent, N = 1 to 16 | 0.33 | < 1.00 (sublinear) | ✓ met |
| Agent scalability | disk | artifacts plus toolchain per worktree | 22.8 MB | ✗ missed | |
| Agent scalability | parallel-speedup | speedup, 50k lines, 4 threads vs 1 | 1.87x | ≥ 2.40x | ✗ missed |
| Agent scalability | cache-contention | dependency cache, 8 concurrent fetches: no corruption | intact | no corruption | ✓ met |
| Agent scalability | cache-contention | dependency cache, 8 concurrent fetches: fetched once | 16 | ≤ 2, one check's connections | ✗ missed |
| Agent scalability | cache-contention | compilation cache, 8 concurrent checks: no corruption | intact | no corruption | ✓ met |
| Agent scalability | cache-contention | compilation cache, 8 concurrent checks: written once | 220 files | the files of one check's cache | ✗ missed |
| Agent scalability | cache-growth | cache size after 100 edits, cap 5 MB | 14.2 MB | ≤ 5.0 MB | ✗ missed |
| Agent scalability | io-per-check | source files read, warm check after one edit | 1 | ≤ 1 | ✓ met |
| Agent scalability | fetch-dedup | connections to the remote, 4 worktrees | 2 | = the first worktree's | ✓ met |
| Artifact quality | proptest-perf | property cases per second | 88k/s | ≥ 100k/s | ✗ missed |
| Artifact quality | proptest-perf | time to shrink a known failure | 28 ms | ≤ 1000 ms | ✓ met |
| Artifact quality | unit-test-perf | 1,000 unit tests, warm | 151 ms | ≤ 1000 ms | ✓ met |
| Artifact quality | unit-test-perf | overhead per unit test | 0.1 ms | ≤ 1.0 ms | ✓ met |
| Artifact quality | integration-test-perf | setup per integration test program | 25 ms | ≤ 20 ms | ✗ missed |
| Artifact quality | integration-test-perf | total time growth in programs | 0.884 | exponent < 1 (sublinear) | ✓ met |
| Artifact quality | integration-test-perf | cost per doc test | 20 ms | ≤ 20 ms | ✗ missed |
| Artifact quality | runtime | geomean hd / Node | 0.57x | ≤ 1.50x | ✓ met |
| Artifact quality | runtime | fib: hd / Node | 0.75x | ≤ 3.00x | ✓ met |
| Artifact quality | runtime | sum: hd / Node | 0.18x | ≤ 3.00x | ✓ met |
| Artifact quality | runtime | string-build: hd / Node | 0.78x | ≤ 3.00x | ✓ met |
| Artifact quality | runtime | map: hd / Node | 1.17x | ≤ 3.00x | ✓ met |
| Artifact quality | runtime | sort: hd / Node | 0.52x | ≤ 3.00x | ✓ met |
| Artifact quality | allocations | counted loop, bytes per iteration | - | 0 allocations (< 1 B/iter) | – n/a |
| Artifact quality | allocations | list loop, bytes per iteration | - | 0 allocations (< 1 B/iter) | – n/a |
| Artifact quality | allocations | map loop, bytes per iteration | - | 0 allocations (< 1 B/iter) | – n/a |
| Artifact quality | allocations | iterator chain, bytes per iteration | - | ≤ 1 allocation (≤ 32 B/iter) | – n/a |
| Artifact quality | size-startup-heap | tiny program, release Wasm size | 5014 B | ≤ 2048 B | ✗ missed |
| Artifact quality | host-call-overhead | Console println, per call | 2.9 µs | ≤ 1.0 µs | ✗ missed |
| Artifact quality | host-call-overhead | Fs read_text!, per call | 12 µs | ≤ 10 µs | ✗ missed |
| Artifact quality | host-call-overhead | serde boundary (list_dir!), per call | 19 µs | ≤ 5.0 µs | ✗ missed |
| Artifact quality | suspension-overhead | await of a ready value, per await | 15 ns | ≤ 100 ns | ✓ met |
| Artifact quality | suspension-overhead | all! of two ready tasks, throughput | 7.4M/s | ≥ 1.0M/s | ✓ met |
| Artifact quality | suspension-overhead | race! of two ready tasks, throughput | 4.8M/s | ≥ 1.0M/s | ✓ met |
| Artifact quality | serde-throughput | JSON encode, hd / Node MB/s | 0.13x | ≥ 0.50x | ✗ missed |
| Artifact quality | serde-throughput | JSON decode, hd / Node MB/s | 0.15x | ≥ 0.50x | ✗ missed |
| Artifact quality | text-throughput | string build, hd / Node MB/s | 1.46x | ≥ 0.50x | ✓ met |
| Artifact quality | text-throughput | split, hd / Node MB/s | 0.74x | ≥ 0.50x | ✓ met |
| Artifact quality | text-throughput | regex find_all, hd / Node MB/s | 0.05x | ≥ 0.50x | ✗ missed |
| Artifact quality | dead-code | Wasm bytes per 1,000 lines | 6516 B | ≤ 10240 B | ✓ met |
| Artifact quality | dead-code | no unused std in the program | none | none | ✓ met |
| Artifact quality | long-run-memory | RSS growth after warm-up, 1 min | 0.0 MB | ≤ 10.0 MB | ✓ met |
| Correctness gate | conformance | pass rate, known failures excluded | 100.0% | ≥ 100.0% | ✓ met |
| Correctness gate | conformance | listed known failures | 3 | ≤ 0 | ✗ missed |
| Correctness gate | incremental-soundness | incremental equals clean, after each edit | 100.0% | ≥ 100.0% | ✓ met |
| Artifact quality | size-startup-heap | tiny program, start to first output | 9.4 ms | ≤ 5.0 ms | ✗ missed |
| Artifact quality | size-startup-heap | peak heap, map: hd / Node | 0.91x | ≤ 2.00x | ✓ met |
| Artifact quality | size-startup-heap | peak heap, string-build: hd / Node | 0.46x | ≤ 2.00x | ✓ met |
| Single-agent development cost | scale | fn-items check | 4.04x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | fn-items fmt | 4.01x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | fn-items build | 4.01x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | struct-items check | 4.03x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | struct-items fmt | 4.01x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | struct-items build | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | enum-items check | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | enum-items fmt | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | enum-items build | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | trait-items check | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | trait-items fmt | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | trait-items build | 4.02x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | impl-methods check | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | impl-methods fmt | 3.97x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | impl-methods build | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | impls-of-one-trait check | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | impls-of-one-trait fmt | 4.01x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | impls-of-one-trait build | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | operator-impls check | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | operator-impls fmt | 4.01x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | operator-impls build | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | derive-items check | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | derive-items fmt | 4.01x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | derive-items build | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | dyn-values check | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | dyn-values fmt | 4.01x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | dyn-values build | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | consts check | 3.97x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | consts fmt | 3.89x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | consts build | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | local-items check | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | local-items fmt | 4.01x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | local-items build | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | syntax-items check | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | syntax-items fmt | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | syntax-items build | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | struct-chain check | 4.04x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | struct-chain fmt | 4.01x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | modules check | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | modules fmt | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | modules build | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | use-names check | 4.04x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | use-names fmt | 4.01x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | use-names build | 4.02x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | generic-fns check | 4.03x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | generic-fns fmt | 4.01x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | generic-fns build | 4.01x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | generic-params check | 4.08x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | generic-params fmt | 4.10x | ≤ 10x | ✓ met |
| Single-agent development cost | scale | generic-params build | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | param-bounds check | 4.01x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | param-bounds fmt | 4.04x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | param-bounds build | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | type-defaults check | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | type-defaults fmt | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | type-defaults build | 4.01x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | row-chain check | 4.02x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | row-chain fmt | 4.01x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | row-chain build | 4.01x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | row-traits check | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | row-traits fmt | 4.04x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | row-traits build | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | closures check | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | closures fmt | 3.94x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | closures build | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | let-statements check | 3.96x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | let-statements fmt | 3.94x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | let-statements build | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | matches check | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | matches fmt | 3.97x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | matches build | 4.42x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | enum-arms check | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | enum-arms fmt | 3.91x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | enum-arms build | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | tuple-patterns check | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | tuple-patterns fmt | 3.95x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | tuple-patterns build | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | range-patterns check | 4.02x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | range-patterns fmt | 4.01x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | range-patterns build | 4.01x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | wide-struct check | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | wide-struct fmt | 3.95x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | wide-struct build | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | call-args check | 4.42x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | call-args fmt | 4.10x | ≤ 10x | ✓ met |
| Single-agent development cost | scale | call-args build | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | binary-chain check | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | binary-chain fmt | 3.78x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | binary-chain build | 4.02x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | interpolation check | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | interpolation fmt | - | ≤ 5x | ✓ met |
| Single-agent development cost | scale | interpolation build | 4.04x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | list-literal check | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | list-literal fmt | 3.82x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | list-literal build | 4.01x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | method-chain check | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | method-chain fmt | 4.04x | ≤ 10x | ✓ met |
| Single-agent development cost | scale | method-chain build | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | pipe-chain check | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | pipe-chain fmt | 3.77x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | pipe-chain build | 3.98x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | question-chain check | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | question-chain fmt | 3.94x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | question-chain build | 3.99x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | if-nest check | 3.92x | ≤ 15.11x | ✓ met |
| Single-agent development cost | scale | if-nest fmt | - | ≤ 15.11x | ✓ met |
| Single-agent development cost | scale | if-nest build | 4.00x | ≤ 15.11x | ✓ met |
| Single-agent development cost | scale | block-nest check | 3.95x | ≤ 15.29x | ✓ met |
| Single-agent development cost | scale | block-nest fmt | - | ≤ 15.29x | ✓ met |
| Single-agent development cost | scale | block-nest build | 3.95x | ≤ 15.29x | ✓ met |
| Single-agent development cost | scale | for-nest check | 5.23x | ≤ 14.5x | ✓ met |
| Single-agent development cost | scale | for-nest fmt | - | ≤ 14.5x | ✓ met |
| Single-agent development cost | scale | for-nest build | 4.69x | ≤ 14.5x | ✓ met |
| Single-agent development cost | scale | while-nest check | 3.88x | ≤ 15.11x | ✓ met |
| Single-agent development cost | scale | while-nest fmt | - | ≤ 15.11x | ✓ met |
| Single-agent development cost | scale | while-nest build | 4.00x | ≤ 15.11x | ✓ met |
| Single-agent development cost | scale | match-nest check | 4.87x | ≤ 16.03x | ✓ met |
| Single-agent development cost | scale | match-nest fmt | - | ≤ 16.03x | ✓ met |
| Single-agent development cost | scale | match-nest build | 4.34x | ≤ 16.03x | ✓ met |
| Single-agent development cost | scale | closure-nest check | 3.95x | ≤ 11.45x | ✓ met |
| Single-agent development cost | scale | closure-nest fmt | - | ≤ 11.45x | ✓ met |
| Single-agent development cost | scale | closure-nest build | 4.00x | ≤ 11.45x | ✓ met |
| Single-agent development cost | scale | option-nest check | 4.18x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | option-nest fmt | - | ≤ 5x | ✓ met |
| Single-agent development cost | scale | option-nest build | 4.04x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | list-type-nest check | 4.27x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | list-type-nest fmt | - | ≤ 5x | ✓ met |
| Single-agent development cost | scale | list-type-nest build | 4.27x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | generic-nest check | 4.34x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | generic-nest fmt | - | ≤ 5x | ✓ met |
| Single-agent development cost | scale | generic-nest build | 4.04x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | paren-nest check | - | ≤ 5x | ✓ met |
| Single-agent development cost | scale | paren-nest fmt | - | ≤ 5x | ✓ met |
| Single-agent development cost | scale | paren-nest build | 4.16x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | arith-nest check | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | arith-nest fmt | - | ≤ 5x | ✓ met |
| Single-agent development cost | scale | arith-nest build | 4.16x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | bool-nest check | 3.95x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | bool-nest fmt | - | ≤ 5x | ✓ met |
| Single-agent development cost | scale | bool-nest build | 4.24x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | bit-nest check | 3.99x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | bit-nest fmt | - | ≤ 5x | ✓ met |
| Single-agent development cost | scale | bit-nest build | 4.09x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | tuple-nest check | 4.06x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | tuple-nest fmt | - | ≤ 5x | ✓ met |
| Single-agent development cost | scale | tuple-nest build | 4.18x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | if-expr-nest check | 3.76x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | if-expr-nest fmt | - | ≤ 5x | ✓ met |
| Single-agent development cost | scale | if-expr-nest build | 3.82x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | call-nest check | 3.89x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | call-nest fmt | - | ≤ 5x | ✓ met |
| Single-agent development cost | scale | call-nest build | 3.33x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | index-nest check | - | ≤ 5x | ✓ met |
| Single-agent development cost | scale | index-nest fmt | - | ≤ 5x | ✓ met |
| Single-agent development cost | scale | index-nest build | 4.16x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | fn-nest check | 4.03x | ≤ 13.42x | ✓ met |
| Single-agent development cost | scale | fn-nest fmt | - | ≤ 13.42x | ✓ met |
| Single-agent development cost | scale | fn-nest build | 4.00x | ≤ 13.42x | ✓ met |
| Single-agent development cost | scale | module-path-nest check | 1.58x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | module-path-nest fmt | - | ≤ 5x | ✓ met |
| Single-agent development cost | scale | module-path-nest build | 1.55x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | coverage: node kinds | 119/119 | 119/119 | ✓ met |
| Single-agent development cost | scale | coverage: node kinds repeated | 110/119 | reported | ✓ met |
| Single-agent development cost | scale | coverage: node kinds nested | 57/119 | reported | ✓ met |
| Single-agent development cost | scale | traits-of-one-struct check | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | traits-of-one-struct fmt | 4.01x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | traits-of-one-struct build | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | struct-chain-values check | 4.04x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | struct-chain-values fmt | 4.02x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | struct-chain-values build | 4.00x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | alias-chain check | 4.01x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | alias-chain fmt | 4.03x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | alias-chain build | 4.00x | ≤ 5x | ✓ met |
| Agent scalability | startup | hd check empty.hd, just written: wall time | 18 ms | ≤ 20 ms | ✓ met |
| Agent scalability | startup | hd check empty.hd, just written: CPU time | 10 ms | ≤ 20 ms | ✓ met |
| Agent scalability | startup | hd check empty.hd, just written: peak RSS | 19.0 MB | ≤ 10.0 MB | ✗ missed |
| Agent scalability | startup | hd check empty.hd, settled: wall time | 7.1 ms | ≤ 20 ms | ✓ met |
| Agent scalability | startup | hd check empty.hd, settled: CPU time | 0.0 ms | ≤ 20 ms | ✓ met |
| Agent scalability | startup | hd check empty.hd, settled: peak RSS | 9.8 MB | ≤ 10.0 MB | ✓ met |
| Agent scalability | disk | artifacts per worktree | 0.0 MB | ≤ 10.0 MB | ✓ met |
| Agent scalability | disk | toolchain, once per machine | 32.0 MB | recorded, no target | ✓ met |
| Single-agent development cost | scale | generic-local-fns check | 4.03x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | generic-local-fns fmt | 4.01x | ≤ 5x | ✓ met |
| Single-agent development cost | scale | generic-local-fns build | 4.01x | ≤ 5x | ✓ met |