feat(async): parse budgets report the measurement that failed

Both `duration_ms < 100` assertions --- src/async_runtime.rs and
tests/m4_acceptance.rs --- now print the observed value and the budget.
Neither budget moves.

dispatch_parse_round_trips_a_rust_source_file redded twice on
macOS/lua54, as U11 and again on #243, and BOTH margins were
unrecoverable: the message said only "trivial parse should be fast", so
the second red could not be compared with the first. A 1ms overshoot and
a 900ms overshoot are different failures that produced identical logs.
U11 predicted that cost in writing, and it came true once.

D1 and D2 are verified against REAL PANIC MESSAGES, by forcing only the
comparison bound to 0 in a scratch build:

  trivial parse should be fast: took 0ms against a 100ms budget
  200-line parse should be quick: took 11ms against a 100ms budget

The second is the stronger demonstration --- a non-zero observed value
cannot be mistaken for a literal.

That scratch panic proves only half. It exercises a budget of 0 while
printing 100ms, so it says nothing about the committed threshold. D3
carries that half separately by pinning the literal 100 in both files.
The two are a proof together and neither substitutes for the other.

The framing withdraws revision 1's claim that the async_runtime
assertion was the codebase's sole measurement-omitting one. It was not:
tests/m4_acceptance.rs:244 is the same measurement against the same
budget. The claim is withdrawn rather than repaired, because a sweep
wide enough to be complete also catches `Instant::now() < deadline` loop
guards and `eval::<bool>` turbofish, while one narrow enough to be
accurate proves nothing about completeness. This is not an
assertion-hygiene audit.

workflow_dispatch was split out per the ledger's own recorded decision;
it and U9's still-unrun discriminating control remain separate lanes.

Framing docs/parse-budget-diagnosability-framing.md revision 2, approved.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_016bqGA6s9tTUFzYpbeW3tai
This commit is contained in:
Levi Neuwirth 2026-08-29 16:43:37 +02:00
parent 355777990f
commit 493e8ee36b
No known key found for this signature in database
4 changed files with 206 additions and 2 deletions

View File

@ -270,6 +270,52 @@ hazard in a shape that looks committed. **A documented error message
that never appears is worse than no documentation**, because the reader
waits for a signal that is not coming.
## Parse-budget diagnosability — ACTIVE
**Written with the branch's FIRST commit**, per the standing correction
from #171 and #215.
- **Branch `parse-budget-diagnosability`**, base `githubsucks/main` @
**`3557779`** exactly, in worktree
`/home/jeans/Repos/personal/pmacs-parse-budget`.
**`githubsucks/parse-budget-diagnosability` is the authoritative
tip** (the ref, not a SHA). Recover with `git fetch githubsucks &&
git checkout parse-budget-diagnosability`.
- **Framing `docs/parse-budget-diagnosability-framing.md`, revision 2 —
APPROVED.** Revision 1 was reviewed and had two defects worth
keeping: it claimed `dispatch_parse_round_trips_a_rust_source_file`
was the codebase's **sole** measurement-omitting assertion (false —
`tests/m4_acceptance.rs:244` is the same budget on the same
measurement), and it bundled `workflow_dispatch`, which this ledger
had already recorded as its own lane.
- **What it does:** both `duration_ms < 100` assertions now report the
observed value and the budget. **Neither budget moves.**
- **Why:** `dispatch_parse_round_trips_a_rust_source_file` redded twice
on macOS/`lua54` — U11, then again on #243 — and **both margins were
unrecoverable**, so the second red could not be compared with the
first. A 1ms overshoot and a 900ms overshoot are different failures
and produced identical logs.
- **D1/D2 verified against REAL PANIC MESSAGES**, by forcing only the
comparison bound to `0` in a scratch build:
- `trivial parse should be fast: took 0ms against a 100ms budget`
- `200-line parse should be quick: took 11ms against a 100ms budget`
The second is the stronger demonstration: a non-zero observed value
cannot be mistaken for a literal.
- **THE SCRATCH PANIC PROVES ONLY HALF.** It exercises a budget of
**0** while printing `100ms`, so it says nothing about the committed
threshold. **D3 carries that half separately** by pinning the literal
`100` in both files. The two are a proof together; neither
substitutes for the other.
- **NOT an assertion-hygiene audit.** The framing's §3 withdraws
revision 1's completeness claim rather than repairing it: a sweep
wide enough to be complete also catches `Instant::now() < deadline`
loop guards and `eval::<bool>` turbofish, and a sweep narrow enough
to be accurate proves nothing about completeness.
- **Still owed, separately:** `workflow_dispatch` on `ci.yml`, and U9's
discriminating control — pin test-binary concurrency to 1, then load
a lone `--lib` binary — which has been named since 2026-08-09 and
never run.
## Panel-pointer replay (parent acceptance 48) — MERGED as #243 (`6c9bae6`)
- **MERGED 2026-08-29T10:37:10Z** at approved head `b8c51b7`, merge

View File

@ -0,0 +1,150 @@
# Parse-budget diagnosability — reporting the measurement that failed
**Status: revision 2 — AWAITING APPROVAL. Nothing implemented.**
Revision 2 answers review of 1. Three of its four changes are
corrections, and one is a scope reduction:
- **SPLIT.** Revision 1 bundled this with adding `workflow_dispatch` to
`ci.yml`. `docs/active-work.md` already records those as "two
follow-ups … both their own lanes", and a shared thesis is not an
atomic feature boundary. **`workflow_dispatch` is no longer in this
framing**; it gets its own.
- **The census was WRONG.** Revision 1 called
`dispatch_parse_round_trips_a_rust_source_file` the sole outlier.
`tests/m4_acceptance.rs:244` asserts the same measurement against the
same budget and also omits it. **Both are now in scope.**
- **The completeness claim is WITHDRAWN**, not repaired. See §3.
- The concurrency reasoning revision 1 got backwards belonged to the
other change and leaves with it.
## 1. What this fixes
Two assertions compare a parse duration against a 100ms budget and
report **nothing** about what they measured:
| where | assertion | message |
|---|---|---|
| `src/async_runtime.rs:3328` | `duration_ms < 100` | `"trivial parse should be fast"` |
| `tests/m4_acceptance.rs:244` | `duration_ms < 100` | `"200-line parse should be quick"` |
When either reds, the log says the parse was slow and stops there.
## 2. Why now, and the evidence
The first has redded **twice** on `Test (macos-latest / lua54)`, and
**both margins are unrecoverable**:
| occurrence | where | outcome |
|---|---|---|
| U11 | PR #242, run `32393462318`, job `96504773333` | red, green on rerun |
| U11's recurrence | PR #243, run `33156571314`, job `98800645872` | red, green on rerun |
`src/async_runtime.rs` was **byte-identical to `main`** for both — blob
`9310ce3fca8c5fd8ebd39a68c29ad6985e256049`. U11's own row predicted the
cost:
> *A recurrence is not another instance of this row. Because the margin
> was never captured, a second red cannot be compared with the first.*
That came true once. Nothing prevents a third.
**A 1ms overshoot and a 900ms overshoot are different failures** — one
says a threshold is marginal, the other says something stalled — and
today they produce identical logs.
## 3. Scope, and a claim this framing does NOT make
**In scope: the two assertions in §1.** They are the same measurement
against the same budget, in the same subsystem, and it would be strange
to fix one and leave the other to produce the next unreadable red.
**Out of scope, and deliberately: everything else.** Revision 1 claimed
these were the only measurement-omitting assertions in the codebase.
**That claim is withdrawn and is not replaced by a corrected one.** A
sweep wide enough to be complete also catches `Instant::now() <
deadline` loop guards and `eval::<bool>` turbofish, which are not
budget assertions at all; a sweep narrow enough to be accurate proves
nothing about completeness. **This lane is not an assertion-hygiene
audit and should not be read as one.**
Several nearby budget assertions do already report their measurements —
`composition_overhead_under_ten_percent`, `criterion_1_end_of_line_typing…`
(`optimistic.rs:989`), `dired_open_renders_10k_entries_under_200ms`,
`m6_2_pty_streaming_respects_byte_ceiling` (`observed {in_flight}`).
They are cited as **precedent for the shape**, not as evidence that the
set is exhausted.
## 4. What lands
```rust
assert!(
duration_ms < 100,
"trivial parse should be fast: took {duration_ms}ms against a \
100ms budget"
);
```
and, in `tests/m4_acceptance.rs`:
```rust
assert!(
duration_ms < 100,
"200-line parse should be quick: took {duration_ms}ms against a \
100ms budget"
);
```
**Both budgets stay at 100ms.** Widening is what R1 already rejected,
and it would discard the signal these reds carry.
## 5. Acceptance
| # | contract | witness | mutation |
|---|---|---|---|
| D1 | the `async_runtime` assertion reports the observed ms **and** the budget | a scratch build with the comparison bound forced to `0` panics with a message containing the observed value and `100ms` | restore the bare message → the row cannot separate a 1ms overshoot from a 900ms one |
| D2 | the `m4_acceptance` assertion does the same | same method, same row | same |
| D3 | both budgets are still `100` | the comparison literal is unchanged in both files | widen either → R1's rejected remedy returns |
**D1 and D2 are asserted against a real panic message, not by reading
the source.** A row that greps the format string would pass while the
assertion it describes had been deleted — which is the same
read-the-code-not-the-effect failure this project has repeatedly
caught.
**How the fault is injected, and what each half proves.** Temporarily
force **only the comparison bound** to `0` in a scratch build. The
resulting panic then proves two things and no more: that the observed
value is interpolated, and that the budget text reads `100ms`.
**It does NOT prove the exercised budget was 100ms — it was 0.** The
scratch build compares against `0` while the message still says `100ms`,
so that panic alone says nothing about the committed threshold. **D3
carries that half separately**, by pinning the comparison literal in
both files. The two rows are only a proof together, and neither
substitutes for the other.
This is the **smallest deterministic fault injection** available, not
the only conceivable one. A row that waited for a genuine 100ms
overshoot would be exactly as intermittent as the thing it documents.
## 6. Coherence impact (`COHERENCE.md` §20)
- **Journey steps touched: NONE.** No product behaviour changes. What
moves is **evidence quality** — whether a failing check can be
reasoned about — the same axis the `scripts/gate` SIGINT guard sat
on.
- **Interaction islands: none added.**
- **Config registry: no entry.** A test budget is not a user-tunable.
- **Background work: none started**, and no attribution moves.
## 7. What this does NOT do
- **It does not fix the intermittence**, and makes no claim about
cause. It makes the next occurrence *comparable*.
- **It does not widen, relax or `#[ignore]` any budget.** Two
intermittent reds are not evidence a threshold is wrong.
- **It does not add `workflow_dispatch`.** That is its own lane, per
the ledger's recorded decision.
- **It does not run U9's discriminating control**, which remains
unrun and is a third, separate piece of work.

View File

@ -3325,7 +3325,11 @@ mod tests {
.expect("parse handoff must hold a bundle on Complete");
match rt.take_result(id) {
Some(JobOutcome::Complete(JobResult::Parse { duration_ms })) => {
assert!(duration_ms < 100, "trivial parse should be fast");
assert!(
duration_ms < 100,
"trivial parse should be fast: took {duration_ms}ms \
against a 100ms budget"
);
}
other => panic!("unexpected outcome: {other:?}"),
}

View File

@ -241,7 +241,11 @@ fn m4_1_dispatch_parse_round_trips_via_runtime() {
.expect("parse handoff holds bundle on Complete");
match rt.take_result(id) {
Some(JobOutcome::Complete(JobResult::Parse { duration_ms })) => {
assert!(duration_ms < 100, "200-line parse should be quick");
assert!(
duration_ms < 100,
"200-line parse should be quick: took {duration_ms}ms \
against a 100ms budget"
);
}
other => panic!("unexpected outcome: {other:?}"),
}