Skip to content

Green is not the bar, and the list no longer says both - #6

Merged
makseq merged 1 commit into
mainfrom
fix/harness-bar
Aug 10, 2026
Merged

Green is not the bar, and the list no longer says both#6
makseq merged 1 commit into
mainfrom
fix/harness-bar

Conversation

@makseq

@makseq makseq commented Aug 10, 2026

Copy link
Copy Markdown
Member

Step 3 of the ordered path demanded that python -m pytest be green, then two bullets later explained that a node which transforms its inputs legitimately fails several of those tests — the reference node copies its inputs to its outputs, and tests/test_inputs.py says in its own docstring that the contract requires none of that.

A reader who acts on the first bullet never reaches the third. And the obvious way to make a copies-its-inputs test pass is to stop transforming the data, so the instruction would have destroyed correct nodes while looking like diligence.

The first bullet now says what the command is and what a green result would actually mean. The bar stays where it belongs — in the bullet that explains which tests a correct node is allowed to fail.

Found by review of the orchestrator PR that sends coding agents here.

🤖 Generated with Claude Code

Step 3 opened by demanding that `python -m pytest` be green and then, two
bullets later, explained that a node which transforms its inputs fails several
of those tests honestly. Both statements were in the same list, and a reader
who acts on the first one never reaches the third: the obvious way to turn a
copies-its-inputs test green is to stop transforming the data, so the
instruction destroyed correct nodes while looking like diligence.

The first bullet now says what the command is and what a green result would
mean; the bar itself is where it belongs, in the bullet that explains which
tests a correct node is allowed to fail.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@makseq
makseq merged commit 3693206 into main Aug 10, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant