Issue 4940: Add skip deployment flag for PR bot tests#4947
Issue 4940: Add skip deployment flag for PR bot tests#4947stuart-bass-cgi wants to merge 4 commits into
Conversation
There was a problem hiding this comment.
Pull request overview
Adds a skip_deployment flag to PR comment bot /test and /test-extended commands so maintainers can rerun smoke/extended E2E tests against an already-deployed deterministic PR validation environment, avoiding the full build/deploy pipeline when appropriate.
Changes:
- Extended PR bot command parsing to recognize
skip_deploymentand pass it through to the reusable deployment workflow. - Updated the reusable workflow to conditionally bypass deployment/build stages and still run smoke/custom E2E jobs.
- Updated developer docs and added unit tests covering the new command parsing behavior.
Reviewed changes
Copilot reviewed 5 out of 5 changed files in this pull request and generated 3 comments.
Show a summary per file
| File | Description |
|---|---|
| docs/tre-developers/github-pr-bot-commands.md | Documents the new skip_deployment flag syntax and fork PR examples for /test and /test-extended. |
| .github/workflows/pr_comment_bot.yml | Plumbs skipDeployment output from the parsing script into the reusable workflow call. |
| .github/workflows/deploy_tre_reusable.yml | Adds skipDeployment input and adjusts E2E job conditions to allow running tests when deployment is skipped. |
| .github/scripts/build.js | Parses skip_deployment, emits skipDeployment output, and updates external-PR SHA extraction to ignore the flag. |
| .github/scripts/build.test.js | Adds unit tests validating skipDeployment output behavior for internal and external PR command forms. |
|
@microsoft-github-policy-service agree company="CGI" |
|
@stuart-bass-cgi thanks for the PR. A review with Opus 4.8 says: I Overall: Well-structured, focused change that solves a real developer pain point (re-running smoke/extended E2E tests without a full redeploy). Good test coverage and docs, plus a couple of nice opportunistic bug fixes. A few items to confirm before approval. 🟢 Done well
🟠 To address
🟡 Nits
Verdict: LGTM pending confirmation of (1) smoke-test check reporting and (2) the intentional flag asymmetry. Let me know if you agree! |
Resolves #4940
What is being addressed
PR bot
/testand/test-extendedcommands currently always run the full validation flow, including build and deployment jobs, even when the PR validation environment has already been deployed. This makes it slow to re-run smoke or extended E2E tests after transient test failures or test-only changes.How is this addressed
skip_deploymentflag for the/testand/test-extendedPR bot commands.skip_deploymentis true, skips the deployment/build/register jobs and allows the smoke and requested custom E2E jobs to run against the existing deterministic PR validation environment.skip_deploymentis supplied.