Skip to content

fix(ci): stop including broken catalog index defaults, disable affected tests#5133

Draft
jonkoops wants to merge 2 commits into
redhat-developer:mainfrom
jonkoops:chore/fix-ci-catalog-index-defaults
Draft

fix(ci): stop including broken catalog index defaults, disable affected tests#5133
jonkoops wants to merge 2 commits into
redhat-developer:mainfrom
jonkoops:chore/fix-ci-catalog-index-defaults

Conversation

@jonkoops

@jonkoops jonkoops commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Stop including dynamic-plugins.default.yaml from the catalog index in CI value files — the :1.11 / :next index references OCI images on registry.access.redhat.com that are not publicly accessible, causing all 9 default plugins to fail to install
  • Disable tests that depend on plugins no longer available in the catalog index defaults (home-page-customization, verify-redis-cache)
  • Remove http-request.spec.ts (migrated to overlay repo's roadie-backstage-plugins workspace, source-verified 1:1 functional match)
  • Clean up stale plugins/rbac/** testIgnore references (directory was removed during RBAC plugin migration)

Root Cause

The :next / :1.11 catalog index image (quay.io/rhdh/plugin-catalog-index) ships a dynamic-plugins.default.yaml that is only 126 lines (vs 1233 in :1.10). All 9 remaining plugin entries reference registry.access.redhat.com/rhdh/... OCI digests that are not accessible:

oci://registry.access.redhat.com/rhdh/backstage-community-plugin-scaffolder-backend-module-regex@sha256:...
oci://registry.access.redhat.com/rhdh/backstage-community-plugin-tech-radar@sha256:...
oci://registry.access.redhat.com/rhdh/backstage-plugin-kubernetes-backend@sha256:...
...

When CI deploys RHDH with includes: ["dynamic-plugins.default.yaml"], the init container tries to pull these images, fails, and the app starts without any default plugins. This causes the MuiCircularProgress loading spinner to never settle, making all tests flaky (10 flaky, 2 permanently failed in #5122's CI run).

Test plan

  • e2e-ocp-helm CI passes — this is the blocker
  • Remaining tests (smoke, guest-signin, catalog-timestamp, annotator, scaffolder-relation-processor, application-provider/listener, licensed-users-info, learning-path, sidebar, settings, audit-log, instance-health-check) all pass without the broken defaults

Builds on #5113 (OCI ref migration). Unblocks #5122 (dynamic catalog index resolution).

Refs: RHIDP-14348

Replace all ./dynamic-plugins/dist/ wrapper paths in CI configs, E2E
tests, and scripts with explicit OCI image tags from the plugin export
overlays metadata.

Bump the catalog index image from quay.io/rhdh/plugin-catalog-index:1.10
to quay.io/rhdh/plugin-catalog-index:2.1 to match the current main
branch target.

Remove dead OCM plugin entries from the GKE config and the
corresponding stale ocm.spec.ts test ignore.

Refs: RHDHPLAN-256, RHDHPLAN-934
Signed-off-by: Jon Koops <jonkoops@gmail.com>
@openshift-ci

openshift-ci Bot commented Jul 21, 2026

Copy link
Copy Markdown

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

@codecov

codecov Bot commented Jul 21, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 55.48%. Comparing base (5992bdd) to head (2ba225a).
⚠️ Report is 4 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #5133      +/-   ##
==========================================
- Coverage   56.03%   55.48%   -0.55%     
==========================================
  Files         123      111      -12     
  Lines        2404     2186     -218     
  Branches      553      546       -7     
==========================================
- Hits         1347     1213     -134     
+ Misses       1051      972      -79     
+ Partials        6        1       -5     
Flag Coverage Δ
rhdh 55.48% <ø> (-0.55%) ⬇️

Continue to review full report in Codecov by Harness.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5992bdd...2ba225a. Read the comment docs.

🚀 New features to boost your workflow:
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@jonkoops

Copy link
Copy Markdown
Contributor Author

/test all

@github-actions

Copy link
Copy Markdown
Contributor

Image was built and published successfully. It is available at:

@jonkoops
jonkoops force-pushed the chore/fix-ci-catalog-index-defaults branch from 877df16 to d4e2d39 Compare July 21, 2026 18:23
@github-actions

Copy link
Copy Markdown
Contributor

Image was built and published successfully. It is available at:

@jonkoops

Copy link
Copy Markdown
Contributor Author

/test all

…ed tests

The :1.11 / :next catalog index's dynamic-plugins.default.yaml references
OCI images on registry.access.redhat.com that are not publicly accessible.
When included, the init container fails to install all 9 default plugins,
causing the app to start without core UI plugins and making tests fail.

Stop including dynamic-plugins.default.yaml from the catalog index. Add
the dynamic-home-page plugin explicitly as an OCI ref (required by the
smoke test's "Welcome back!" heading check and the home-page-customization
tests). All other plugins needed by CI tests are already listed explicitly
as OCI refs in the values files.

Disable verify-redis-cache.spec.ts (needs techdocs frontend plugin which
is not available as an OCI ref yet).

Remove http-request.spec.ts (migrated to overlay repo's
roadie-backstage-plugins workspace, source-verified 1:1 match).

Clean up stale plugins/rbac/** testIgnore references (directory removed
during RBAC migration).

Refs: RHIDP-14348
Signed-off-by: Jon Koops <jonkoops@gmail.com>
@jonkoops
jonkoops force-pushed the chore/fix-ci-catalog-index-defaults branch from d4e2d39 to 2ba225a Compare July 22, 2026 09:09
@sonarqubecloud

Copy link
Copy Markdown

@jonkoops

Copy link
Copy Markdown
Contributor Author

/test e2e-ocp-helm

@github-actions

Copy link
Copy Markdown
Contributor

Image was built and published successfully. It is available at:

@openshift-ci

openshift-ci Bot commented Jul 22, 2026

Copy link
Copy Markdown

@jonkoops: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-ocp-helm 2ba225a link true /test e2e-ocp-helm

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant