Skip to content

Use preinstalled Chrome for E2E tests - #2488

Open
ejsmith wants to merge 5 commits into
mainfrom
feature/ci-use-preinstalled-chrome
Open

Use preinstalled Chrome for E2E tests#2488
ejsmith wants to merge 5 commits into
mainfrom
feature/ci-use-preinstalled-chrome

Conversation

@ejsmith

@ejsmith ejsmith commented Aug 18, 2026

Copy link
Copy Markdown
Member

What changed

  • run the required E2E job against Google Chrome already installed on the GitHub Ubuntu runner
  • keep local Playwright behavior unchanged unless E2E_BROWSER_CHANNEL is set
  • replace the Chromium and Ubuntu package installation with Playwright's 2.3 MiB FFmpeg helper so retained failure videos still work

Why

The release run that motivated this experiment spent 6m06s installing Playwright Chromium. About 5m45s was a slow Ubuntu package download; the browser archives themselves took only seconds. Recent runs normally spend about 20-30 seconds here, but the network-dependent step has an unbounded tail.

This PR intentionally changes only the browser provisioning path so its hosted timing is attributable.

Verification

  • npm run check
  • CI=true E2E_BROWSER_CHANNEL=chrome npx playwright test --list --project=chromium (28 tests discovered)
  • npx prettier --check playwright.config.ts
  • workflow YAML parsed successfully
  • three hosted E2E passes, all 28 tests each

Measurement

Compare the test-e2e job and browser-install portion with:

Hosted sample FFmpeg install Playwright tests E2E job Retries
1 2s 6m25s 9m57s 1
2 2s 6m28s 9m52s 1
3 2s 6m23s 9m52s 1

All three samples passed the same 28 tests. The single retry in each was the existing list-query-cache.e2e.ts flake, not a browser-specific failure. During the paired second sample, the unchanged Chromium install took 3m56s while this FFmpeg step remained at 2s.

The typical E2E job improvement is modest because the historical browser-install median was only 23 seconds, but the experiment removes a reproduced multi-minute tail: 6m06s in the motivating run and 3m56s in the paired repeat.

Breaking changes

None.

@ejsmith
ejsmith marked this pull request as ready for review August 18, 2026 04:45
@github-actions

Copy link
Copy Markdown

Code Coverage

Package Line Rate Branch Rate Complexity Health
Exceptionless.Insulation 37% 35% 286
Exceptionless.Core 75% 67% 10184
Exceptionless.Web 85% 69% 7903
Exceptionless.AppHost 38% 41% 147
Summary 78% (25167 / 32154) 67% (11819 / 17554) 18520

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants