test(e2e): align specs with the community edition and record the e2e baseline
The first full e2e run on this branch failed 19 tests, all on features the community edition removed: /api/tier, Stripe, /api/compliance, the billing settings tab, the payment pages and the upgrade dialog. Those checks now assert that the endpoints and pages are gone (404); tier, billing and team-settings probes are dropped from the remaining journeys. The rerun is 410 passed, 18 skipped, 0 failed.
This commit is contained in:
@@ -58,17 +58,23 @@ than at the baseline is expected: the removed code took its tests with it.
|
||||
| Lint, web | 38 errors, 60 warnings (all pre-existing; down from 49 errors) |
|
||||
| Unit tests, root | 638 files, 10,751 tests: 10,655 passed, 41 failed, 55 skipped |
|
||||
| Unit tests, web | 212 files, 1,884 tests, all passed |
|
||||
| E2E | 410 passed, 18 skipped, 0 failed (7.0 min, Chromium) |
|
||||
|
||||
The 41 failures are the same four files as in "Known failures" above.
|
||||
|
||||
E2E ran with `WAGGLE_E2E_PORT=3344 WAGGLE_E2E_BASE_URL=http://127.0.0.1:3344
|
||||
WAGGLE_E2E_REUSE_EXISTING_SERVER=0 WAGGLE_E2E_DATA_DIR=<temp dir> npm run test:e2e`, so it
|
||||
neither reused nor disturbed a sidecar on `:3333` (it still rebuilds the root `dist/`). The
|
||||
first run failed 19 tests, all on removed features: `/api/tier`, Stripe, `/api/compliance`,
|
||||
the billing settings tab, the payment pages and the upgrade dialog. Those specs now assert
|
||||
that the endpoints and pages are gone (404) instead. The 18 skips depend on the environment:
|
||||
Windows-only launcher lanes, live chat without a provider key, and the optional team server.
|
||||
|
||||
## Not run yet
|
||||
|
||||
- **E2E and visual regression.** By default the Playwright web server reuses any sidecar on
|
||||
`:3333` with its data directory, and it rebuilds the root `dist/`. A baseline run needs a
|
||||
free port and an isolated data directory (`WAGGLE_E2E_REUSE_EXISTING_SERVER=0`,
|
||||
`WAGGLE_E2E_PORT`) at a time when restarting the local sidecar is acceptable.
|
||||
Several specs still exercise the removed tier, trial and Stripe endpoints (`/api/tier`,
|
||||
`/api/stripe/*`, upgrade prompts); they are updated together with that first e2e run.
|
||||
- **Visual regression** (`npm run test:visual`). It compares screenshots against 36
|
||||
baselines with a 0.3% pixel threshold; the platform they were captured on is not recorded,
|
||||
and the Cockpit and Memory screens have changed since. It is re-baselined in P2.7.
|
||||
- **Infrastructure suites** (`npm run test:infra`) need Postgres and Redis and cover team
|
||||
mode, which is not part of the community edition.
|
||||
- **Windows and Linux.** This record covers macOS only.
|
||||
|
||||
Reference in New Issue
Block a user