test(e2e): align specs with the community edition and record the e2e baseline

The first full e2e run on this branch failed 19 tests, all on features the
community edition removed: /api/tier, Stripe, /api/compliance, the billing
settings tab, the payment pages and the upgrade dialog. Those checks now
assert that the endpoints and pages are gone (404); tier, billing and
team-settings probes are dropped from the remaining journeys. The rerun is
410 passed, 18 skipped, 0 failed.
This commit is contained in:
shumeiko.it
2026-10-20 01:36:38 +02:00
parent 01a2d8a4ce
commit 20567ecb10
11 changed files with 57 additions and 348 deletions

View File

@@ -58,17 +58,23 @@ than at the baseline is expected: the removed code took its tests with it.
| Lint, web | 38 errors, 60 warnings (all pre-existing; down from 49 errors) |
| Unit tests, root | 638 files, 10,751 tests: 10,655 passed, 41 failed, 55 skipped |
| Unit tests, web | 212 files, 1,884 tests, all passed |
| E2E | 410 passed, 18 skipped, 0 failed (7.0 min, Chromium) |
The 41 failures are the same four files as in "Known failures" above.
E2E ran with `WAGGLE_E2E_PORT=3344 WAGGLE_E2E_BASE_URL=http://127.0.0.1:3344
WAGGLE_E2E_REUSE_EXISTING_SERVER=0 WAGGLE_E2E_DATA_DIR=<temp dir> npm run test:e2e`, so it
neither reused nor disturbed a sidecar on `:3333` (it still rebuilds the root `dist/`). The
first run failed 19 tests, all on removed features: `/api/tier`, Stripe, `/api/compliance`,
the billing settings tab, the payment pages and the upgrade dialog. Those specs now assert
that the endpoints and pages are gone (404) instead. The 18 skips depend on the environment:
Windows-only launcher lanes, live chat without a provider key, and the optional team server.
## Not run yet
- **E2E and visual regression.** By default the Playwright web server reuses any sidecar on
`:3333` with its data directory, and it rebuilds the root `dist/`. A baseline run needs a
free port and an isolated data directory (`WAGGLE_E2E_REUSE_EXISTING_SERVER=0`,
`WAGGLE_E2E_PORT`) at a time when restarting the local sidecar is acceptable.
Several specs still exercise the removed tier, trial and Stripe endpoints (`/api/tier`,
`/api/stripe/*`, upgrade prompts); they are updated together with that first e2e run.
- **Visual regression** (`npm run test:visual`). It compares screenshots against 36
baselines with a 0.3% pixel threshold; the platform they were captured on is not recorded,
and the Cockpit and Memory screens have changed since. It is re-baselined in P2.7.
- **Infrastructure suites** (`npm run test:infra`) need Postgres and Redis and cover team
mode, which is not part of the community edition.
- **Windows and Linux.** This record covers macOS only.