Files
waggle-os/docs/oss/baseline.md
shumeiko.it 20567ecb10 test(e2e): align specs with the community edition and record the e2e baseline
The first full e2e run on this branch failed 19 tests, all on features the
community edition removed: /api/tier, Stripe, /api/compliance, the billing
settings tab, the payment pages and the upgrade dialog. Those checks now
assert that the endpoints and pages are gone (404); tier, billing and
team-settings probes are dropped from the remaining journeys. The rerun is
410 passed, 18 skipped, 0 failed.
2026-10-20 01:36:38 +02:00

4.5 KiB
Raw Blame History

Baseline at the start of the conversion

The state of build, typecheck, lint and tests before any scope work. Every later change is compared against this record: a check that passes here must not start failing.

  • Date: 2026-10-15
  • Commit: 2346cf3 on oss/community-edition (the commercial code at b20b138 plus the fixes UF-001, UF-007, UF-008, UF-021 and UF-022)
  • Machine: macOS 26.6.2, Apple silicon (arm64), Node 22.23.2, npm 10.9.8
  • CI: not set up yet. The location of the public repository is still open, so this record stands in for a CI baseline until the pipeline exists (work package 0.2).

Results

Check Command Result
Package build npm run build:packages Pass
Typecheck, agent npx tsc --noEmit --project packages/agent/tsconfig.json Pass
Typecheck, server npx tsc --noEmit --project packages/server/tsconfig.json Pass
Typecheck, app tooling npx tsc --noEmit --project app/tsconfig.json Pass
Typecheck, web cd apps/web && npx tsc --noEmit -p tsconfig.app.json Pass
Web build cd apps/web && npx vite build --outDir <temp dir> Pass
Lint, root npx eslint . (ignores apps/web, which has its own config) 1,516 files, 0 errors, 0 warnings
Lint, web cd apps/web && npx eslint . 605 files, 49 errors (43 no-explicit-any), 60 warnings, all pre-existing
Unit tests, root npm run test 719 files, 12,012 tests: 11,915 passed, 41 failed, 56 skipped (8.6 min)
Unit tests, web cd apps/web && npx vitest run 221 files, 1,979 tests, all passed (2.4 min)
E2E npm run test:e2e Not run, see below
Visual regression npm run test:visual Not run, see below

The web build went to a temporary directory instead of the root dist/, because a running sidecar serves that directory.

In the full root run packages/hive-mind-cli/tests/cli-help.test.ts also failed once: the isolated home made npm print an update notice into the CLI output. The setup now turns that notice off and the file passes (3 of 3), so the totals above count it as passing.

Known failures (macOS)

All 41 failing root tests are in four files and fail the same way when run alone. They are logged as UF-023.

File Failing Symptom
packages/server/tests/local/managed-ollama-runtime.test.ts 38 of 45 "Official runtime archive did not contain ollama.exe"
packages/hive-mind-hooks-openclaw/tests/handler.test.ts 1 of 16 Expects /var/folders/..., receives /private/var/folders/...
packages/server/tests/local/files.test.ts 1 of 48 "escapes workspace root through symlink" in a move test
packages/server/tests/local/external-tool-runs.test.ts 1 of 17 "OpenClaw run did not settle" (timeout, not investigated)

Checkpoint: end of week 1

Measured on 2026-10-20 at 5f08869, after P0.1–P0.3, P1.4, P1.6 and P2.2 part 1. Fewer tests than at the baseline is expected: the removed code took its tests with it.

Check Result
Package build, web typecheck, check:deps Pass
Lint, root 0 errors, 0 warnings
Lint, web 38 errors, 60 warnings (all pre-existing; down from 49 errors)
Unit tests, root 638 files, 10,751 tests: 10,655 passed, 41 failed, 55 skipped
Unit tests, web 212 files, 1,884 tests, all passed
E2E 410 passed, 18 skipped, 0 failed (7.0 min, Chromium)

The 41 failures are the same four files as in "Known failures" above.

E2E ran with WAGGLE_E2E_PORT=3344 WAGGLE_E2E_BASE_URL=http://127.0.0.1:3344 WAGGLE_E2E_REUSE_EXISTING_SERVER=0 WAGGLE_E2E_DATA_DIR=<temp dir> npm run test:e2e, so it neither reused nor disturbed a sidecar on :3333 (it still rebuilds the root dist/). The first run failed 19 tests, all on removed features: /api/tier, Stripe, /api/compliance, the billing settings tab, the payment pages and the upgrade dialog. Those specs now assert that the endpoints and pages are gone (404) instead. The 18 skips depend on the environment: Windows-only launcher lanes, live chat without a provider key, and the optional team server.

Not run yet

  • Visual regression (npm run test:visual). It compares screenshots against 36 baselines with a 0.3% pixel threshold; the platform they were captured on is not recorded, and the Cockpit and Memory screens have changed since. It is re-baselined in P2.7.
  • Infrastructure suites (npm run test:infra) need Postgres and Redis and cover team mode, which is not part of the community edition.
  • Windows and Linux. This record covers macOS only.