diff --git a/docs/oss/baseline.md b/docs/oss/baseline.md index 4fe07e1..0cc644f 100644 --- a/docs/oss/baseline.md +++ b/docs/oss/baseline.md @@ -105,6 +105,47 @@ stayed on "Starting Waggle…" because the shell looked for the sidecar next to (UF-004); with that fixed, the app starts its bundled sidecar on a temporary data directory and opens the onboarding screen. +## Checkpoint: macOS acceptance, week 3 + +Measured on 2026-11-01 on `oss/community-edition` (from `4d54612` to `a70bc14`), macOS arm64, +after P1.3c, P1.3d, P2.2–P2.5 and the version bump to 1.0.0. + +| Check | Result | +|---|---| +| Root unit tests | The 40 known failures (managed-ollama-runtime 38, files 1, external-tool-runs 1). Under load `git-tools`, `background-bash`, `cli-runtime` and `skill-watcher` can fail on timing; alone they pass | +| `apps/web` unit tests | 1,914 passed | +| Rust (`cargo test --lib`) | 33 passed | +| E2E | 400 passed, 8 skipped, 5 failed. All 5 were phone-width tests that waited on the sidebar, which phones no longer show (UF-057); after fixing the tests they pass (7 of 7 in the rerun) | +| Desktop app | `Waggle.app` and `Waggle_1.0.0_aarch64.dmg` build; `scripts/release-smoke.mjs desktop` starts the app and its sidecar answers `/health` | +| Server installer | Installed from the packed archive: `doctor` passes, `run` serves the UI, `update` and `uninstall` work, the data directory stays | + +Acceptance against section 5 of the scope, as a new user of the server installer on a fresh data +directory (the managed Ollama runtime and Llama 3.1 8B copied in, so nothing was downloaded): + +| Scope item | Result | +|---|---| +| Agent runtime with several personas | Researcher, Writer, Analyst, Planner and others; the onboarding template opens the workspace with its persona | +| Web UI first, CLI as a headless alternative | Web UI: onboarding, chat, memory, agents, Skills Hub, marketplace and settings work. CLI: answers with a local model after the fix below | +| Skills, marketplace, connectors | Marketplace lists skills, connectors (Gmail, Google Drive, Notion and others) and MCP servers; starter skills and packs appear after UF-066 | +| Local model out of the box, own cloud keys | Onboarding finds the local model; chat answers with Llama 3.1 8B; 12 providers take a key in Settings → Models | +| Persistent memory | The agent saved a fact through `save_memory`; after a server restart a new question recalled it ("Rust, according to prior information stored about you") | +| No billing, tiers or upsell | Settings has General, Models, Permissions, Channels, Backup and Advanced; no plan, team or enterprise tabs | +| Analytics only with consent | A source build has no PostHog key: no consent prompt and no request to PostHog | + +Found and fixed during acceptance: + +- Installed builds had no capability packs and no starter skills (UF-066). +- The status bar named an unusable default model after a restart (UF-067). +- The CLI could only reach models through the LiteLLM proxy, which the community edition no + longer starts; local `ollama/*` models now go to Ollama directly. Cloud models in the CLI still + need a LiteLLM-compatible proxy. + +Noted, not fixed: + +- The first local-model turn took about 2.5 minutes: Llama 3.1 8B loads into memory, and the + first request carried about 16,500 input tokens. Later turns were much faster. +- Memory is mem0 (decision Q1). Whether GluoMem becomes the default is open with the owner. + ## Not run yet - **Visual regression** (`npm run test:visual`). It compares screenshots against 36