Files
waggle-os/docs/decisions/2026-04-26-v2-pre-launch-sequencing-addendum.md
Oleg Maslov 0c3e2ead3b
Some checks failed
Installer Smoke / installer-smoke (push) Has been cancelled
moving
2026-09-02 10:10:29 +02:00

7.1 KiB
Raw Permalink Blame History

V2 Pre-Launch Sequencing Addendum

Date: 2026-04-26 Author: PM Status: Ratified by Marko 2026-04-26 in PM session Predecessors:

  • decisions/2026-04-25-launch-gate-reframe-decision-matrix.md (original Decision Matrix)
  • decisions/2026-04-26-decision-matrix-self-judge-reframe.md (PHF reframe post self-judge re-eval)
  • briefs/2026-04-26-retrieval-v2-embeddings-audit-brief.md (V2 brief sa 5 open questions)

§1 — Trigger

Marko 2026-04-26 ratifikovao 5 pitanja iz retrieval V2 brief §8. Najveći shift: V2 ide PRE launch, ne post. Marko quote: "nema launcha dok se sve ne sredi".

To uključuje:

  1. V2 sequencing PRE launch (ratified)
  2. CC-3 fresh sesija (ratified)
  3. Sve 5 directions execute, no cuts (ratified)
  4. Tier-gating Pro za reranker, Voyage/OpenAI Free (ratified)
  5. Mock-fallback telemetry internal-only (ratified)

Ova ratifikacija fundamentally menja launch sequencing i comms framing. Audit trail u ovom dokumentu.


§2 — Šta se menja

2.1 — Launch ETA

Pre 2026-04-26 ratifikacije: launch ETA bila ~3-4 nedelje (CC-1 Phase 5 + CC-2 Step 3 + 14-step launch plan items). V2 work bila planirana post-launch kao "v2 of arxiv paper ili follow-up note".

Posle ratifikacije: launch ETA shift na 6-9 nedelja od danas (2026-04-26):

  • CC-1 agent fix Phases 2-5: ~2-4 nedelje (Phase 1 done)
  • CC-2 memory sync Steps 2-3: ~1-2 nedelje (Step 1 done)
  • CC-3 retrieval V2 Phases A-C: 4-5 nedelje (sequenced, ne paralelno sa CC-1 Phase 2-5 jer baseline merenja confounded inače)
  • Critical path: CC-1 Phase 5 + CC-2 Step 3 → CC-3 starts → Phase C ends → ostali 14-step items ako nisu paralelno gotovi

2.2 — Launch comms framing

Pre ratifikacije (PHF — PASS-with-honest-framing per 2026-04-26-decision-matrix-self-judge-reframe.md):

  • Substrate ceiling claim (74% self-judge oracle vs Mem0 peer-reviewed 66.9%) leads
  • V1 retrieval honest disclosure (48% self-judge / 22.25% trio-strict, V2 in progress)
  • Methodology contribution (+27.35pp self-judge bias)
  • Apache-2.0 + sovereignty axes

Posle ratifikacije (V2 production-ready at launch):

  • Substrate ceiling claim INTACT (74% self-judge oracle, paper claim #1)
  • V2 retrieval results REPLACE V1 honest disclosure — production-ready numbers, ne "in progress"
  • Methodology contribution (+27.35pp self-judge bias) INTACT
  • Apache-2.0 + sovereignty axes INTACT
  • New: "production-grade retrieval validated against substrate ceiling, gap closed" framing if V2 acceptance criteria met (per V2 brief §7: trio-strict V2 ≥30% AND beats full-context 27.25%)

2.3 — arxiv paper §5.3 framing

Pre ratifikacije: §5.3 says "V1 retrieval at 48% self-judge / 22.25% trio-strict; 5 directions identified for community contribution; V2 work in progress".

Posle ratifikacije: §5.3 will publish V2 results at launch:

  • V2 retrieval baseline (target: trio-strict ≥30%, self-judge ≥65% per V2 brief acceptance criteria)
  • Per-direction ablation results (5 directions × empirical contribution to overall lift)
  • Comparison: V1 vs V2 vs oracle ceiling (both methodologies)
  • Production deployment deployment criterion satisfied (V2 > full-context baseline)

If V2 acceptance criteria fail at full N=400 (Phase C verdict), §5.3 framing reverts to honest disclosure ("V2 work attempted, achieved X% gap closure, V3 work scoped as next") — this is contingent path, but per Mixed-methodology baseline rule we'll publish whichever is honestly defensible.

2.4 — Landing copy v3 §3 Claim 3 framing

Pre ratifikacije: "We publish what survives multi-vendor blind judging. We also publish what doesn't: V1 retrieval is honest at 48%..."

Posle ratifikacije: "Production-grade retrieval. Validated. V2 retrieval reaches X% (trio-strict) — closing 70%+ of gap to substrate ceiling. Beats full-context baseline. Five-direction architectural improvement (embedding model, scoring weights, temporal-aware, learned reranker, entity-aware KG bridge) — full ablation in arxiv paper §5.3."

If V2 fails acceptance: revert to honest disclosure per current draft.

2.5 — Decision Matrix scenario

Pre ratifikacije: PHF (PASS-with-honest-framing) per decisions/2026-04-26-decision-matrix-self-judge-reframe.md.

Posle ratifikacije: PHF augmented to PASS-with-production-validation:

  • Substrate ceiling claim retained (PHF fundamentals)
  • V2 retrieval production validation added as launch prerequisite
  • If V2 fails: fallback to PHF (i.e., revert to V1 honest disclosure, accept timeline shift if V2 retry needed)
  • If V2 passes: stronger launch narrative with end-to-end production-ready memory

§3 — Šta ne menja se

  • Substrate ceiling claim (74% self-judge oracle, +7.1pp vs Mem0 peer-reviewed) — INTACT
  • Methodology contribution (+27.35pp self-judge bias quantification) — INTACT
  • Apache-2.0 + local-first + EU AI Act audit triggers — INTACT
  • Pricing (Solo Free / Pro $19 / Teams $49 LOCKED 04-18) — UNCHANGED
  • Pre-registered manifest v6 + amendments + audit chain — UNCHANGED
  • Trio-strict κ=0.7878 ensemble — UNCHANGED
  • 14-step launch plan — sequencing within steps adjusted but step set unchanged
  • Anti-pattern #4 discipline (thresholds do not shift post-hoc) — UNCHANGED; V2 acceptance criteria are pre-registered before V2 execution

§4 — Implementation queue (PM streams)

Following items must be authored / updated based on this addendum:

  1. arxiv §5.3 update — replace V1 honest disclosure framing with V2 production-ready framing (placeholder until V2 results land); methodology citations explicit per Mixed-methodology baseline rule
  2. Landing copy v3 §3 Claim 3 update — replace V1 honest disclosure with V2 production-ready framing (placeholder until V2 results land)
  3. CC-3 brief authoring — paste-ready prompt for fresh CC-3 sesija; not sent until CC-1 Phase 5 + CC-2 Step 3 done; placeholder + acceptance criteria binding
  4. 14-step launch plan memory entry update — Korak 2 (retrieval V2) now PRE-launch, not post-launch annotation
  5. Substrate integrity audit brief (Korak 12) — must include V2 reproducibility check, not just V1 substrate verification

PM authoring queue:

  • (1) + (2) + (4) ide sad (parallel sa CC-1/CC-2 active work)
  • (3) ide kad CC-3 prerequisites ispunjeni (~2-3 nedelje)
  • (5) ide pre Day 0 launch comms freeze (~1-2 nedelje pre launch-a)

§5 — Open question — none

Sve 5 V2 pitanja ratified. Sequencing implications dokumentovani. PM proceeds with implementation queue per §4.


§6 — Cross-references

  • Original Decision Matrix: decisions/2026-04-25-launch-gate-reframe-decision-matrix.md
  • PHF reframe: decisions/2026-04-26-decision-matrix-self-judge-reframe.md
  • V2 brief (5 ratifications resolved): briefs/2026-04-26-retrieval-v2-embeddings-audit-brief.md
  • Memory sync audit: decisions/2026-04-26-memory-sync-audit.md
  • Pilot verdict: decisions/2026-04-26-pilot-verdict-FAIL.md
  • Mixed-methodology baseline rule: feedback_config_inheritance_audit.md Extension 2
  • Stage 3 v6 5-cell summary: D:\Projects\waggle-os\benchmarks\results\stage3-n400-v6-final-5cell-summary.md