Files
waggle-os/packages/hive-mind-core
shumeiko.it 2e1999a3f6 refactor: remove self-learning and the optimizer package (P1.4)
Self-learning is excluded from the community edition (ADR-0004); the
project owner reworks it separately. Cost tracking stays.

- agent: delete behaviour evolution (evolve-schema, iterative GEPA,
  compose-evolution, evolution gates, orchestrator and deploy),
  improvement and correction detection, AgentLearning, the eval-dataset
  builder, optimization-capture and the agent_insights tool. Secret
  detection moves from eval-dataset to secret-patterns. The LLM wiring
  keeps only the Haiku adapter and judge call used by skill audit and
  hygiene, so @ax-llm/ax is now declared by agent instead of server.
- server: delete /api/evolution/*, the evolution and optimizer services,
  GEPA expansion of the first chat message, the prompt_optimization and
  monthly_assessment jobs, the idle-session reviewer and its
  session-reviewer persona, prompt injection of past corrections and
  thumbs-down recorded as correction signals. Existing job rows of the
  removed types are ignored, not deleted.
- core: delete OptimizationLogStore; stop re-exporting the improvement
  signal and evolution run stores.
- web: delete the Evolution screen and the two job types in the
  automation editor.
- delete packages/optimizer.

Also logs UF-027 (self-learning loops read data nothing collects) and
UF-028 (the Settings prompt-shape choice is ignored by chat).
2026-10-20 00:54:58 +02:00
..
2026-09-02 10:14:22 +02:00
2026-09-02 10:10:29 +02:00
2026-09-02 10:14:22 +02:00
2026-09-02 10:14:22 +02:00
2026-09-02 10:10:29 +02:00

@waggle/hive-mind-core

The substrate. SQLite + sqlite-vec hybrid search, bitemporal knowledge graph, frame compression, identity layer, awareness layer, embedder providers, harvest pipeline.

What this is

hive-mind-core is the persistence and retrieval substrate that powers Waggle OS's memory layer. The public Apache-2.0 distribution lives in marolinik/hive-mind and is produced from this canonical source by a maintainer-curated forward-port.

Publication boundary: this monorepo package is private and must never be published or pushed as a raw subtree split. It contains Waggle-only files and interleaved install_audit schema/migration logic. The curated forward-port adapts the public layout and imports, then removes all excluded material.

What's inside

Module Purpose
mind/db.ts MindDB — better-sqlite3 + sqlite-vec hybrid backend
mind/frames.ts FrameStore — I/P/B frame types + compaction + dedup
mind/sessions.ts SessionStore — session lifecycle + ensureActive
mind/search.ts HybridSearch — FTS5 + vec0 fused via Reciprocal Rank Fusion
mind/knowledge.ts KnowledgeGraph — entity/relation graph + bitemporal validity
mind/identity.ts IdentityLayer — personal identity persistence
mind/awareness.ts AwarenessLayer — active task/state tracking
mind/scoring.ts Scoring profiles (recency, popularity, relevance, importance)
mind/reconcile.ts Index reconciliation (FTS, vec, orphan cleanup)
mind/ontology.ts Entity ontology + validation
mind/concept-tracker.ts Concept mastery tracking
mind/entity-normalizer.ts Entity name normalization + dedup
mind/{api,inprocess,litellm,ollama}-embedder.ts Embedder providers + provider factory
mind/embedding-provider.ts createEmbeddingProvider — runtime embedder selection + quota
harvest/pipeline.ts HarvestPipeline — universal ingestion into frames
harvest/dedup.ts Cross-source dedup
harvest/{chatgpt,claude,claude-code,gemini,perplexity,markdown,plaintext,pdf,url,universal}-adapter.ts Per-source ingest adapters
harvest/source-store.ts, run-store.ts Harvest source + run persistence
injection-scanner.ts scanForInjection — prompt-injection detection
logger.ts createCoreLogger — minimal structured logger

Publication status

  • The public mirror is Apache-2.0 and excludes Waggle-only governance and audit material.
  • Benchmark and performance claims belong in versioned reports with their model, dataset, scorer, revision, and receipts; this README does not make an unqualified SOTA claim.
  • Run scripts/oss-drift-check.sh and the public mirror's own test and lint gates before every curated release.

Status

Migrated from marolinik/hive-mind into the canonical marolinik/waggle-os monorepo at packages/hive-mind-core/ on 2026-04-30. Future development happens here. scripts/oss-subtree-split.sh is an inspection/curation starting point only; the public mirror is updated through a reviewed, curated forward-port.

License: Apache-2.0.