Foundations

SIU & Autonomous Curation

The Sulcus Intelligence Unit (SIU) combines fast System 1 neural gating on write with background consolidation, deduplication, and cold folding so agent memory stays high-signal over thousands of sessions.

SIU PipelineSystem 1 Neural MLPEpisodic ConsolidationCold Folding & Archive
01 · Sulcus Intelligence Unit

SIU Architecture & System 1 Gate

System 1 runs a pure-Rust Wide-and-Deep MLP directly over the 384-dimensional BGE-small-en-v1.5 vector computed during ingestion, adding sub-millisecond overhead on CPU with zero GPU requirement.
SIVUBinary Quality Gate
Sulcus Intelligence Value Unit

Screens incoming turns before storage, rejecting greetings, boilerplate acknowledgements, raw noisy logs, and low-utility chatter in under 2ms.

SICU5-Archetype Router
Sulcus Intelligence Classification Unit

Routes accepted memories into episodic, semantic, preference, procedural, or fact so each node inherits the right thermodynamic decay curve.

SILUEntity & Graph Linker
Sulcus Intelligence Linking Unit

Extracts services, files, symbols, and domain concepts on ingestion, anchoring nodes into the Knowledge Graph and flagging contradictions.

SITUReactive Rule Evaluator
Sulcus Intelligence Trigger Unit

Evaluates matching memory and Agent Bus triggers with crossing-cadence guards and precision feedback tracking.

SIRUAdaptive Recall Scorer
Sulcus Intelligence Recall Unit

Blends cosine similarity, BM25 lexical match, current_heat, type-aware recency, and 2-hop graph resonance using tenant feedback signals.

bashEvaluating Candidate Text via POST /api/v1/siu/classify
# Pre-screen candidate text through SIU (SIVU quality gate + SICU archetype router)
curl -X POST https://api.sulcus.ca/api/v1/siu/classify \
  -H "Authorization: Bearer $SULCUS_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "text": "Always verify Stripe webhook signatures with ActiveSupport::SecurityUtils.secure_compare",
    "namespace": "payments-rails"
  }'

# Example response:
# {
#   "worth_storing": true,
#   "quality_confidence": 0.97,
#   "predicted_type": "procedural",
#   "type_confidence": 0.91
# }
02 · Memory Hygiene

Consolidation, Cold Folding & Deduplication

As episodic session notes cool over time, Sulcus distills recurring lessons into durable synthesis memories rather than letting valuable context vanish or cluttering working memory.

1. Near-Duplicate Compaction

Ingest deduplication and MCP compact_memory (default cosine threshold 0.92) merge redundant memories, reinforcing stability on the surviving canonical node.

2. Synthesis Consolidation

Clusters of cooling episodic memories are distilled into a single synthesis memory (60-day / 800-interaction half-life) linked via derived_from provenance edges.

3. Reversible Cold Archive

Source episodes move out of hot recall into cold archive, where they remain inspectable via GET /api/v1/agent/archive and restorable anytime via POST /api/v1/agent/restore.

bashInspecting Candidates & Running Synthesis Consolidation
# 1. Preview cold episodic clusters ready for synthesis consolidation
curl "https://api.sulcus.ca/api/v1/agent/consolidation-candidates?namespace=payments-rails" \
  -H "Authorization: Bearer $SULCUS_API_KEY"

# 2. Distill candidate episodes into durable synthesis memories with provenance edges
curl -X POST https://api.sulcus.ca/api/v1/agent/consolidate \
  -H "Authorization: Bearer $SULCUS_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "namespace": "payments-rails",
    "dry_run": false
  }'
Per-Namespace SIU Overrides
You can tune quality gate sensitivity globally via PATCH /api/v1/settings/siu or override thresholds for a specific repository namespace (for example stricter filtering on noisy CI namespaces) via PATCH /api/v1/settings/siu/:namespace.
03 · Protocol Reference

SIU & Curation Endpoints

POST/api/v1/siu/classify
Evaluate candidate text through SIVU quality gate + SICU archetype router.
POST/api/v1/decision
Full System 1 evaluation returning calibrated probabilities and store/reject decision.
GET/api/v1/settings/siu
Read tenant SIU configuration and thresholds.
PATCH/api/v1/settings/siu/:namespace
Set namespace-specific SIU threshold overrides.
GET/api/v1/agent/consolidation-candidates
List cold episodic clusters ready for synthesis.
POST/api/v1/agent/consolidate
Consolidate episodic clusters into synthesis nodes.
POST/api/v1/agent/fold
Group related memories into a named context fold.
GET/api/v1/agent/archive
Inspect archived cold memories.
POST/api/v1/agent/restore
Restore archived nodes back to active working memory.