Data Stream Load
Select a source and trigger the data stream load event. This creates the record that feeds DLO and DMO stages.
Operations Runbook
0/6 complete0%
Ingest source object record
DLO · ⟳ running
Landing raw object fields into DLO with source metadata, identifiers, and timestamps.
Map semantic fields
DMO · pending
Resolve core fields used for retrieval (Title, Body, Language, URL, Source) into DMO semantics.
Create chunk rows
Chunk DMO · pending
Slice body text into chunk records with overlap and chunk-level metadata for recall coverage.
Generate vectors and index
IDMO · pending
Translate each chunk to embeddings and write vector references for nearest-neighbor retrieval.
Run vector retrieval
Retriever · pending
Embed query, rank chunk candidates by cosine similarity (semantic/hybrid), return top-K results.
Generate grounded answer
Generate · pending
Assemble system prompt + retrieved chunks + user query, then call Groq (or distilbert) to produce a cited answer.