RAG Data Pipelines
The operational layer around a RAG knowledge base — trigger, inputs, processing, destination — that keeps the vector store fresh. Covers create, update, and delete flows (including the n8n recycling-bin workaround for missing delete triggers), metadata tagging for stale-vector removal, and file-type switches for mixed document sources. The core claim: a stale or duplicate-heavy database silently degrades agent accuracy, so ingestion plumbing matters as much as retrieval.
Related entities
Source references
- [src-006] Nate Herk cluster — Nate Herk — RAG and data ingestion cluster (5 videos)
– Videos referenced: 5uw1wE6niGc
Keep reading from this thread
From 500 indexed pages and articles.
- Wiki concept RAG Retrieval Methods Framework of four retrieval patterns for AI agents: (1) database filters for structured rows when the answer lives in a small subset, (2) Related by retrieval
- Wiki concept Gemini File Search API Google's managed RAG service that hides chunking, embedding, and storage behind four HTTP operations: create store, upload file, import file into store Related by retrieval
- Wiki concept Multimodal Embeddings Embedding models that place text, images, video, audio, and documents into a single shared vector space, allowing cross-modal retrieval from one query. Related by ingestion