GenAIWiki
Retrieval

RAG

RAG, retrieval-augmented generation, retrieves evidence first, then generates an answer from that evidence instead of parametric memory alone.

Expanded definition

A RAG system has a retriever (vector search, BM25, or hybrid) and a generator (usually an LLM). Production stacks add chunking, metadata filters, reranking, citations, tenant access control, and faithfulness evals. RAG reduces hallucination only when retrieved evidence is relevant and the model is required to use it. Empty retrieval plus a chatty model is still an ungrounded answer. Evaluate citation precision separately from answer quality.

Related terms

Explore adjacent ideas in the knowledge graph.

RAG FAQ

What is RAG?

RAG, retrieval-augmented generation, retrieves evidence first, then generates an answer from that evidence instead of parametric memory alone.

How is RAG used in AI systems?

A RAG system has a retriever (vector search, BM25, or hybrid) and a generator (usually an LLM). Production stacks add chunking, metadata filters, reranking, citations, tenant access control, and faithfulness evals. RAG reduces hallucination only when retrieved evidence is relevant and the model is required to use it. Empty retrieval plus a chatty model is still an ungrounded answer.

Related

Comparisons, tools, and models that connect to this idea.