Reported as one of the most common AI design prompts.
Two paths. Indexing: parse, chunk, embed, store. Querying: search, rerank, build the prompt, generate with citations.
Measure retrieval and answers separately. If the right passage never arrives, no prompt can fix the result.
Filter by permission at search time, and plan for documents that change.
- What are the steps of indexing?
- Parse, chunk, embed, store with metadata such as permissions and dates.
- What are the steps of a query?
- Search, rerank, build the prompt, generate with citations.
- What's recall@k?
- Of the passages that matter, the share that reached the top k.
- What's MRR?
- Mean reciprocal rank: how high the first useful result sits. First place scores 1, second 0.5.
- What's faithfulness?
- Whether the answer is supported by the retrieved text.
- Why use hybrid search?
- Keyword search catches exact terms like error codes, and vector search catches meaning.
- Why combine rankings by rank?
- Keyword and vector scores use different scales, so rank fusion avoids comparing them.
- Where do permission checks go?
- In the search, before generation. Otherwise a restricted document can shape the answer.