WorkflowFor DevelopersMachine Learning & AI Engineering

RAG (Retrieval-Augmented Generation) System Builder.

When building an LLM application that must answer questions based on specific, proprietary knowledge.

ChatGPT Β· Claude Β· GeminiΒ·AdvancedΒ·~214 tokens
Curated by the AIPP team
Last updated 14 May 2026 Β· v3
rag-retrieval-augmented-generation-system-builder.md Β· 214 words
You are a senior {{role}} brought in to help {{target_user}} complete a RAG (Retrieval-Augmented Generation) System Builder.

# Context
Original working context:
- Act as an AI architect. Build a Retrieval-Augmented Generation (RAG) system for {{describe_the_use_case}}.
- Step 1: Ingestion: document loading, chunking strategy, embedding model choice, and vector store population.
- Step 2: Retrieval: query embedding, similarity search, re-ranking strategy, and context assembly.
- Step 3: Generation: prompt template, context injection, answer generation, and source citation.
- Step 4: Evaluation: how to measure RAG quality (retrieval precision, answer faithfulness, answer relevance).

# Goal
Produce the exact deliverable requested for this use-case. Make the output practical, specific, and ready to use.

# Constraints
- Use the user's variables exactly where relevant.
- Avoid generic filler and vague advice.
- Be specific to the stated audience, platform, market, role, industry, or situation.
- Ask only essential clarifying questions if required; otherwise make reasonable assumptions and continue.

# Output
Return the final deliverable in a clean, skimmable format with clear headings, bullets, tables, scripts, templates, or steps as appropriate.

The variables to fill in

PlaceholderWhat to put thereExample
{{describe_the_use_case}}Describe the use caseinsert your specific value
{{role}}Rolefreelance client onboarding strategist
{{target_user}}Target usera freelance consultant

How to customize this prompt

  1. Replace each {{double-curly}} with your real context.
  2. Adjust the constraints section to match your tone β€” formal, casual, blunt.
  3. If the engagement is recurring, change the duration line to mention milestones rather than days.
  4. Run it in your tool of choice. The output should be ready to paste with at most one small edit.

When to use

When building an LLM application that must answer questions based on specific, proprietary knowledge.

PRO TIP

Retrieval quality is the bottleneck in most RAG systems β€” invest in re-ranking and query expansion before optimising the generation prompt.

Related prompts

Structured

Technical Problem Debugger

Debug this problem systematically. Identify the root cause, explain why it is happening, provide the fix, and explain how to prevent it in future.

Structured

System Design Advisor

Design the high-level architecture for this system. Cover components, data flow, scaling strategy, and key design decisions.

Structured

No-Code Tool Selector

Recommend the best no-code or low-code tool stack for the stated goal, with implementation guidance.

Structured

Data Analysis Prompt

Design the complete analysis approach for the stated question. Include the analytical method, the steps to execute it, and the format for presenting findings.

β˜… THIS PROMPT IS IN A PACK

The Developer Toolkit Pack

250 technical prompts for code review, documentation, architecture planning, debugging, test writing, API design, and career growth β€” built by developers for developers.

Browse more prompts β†’