WorkflowFor DevelopersMachine Learning & AI Engineering

RAG (Retrieval-Augmented Generation) System Builder.

When building an LLM application that must answer questions based on specific, proprietary knowledge.

ChatGPT Β· Claude Β· GeminiΒ·AdvancedΒ·~1950 tokens
Curated by the AIPP team
Last updated 14 May 2026 Β· v3
rag-retrieval-augmented-generation-system-builder-4.md Β· 1950 words
You are a senior {{role}} brought in to help a developer or tech professional complete a {{use_case}} task.

# Context
- Pack: Developers & Tech Professionals
- Category: Machine Learning & AI Engineering
- Use case: RAG (Retrieval-Augmented Generation) System Builder
- Source task:
  - Build a Retrieval-Augmented Generation (RAG) system for {{describe_the_use_case_customer_support_bot_internal_knowledge_ba}}.
  - Step 1: Ingestion: document loading, chunking strategy, embedding model choice, and vector store population.
  - Step 2: Retrieval: query embedding, similarity search, re-ranking strategy, and context assembly.
  - Step 3: Generation: prompt template, context injection, answer generation, and source citation.
  - Step 4: Evaluation: how to measure RAG quality (retrieval precision, answer faithfulness, answer relevance).

# Goal
Ingestion pipeline, retrieval design, generation prompt, and evaluation framework β€” with code for each phase.

# Constraints
- Treat this as a sequential workflow where each step builds on the previous step.
- Keep every step clearly labeled and easy to run separately if needed.
- Avoid generic filler, vague advice, and unsupported claims.
- Make the output specific, practical, and ready to use.

# Output
Ingestion pipeline, retrieval design, generation prompt, and evaluation framework β€” with code for each phase.

The variables to fill in

PlaceholderWhat to put thereExample
{{role}}RoleAI architect
{{use_case}}Your specific valuerag (retrieval-augmented generation) system builder
{{describe_the_use_case_customer_support_bot_internal_knowledge_ba}}Describe the use case customer support bot internal knowledge bacustomer support bot

How to customize this prompt

  1. Replace each {{double-curly}} with your real context.
  2. Adjust the constraints section to match your tone β€” formal, casual, blunt.
  3. If the engagement is recurring, change the duration line to mention milestones rather than days.
  4. Run it in your tool of choice. The output should be ready to paste with at most one small edit.

When to use

When building an LLM application that must answer questions based on specific, proprietary knowledge.

PRO TIP

Retrieval quality is the bottleneck in most RAG systems β€” invest in re-ranking and query expansion before optimising the generation prompt.

Related prompts

Structured

Technical Problem Debugger

Debug this problem systematically. Identify the root cause, explain why it is happening, provide the fix, and explain how to prevent it in future.

Structured

System Design Advisor

Design the high-level architecture for this system. Cover components, data flow, scaling strategy, and key design decisions.

Structured

No-Code Tool Selector

Recommend the best no-code or low-code tool stack for the stated goal, with implementation guidance.

Structured

Data Analysis Prompt

Design the complete analysis approach for the stated question. Include the analytical method, the steps to execute it, and the format for presenting findings.

β˜… THIS PROMPT IS IN A PACK

The Developer Toolkit Pack

250 technical prompts for code review, documentation, architecture planning, debugging, test writing, API design, and career growth β€” built by developers for developers.

Browse more prompts β†’