Course overview
A course for PMs who need to decide whether their product needs RAG, then scope each stage with the engineering team. Without writing code, you build the documented RAG architecture of your own product and the question set that will judge its quality before any solution is chosen.
Lesson objective
By the end of this overview, you will know what you are going to produce (your product's documented RAG architecture and a set of 30 test questions) and in what order the five modules get you there.
Topics covered
- RAG architecture
- RAG for product managers
- retrieval-augmented generation
- AI assistant product
Where it fits
Overview
What will I design in this course, and in what order?
Lessons in this module
- Course overview (this lesson)
What you will learn in the course
This lesson is part of the course Design a RAG architecture that fits your product
- Choose, for an information need, between long context, data injected by the application, RAG and fine-tuning, and justify the choice by volume, update frequency, access rights and cost.
- Specify the source inventory, exclusions, the metadata to capture and the document chunking strategy.
- Design retrieval: semantic, keyword or hybrid search, reranking, contextual retrieval, number of passages and relevance threshold.
- Specify the answer grounded in sources, how citations are displayed, how conflicting sources are handled and what happens when nothing is found.
- Specify access filtering before the model reads any passage, and index freshness (resync, deletions, versions).
- Build a set of 30 test questions that covers RAG failure modes and diagnose which stage caused a wrong answer.
- Estimate the cost items of a RAG system and choose between a hosted tool, a managed knowledge base, a vector database and a custom build.
Related courses
- Build an AI assistant for your productAdvanced · ~3 hr
- Evaluate an AI feature: test sets, metrics and LLM judgesAdvanced · ~3 hr
- Ship and monitor an AI feature in productionExpert · ~3 hr