Evaluating retrieval
Before blaming the model for a bad answer, check whether the right passage was ever retrieved. Recall at k tells you which half of the system to fix.
- 12m
- Advanced
Video by Logical Lenses · YouTube
Check your understanding
3 questions. Unlocks when you finish the video.
Overview
What this lesson covers
- Build a query set with known correct passages
- Measure recall and precision at k
- Separate retrieval failures from generation failures
This lesson sits in Retrieval Quality, part of Retrieval-Augmented Generation from Scratch. It assumes what came before it and leads directly into the next lesson in the module.
In this lesson you will:
- Build a query set with known correct passages
- Measure recall and precision at k
- Separate retrieval failures from generation failures
Resources
Your notes will live here
Note taking is not available yet. Nothing you type would be saved, so the tab stays read-only for now.