epochs

Learn · Module 09 · Search and retrieval · Lesson 5 of 5

Evaluating retrieval

If you don't measure retrieval on its own, you can't tell whether a bad answer is the search's fault or the model's.

4 minute read

In short
  • Evaluate retrieval separately from generation.
  • Hit rate at k asks if the right passage is in the top k; MRR rewards ranking it higher.
  • For answers, measure faithfulness, relevance and correctness.

This lesson is part of Pro

The first two lessons of every module are free. Pro opens every lesson and every project.

See Pro plansFrom ₹119 a month. No auto-renewal.