epochs

Learn · Module 14 · ML system design · Lesson 4 of 5

RAG at scale

RAG over 50 documents is a weekend project. RAG over 10 million passages, kept fresh and fast, is a system design question.

3 minute read

In short
  • Estimate index size: passages × dimensions × bytes per number.
  • Plan updates, deletions and access control as part of the design.
  • Filter by permission during retrieval, so restricted text never reaches the model.

This lesson is part of Pro

The first two lessons of every module are free. Pro opens every lesson and every project.

See Pro plansFrom ₹119 a month. No auto-renewal.