01 · Understand the idea
In simple words
A long textbook is easier to search when divided into sensible sections. Chunking splits documents into smaller pieces for retrieval. If a piece contains only “it lasts 30 days”, the meaning is unclear. Keeping the heading “Trial membership” with that sentence makes the piece more useful.
Two useful terms
Chunk: a section of a document. Metadata: information about the section, such as title and source.
Build your understanding
A retrieval system often divides documents into chunks. Chunks that are too small lose context; chunks that are too large may include irrelevant material. Start with meaningful boundaries such as headings and paragraphs. Choose sizes by evaluating actual questions rather than copying a universal number.
Sign in to save your reading progress.
Sign in