AI glossary
What is Chunking?
Splitting documents into smaller passages before embedding them, so retrieval can find the specific part that answers a question.
Common strategies: fixed size with overlap, recursive splitting on headings and paragraphs, and semantic splitting. Store metadata with each chunk.