Why This Matters

If you've built even a basic RAG pipeline, you've probably run into "chunk overlap" as a setting — usually with some default value like 50 or 200 tokens — and wondered why you'd deliberately want the same text to appear in two different chunks. Doesn't that just waste storage …