The "Lost in the Middle" Problem in RAG and How to Work Around It

Posted on Thu 22 October 2026 in GenAI • Tagged with GenAI, RAG, LLM, context-window, retrieval, reranking

Why This Matters

You build a RAG pipeline. Retrieval works: the right chunk is definitely in the top results. You send everything to the LLM, and it still gives a wrong or incomplete answer, as if it never saw the one piece of text that contained the answer.

Very often …


Continue reading

What is a Context Window, Really? Why Longer Isn't Always Better

Posted on Mon 14 September 2026 in Beginner Guide • Tagged with GenAI, LLM, context-window, beginner, tokens

Why This Matters

If you've used any LLM API, you've probably seen a spec sheet listing something like "128K context window" or "1M context window" and assumed bigger automatically means better. It's easy to think of it like storage space — more is always good, right?

Turns out, it's more complicated …


Continue reading