Skip to content
AImpact
IT EN
Inference Intermediate Also known as: Perso nel mezzo

Lost in the middle

The phenomenon where an LLM remembers information at the start and end of the context better, while content in the middle is often ignored or forgotten.

ShareLinkedInX

In practice

Critical for RAG and long prompts: the order of documents matters. Put the key information at the start or the end. It is one of the reasons a 1M-token context window is not equivalent to actually using it all.

Related terms

Context window Needle in a Haystack RAG

Seen in the wild

0 entries mentioning it

No archive entry mentions it explicitly. Appears in broader contexts.

← All terms