What is a context window?

Answer

A context window is the maximum number of tokens a language model can consider at once, covering both the input prompt and the generated output. If a conversation or document exceeds this limit, earlier content must be truncated, summarized, or retrieved selectively. Larger context windows allow more documents and history to be included, but they increase cost and latency and do not guarantee the model attends equally to everything in the window.