AI Glossary
Context Window
The amount of information an AI model can consider at one time when generating a response.
Context Window
Overview
One of the most important limitations of modern AI systems is that they cannot consider unlimited information at once.
Every AI model has a context window, which represents the amount of information it can process during a conversation or task.
A helpful way to think about a context window is a person’s short-term working memory. While reading a book, you can remember recent paragraphs more easily than chapters you read several hours ago.
AI models face a similar challenge.
When information exceeds the model’s context window, older information may become less accessible or may need to be removed entirely.
This concept has become increasingly important as organizations use AI systems to analyze documents, summarize meetings, answer questions, and process large amounts of information.
The size of a context window influences how much information a model can consider simultaneously and often affects the quality of its responses.
Understanding context windows helps explain both the strengths and limitations of modern Large Language Models (LLMs).
Why It Matters
The context window determines how much information an AI model can consider when generating an output.
Real-World Example
A chatbot may be able to remember several pages of conversation but eventually lose access to older information once the context window is exceeded.