Context window — definition and meaning
A context window is the maximum amount of text — measured in tokens — an AI model can consider at once. Anything beyond it is forgotten unless stored and re-supplied by a separate memory system.
Last reviewed 2026-05-25
The context window is the model's working memory: the span of recent conversation it can actually 'see' when generating a reply. When a conversation exceeds the window, the oldest content drops out of view. This is the core reason AI companions forget things — not a flaw in the model's intelligence, but a hard architectural limit. Every long-term memory feature in every companion app is a workaround that extracts important facts and re-injects them into the window at the right moment. Bigger windows help, but they don't replace a real memory layer.
About context window.
What is context window?
A context window is the maximum amount of text — measured in tokens — an AI model can consider at once. Anything beyond it is forgotten unless stored and re-supplied by a separate memory system.
How is "context window" used in AI companion apps?
The context window is the model's working memory: the span of recent conversation it can actually 'see' when generating a reply. When a conversation exceeds the window, the oldest content drops out of view. This is the core reason AI companions forget things — not a flaw in the model's intelligence, but a hard architectural limit. Every long-term memory feature in every companion app is a workaround that extracts important facts and re-injects them into the window at the right moment. Bigger windows help, but they don't replace a real memory layer.
What other terms relate to context window?
Related terms in the AI companion space include: LLM (large language model), Long-term memory (in AI companions), Memory canon, Token (AI). Each has its own glossary entry on /glossary.
- LLM (large language model)
A large language model (LLM) is an AI system trained on vast amounts of text to predict and generate human-like language. LLMs power AI companions, chatbots, and assistants like ChatGPT, Claude, and Gemini.
- Long-term memory (in AI companions)
An AI companion's ability to recall facts and context from prior conversations across days, weeks, and months.
- Memory canon
A user-readable, user-editable record of what an AI companion remembers about the user and the relationship.
- Token (AI)
A token is the basic unit of text an AI model processes — roughly a word or word-piece. Models read and generate text token by token, and limits like the context window are measured in tokens.