Context Window

A context window is the maximum amount of text an AI model can consider at one time, including the question, the conversation so far, any content it has retrieved, and the answer it writes.

Also called
Context length, Token limit, Context size
MentionBird glossary card with the heading context window, its one sentence definition, and an A to Z grid of pastel letter tiles with the C tile highlighted
On this page
Key takeaways
  • A context window is the limit on how much text a model can consider at once, shared by instructions, conversation history, retrieved content, and the answer.
  • Context windows are measured in tokens, and 1,000 tokens is roughly 750 English words.
  • Even large windows are shared across many sources in AI search, so platforms usually retrieve only the most relevant sections of a page.
  • Models tend to use information at the start and end of a long context more reliably than information in the middle.
  • Putting key facts early, keeping pages focused, and naming your brand in key sections help your content survive the trip into an answer.

What fills a context window

Everything a model works with in a single moment has to fit inside its context window, and that space fills up from several directions at once.

What fills itWhere it comes from
InstructionsRules the platform gives the model behind the scenes
Conversation historyEarlier questions and answers in the same chat
Retrieved contentPassages pulled from web pages to answer the question
The answerThe response the model is writing

Because the conversation shares that space, earlier messages shape later answers, which is one reason answers drift within a single chat and part of what drives AI personalization. When there is more material than room, something has to go, usually the oldest messages or the least relevant passages.

How context windows are measured

Context windows are measured in tokens, the small units of text a model reads. A token is often a short word or part of a longer one, and in English, 1,000 tokens usually works out to roughly 750 words.

Context windowRoughly equal to
8,000 tokensAbout 6,000 words, or a long report
128,000 tokensAbout 96,000 words, or a full length book
1,000,000 tokensAbout 750,000 words, or several books

Sizes have grown quickly. Early chat models handled a few thousand tokens, while some current models can take in hundreds of thousands or even a million.

Why a bigger window does not mean AI reads every page

A large window does not mean an assistant reads your whole site, or even your whole page, when it answers a question. In AI search, the window is shared between the conversation and passages from many sources, so platforms typically retrieve only the most relevant sections of each page. That selection step is known as chunking.

Where information sits inside the window matters too. Research published as Lost in the Middle found that language models tended to use information at the start and end of a long context more reliably than information buried in the middle. Details that get overlooked this way can lead to answers that miss or misstate facts, a common route to AI hallucination.

What context windows mean for your content

  • Put key facts early: Facts near the top of a page or section are more likely to be included and used.
  • Keep pages focused: A page that covers one topic well gives AI less irrelevant text to sort through.
  • Cut the padding: Long introductions take up space without adding anything an answer can use.
  • Name your brand in key sections: When only part of a page is retrieved, that part should still say whose product it describes.

Curious what AI says about your brand?

MentionBird tracks your buying prompts every day across the AI platforms in your plan, and shows where your brand appears. Starter covers ChatGPT and Gemini, Growth adds Perplexity and Claude, and Custom supports up to 20 platforms: ChatGPT, Gemini, Perplexity, Claude, Grok, Google AI Overviews, Microsoft Copilot, DeepSeek, Google AI Mode, Mistral Vibe, Qwen Chat, Meta AI, Kimi AI, You.com, Ask Brave, Alexa for Shopping, Doubao, ERNIE, Poe, and Duck.ai.

Start today

FAQs

1. Which AI model has the largest context window?

It changes often, as providers release new models every few months, so it is best to check each provider's current documentation.

2. Does a bigger context window make answers more accurate?

Not necessarily. More room lets a model consider more material, but it still has to pick out what matters, and details in the middle of a long context can be used less reliably.

3. Does the context window reset between chats?

Generally yes. Each new conversation starts with an empty window, unless the platform adds saved memory from earlier chats.

4. Why does an assistant forget things in long conversations?

Once the window fills up, older messages are usually dropped or condensed to make room for new ones.

5. Do longer contexts cost more?

For businesses using AI models directly, pricing is usually per token, so longer contexts typically cost more to run.

See how AI answers questions about your brand

First month $19 with code TRY19, then $79/mo. Cancel anytime.