AI glossary
What is Context Window?
The maximum number of tokens a model can consider at once, including both the input prompt and the generated output.
Modern models range from tens of thousands to over a million tokens. Bigger isn't automatically better: long prompts cost more, add latency, and models can miss information buried in the middle.