Basics

Context window

The maximum amount of text, measured in tokens, a model can take into account at once, including your prompt, any files, the conversation so far and its own reply. Beyond it, earlier material is dropped or summarised. A big window does not guarantee the model uses everything in it equally well.


Where this is taught

15How large language models work
Tokens, embeddings, attention, context windows, temperature and training: what is actually happening when a model answers you.

Related terms

AGI (artificial general intelligence)

A hypothetical AI that could match or exceed people across most intellectual tasks. There is no agreed definition or t…

AI (artificial intelligence)

Computer systems that do tasks we would normally say need human intelligence, such as understanding language, recognis…

AI assistant

A general-purpose chat tool built on a large language model that can write, answer questions, analyse files and, incre…

Algorithm

A set of step-by-step instructions for solving a problem. In machine learning, the training algorithm is the recipe fo…

Chatbot

A program you talk to in a conversation. Older chatbots followed scripted decision trees; modern ones use large langua…

Computer vision

The field of AI that interprets images and video: reading text in photos, spotting defects on a production line, count…

Beyond the definition

Knowing the word is the easy part

A short assessment scores you across five skill areas and builds a path through 18 modules, skipping whatever you already know. Free, no card.

Find your level