Batch processing
Sending many requests together to be processed in the background over a longer window, rather than waiting for each in real time. Providers that offer it often charge less, which suits jobs such as classifying a backlog of documents overnight.
Related terms
A way for software to talk to other software. AI providers offer APIs so developers can send prompts and receive outpu…
API keyA secret string that identifies your account when your code calls an API, and that the bill is charged to. Treat it li…
AgentAn AI system that works towards a goal over several steps, deciding which tools to use and acting on the results with …
Agentic workflowA process where an AI model decides some of the steps itself, rather than following a fixed sequence. It handles messy…
BenchmarkA standard public test used to compare models, such as sets of exam questions, coding problems or maths puzzles. Usefu…
Benchmark contaminationWhen benchmark questions or answers have leaked into a model's training data, so a high score partly reflects memory r…
Knowing the word is the easy part
A short assessment scores you across five skill areas and builds a path through 18 modules, skipping whatever you already know. Free, no card.
Find your level