How it works Start free

← All categories

Language models

How AI writes and talks

Chatbots do not think in sentences. They think in tokens, prompts and context. Here is what that means.

8 terms

Large language model
Level 1
A model trained on enormous amounts of text to predict what words come next.
Token
Level 1
A small chunk of text that a model reads and writes, usually part of a word.
Prompt
Level 1
The instruction and information you give a model.
Context window
Level 2
The maximum amount of text a model can consider at one time.
Temperature
Level 2
A setting that controls how predictable or varied a model's output is.
Hallucination
Level 1
When a model states something false with complete confidence.
Fine-tuning
Level 2
Additional training that adapts a general model to a specific job or style.
System prompt
Level 2
Hidden instructions that set a model's role and rules before you type anything.