AGI
Artificial General IntelligenceA hypothetical AI matching human ability across arbitrary cognitive tasks.
Artificial General Intelligence — an AI that generalises across arbitrary tasks at or above human level, in contrast to today's narrow AI systems.
AI
Artificial IntelligenceSoftware systems that perform tasks that normally require human intelligence.
Artificial Intelligence — the broad field spanning symbolic reasoning, machine learning, and modern deep-learning-based generative models like Claude.
Context Window
Context LengthDomain 2The maximum number of tokens a model can attend to at once.
Claude Opus 4.7 supports up to 1M tokens. Anything past the context window is invisible to the model.
Deep Learning
DLNeural networks with many layers trained on large datasets.
A subfield of ML using multi-layer neural networks. Transformers — the architecture behind Claude — are a deep-learning architecture.
Embedding
A dense vector representation of text or other data.
Embeddings turn text into vectors so that semantic similarity ≈ cosine similarity. Used for retrieval (RAG), clustering, and classification.
Fine-tuning
Additional training on a specialised dataset to steer a model.
Adjusts model weights with supervised data. Distinct from prompting (no weight updates) and RLHF (uses preference data).
Foundation Model
A large pretrained model repurposed for many downstream tasks.
A base model (often multi-modal) trained once at great cost and then adapted — via fine-tuning, prompting, or RLHF — to many uses. Claude Opus/Sonnet/Haiku are foundation models.
LLM
Large Language ModelA transformer trained on text at scale to predict the next token.
Large Language Model — Claude, GPT, Gemini, Llama are LLMs. They generate text by sampling one token at a time from a learned distribution.
ML
Machine LearningAlgorithms that learn statistical patterns from data.
Machine Learning — the family of statistical algorithms (linear models, trees, deep networks) that learn from data rather than being programmed with explicit rules.
Neural Network
NNA parameterised function of stacked linear + nonlinear layers.
A network of weighted connections trained via gradient descent. Transformers stack self-attention layers to model relationships across a sequence.
RAG
Retrieval-Augmented GenerationPrompting an LLM with retrieved passages from a knowledge base.
Retrieval-Augmented Generation — embed a corpus, retrieve top-k passages for a query, and pass them to the LLM as context. The go-to pattern for grounded answers.
See also: Embedding, Vector Database
RL
Reinforcement LearningTraining a policy from reward signals rather than labelled examples.
The agent picks actions and learns from the resulting rewards. Underpins RLHF, RLAIF, and increasingly the training of reasoning models.
Token
The atomic unit of text an LLM sees — typically ~4 chars in English.
LLMs read and write tokens, not characters. Costs are billed per token; context windows are counted in tokens; latency scales with tokens.
Tokenization
Splitting text into tokens the model can process.
The lookup that turns 'hello world' into a sequence of integer token IDs. Different models use different tokenizers, so byte counts vary.
Transformer
The neural-network architecture behind modern LLMs including Claude.
Attention-based sequence model introduced in 'Attention Is All You Need' (2017). Every current frontier LLM — Claude, GPT, Gemini — is a transformer variant.