Glossary
Figure 0.2. How the core terms fit together. Retrieval, evaluation, and durable-execution terms are left out; each has its own part of the course.- Model. A large language model. It takes text in and returns text out.
- Harness. The code around a model. It sends requests, runs tools, keeps state, and decides when to stop.
- Agent. A model plus a harness plus a goal.
- Tool. A Java method the model can ask the harness to run.
- Tool call. The model’s request to run a tool. It names the tool and gives arguments.
- Loop. The cycle of model call, tool execution, and result. It ends when the run stops.
- Termination. The rule that ends a run.
- Context window. The text the model can read in one call. It is measured in tokens.
- Token. A small piece of text. Providers bill by token.
- Skill. A file of instructions for one task. The harness loads it only when needed.
- Sub-agent. An agent that a parent agent calls as a tool.
- Memory. Information kept across model calls. Short-term memory is the recent conversation. Long-term memory is stored outside it.
- Embedding. A list of numbers that represents the meaning of a text.
- Vector store. A database that finds texts with similar embeddings.
- BM25. A keyword scoring method. It rewards rare words that appear often in a document.
- Hybrid search. Keyword search and vector search, merged into one result list.
- RRF (Reciprocal Rank Fusion). A way to merge ranked lists by rank position, not by score.
- Reranker. A model that scores a query and each candidate together, then reorders the candidates.
- RAG (retrieval-augmented generation). The harness fetches relevant documents before the model answers.
- HITL (human-in-the-loop). A run that pauses until a person approves an action.
- Graph. A flow of nodes and edges. A knowledge graph stores relationships between things.
- Durable execution. A run that survives crashes and restarts because its state is stored.
- Workflow (Temporal). The durable definition of one run.
- Activity (Temporal). A unit of work with side effects, such as a model call. Temporal retries it.
- Signal (Temporal). A message sent to a running workflow, such as an approval.
- Eval. A fixed set of test inputs with expected properties. Run it before each change.
- Prompt caching. The provider reuses work for a stable part of the prompt. It lowers cost.
docs