Technical glossary
Look up a concept, follow its connections, or try it in a local tool. Each definition includes an example, a limitation and a primary source.
AI agent
AI
A system in which a model chooses tools or steps to pursue a task within configured boundaries.
In practice. Inspect an incident, request a permitted log lookup and propose the next step.
Watch for. Model output is not authority: software must enforce permissions and approval.
AIOps
Platform
Use AI to assist operations, such as alert correlation, incident investigation and remediation proposals.
In practice. Connect a latency alert with traces and a recent deployment for an operator to review.
Watch for. Correlation is not proof of cause; remediation needs scoped authority and validation.
Apache Airflow
Data
Coordinate workflows defined as code, including dependencies, schedules, retries and task state.
In practice. Run extraction, validation and reporting in dependency order and inspect failed tasks.
Watch for. It is an orchestrator, not a per-event streaming engine.
Apache Kafka
Data
A distributed event-streaming platform with partitioned logs that producers write and consumers can replay.
In practice. Publish order events so inventory and analytics can consume them independently.
Watch for. Ordering is per partition, not global; retention and delivery semantics need deliberate configuration.
Backoff
Platform
Delay successive retries to reduce pressure on a failing dependency; jitter spreads synchronized clients.
In practice. Try again after progressively longer bounded delays, with a total retry budget.
Watch for. More retries can amplify an outage. Retry only eligible failures and make side effects safe.
Batch processing
Data
Process a bounded collection of data as a job, rather than treating it as an endless flow.
In practice. Calculate yesterday's sales from a closed set of orders.
Watch for. Scheduling frequency and job duration determine how long readers wait for new results.
Change data capture
Data
Turn database changes into events that downstream consumers can process incrementally.
In practice. Propagate inserts, updates and deletes from an operational database to an analytical system.
Watch for. Snapshots, replay, deletes and schema changes require explicit consumer behavior.
Circuit breaker
Platform
Temporarily stop calls after enough failures, then admit limited probes to check recovery.
In practice. Open a circuit during a persistent dependency outage and test it after a cooldown.
Watch for. It does not repair the dependency and can delay recovery if thresholds are poorly chosen.
ClickHouse
Data
A column-oriented SQL database designed for analytical queries over large volumes of data.
In practice. Aggregate event histories to power an operational dashboard.
Watch for. An analytical serving layer needs its own ingestion, retention and recovery design; it does not replace every transactional database.
Data lineage
Data
Recorded relationships between datasets, jobs and runs that explain where data came from and how it changed.
In practice. Trace a dashboard field back to the job and source dataset that produced it.
Watch for. Lineage coverage can be incomplete; a dependency graph does not prove data correctness.
DataOps
Data
Collaborative practices that improve delivery and operation of analytical data through automation, testing and feedback.
In practice. Validate a pipeline change with representative data before releasing it and observe quality afterwards.
Watch for. An orchestrator alone cannot replace ownership, quality criteria or communication with consumers.
dbt
Data
Build, test and document data transformations from versioned models and their dependencies.
In practice. Turn raw order tables into tested revenue models with traceable dependencies.
Watch for. dbt does not replace ingestion; adapters and Core/Fusion release channels must be checked separately.
Dead-letter queue
Platform
A separate destination for messages that could not be processed within the configured attempt limit.
In practice. Quarantine an invalid event after repeated failures and inspect it before replay.
Watch for. Moving a message to a DLQ is not successful processing; retention and replay need an owner.
DevOps
Platform
Shared practices and responsibility across software delivery and operation, supported by automation and feedback.
In practice. The team that ships a service also uses incident feedback to improve its delivery process.
Watch for. Renaming a team or installing a CI server does not establish shared ownership.
DevSecOps
Platform
Integrate security practices and shared responsibility throughout software development, delivery and operation.
In practice. Review threat assumptions, verify dependencies and test authorization before releasing a change.
Watch for. A scanner passing does not establish secure design; exceptions, remediation and incident learning still need owners.
DuckDB
Data
An analytical SQL engine that can run inside an application and query files such as Parquet.
In practice. Explore a local dataset without deploying a separate database server.
Watch for. Local performance does not establish distributed or multi-user service capacity; preview features have separate limits.
Evaluation
AI
A defined set of tasks and scoring rules used to inspect system behavior, including failures.
In practice. Check task completion and unauthorized actions separately on a held-out test set.
Watch for. A high aggregate score can hide dangerous failures; model judges also need calibration.
FinOps
Platform
Shared practices connecting technology spending, ownership and business value through engineering, finance and product collaboration.
In practice. Attribute a service's cost, review demand and compare cost per successful task.
Watch for. Reducing a bill without preserving needed quality, reliability or value can be a false saving.
GitOps
Platform
Continuous reconciliation of running systems against a versioned description of their intended state.
In practice. A controller restores a deployment after an unapproved configuration change.
Watch for. A pipeline that runs scripts from Git is not necessarily a reconciliation loop.
Idempotency
Platform
Repeating the same operation has the same intended effect as performing it once.
In practice. Reuse an operation identifier when retrying an order creation after a timeout.
Watch for. The key, scope and retention window matter; a timeout does not prove the first attempt failed.
Infrastructure as code
Cloud
Infrastructure definitions stored as reviewable, versioned configuration that automation can apply.
In practice. Review a network change and its plan before applying it.
Watch for. Version control does not prevent drift or make a destructive plan safe.
KV cache
AI
Stored attention keys and values from prior tokens, reused during autoregressive decoding.
In practice. Reuse the prompt cache while producing each subsequent token.
Watch for. Memory grows with sequence length and concurrency; layout and compression depend on the model and runtime.
Lakehouse
Data
An analytical architecture combining lake-style storage with table management and warehouse-style capabilities.
In practice. Keep analytical tables in object storage and query them through a tested catalog and engine.
Watch for. Open files alone do not establish transactions, permissions or interoperability.
LLMOps
AI
Lifecycle practices for releasing, evaluating and operating applications built around language models.
In practice. Version prompts and retrieval data, evaluate a release and observe its latency, cost and failures.
Watch for. A model benchmark does not validate the application's tools, permissions or real user tasks.
MCP
AI
A protocol through which AI applications discover and interact with tools, resources and prompts exposed by servers.
In practice. Expose a read-only catalog tool through a server with explicit access controls.
Watch for. Protocol compatibility does not grant permission or make tool output trustworthy.
Medallion architecture
Data
Organize data by refinement: bronze retains raw input, silver validates it and gold serves a use case.
In practice. Preserve incoming orders, validate identifiers, then publish a revenue summary.
Watch for. Layer names are a design convention, not proof of data quality or a requirement to copy every dataset three times.
MLOps
AI
Practices for delivering and operating ML systems across code, data, training, deployment and monitoring.
In practice. Version a model with its training data references, evaluation results and rollback artifact.
Watch for. Automating deployment does not ensure model quality or detect every change in production data.
Multi-agent systems
AI
Several agents cooperate with distinct responsibilities, context or permissions in one workflow.
In practice. A coordinator requests a report from a data agent and a reviewer checks its sources.
Watch for. Additional agents increase coordination, latency and failure paths; they do not guarantee better answers.
Private cloud
Cloud
Cloud resources dedicated to one organization, whether operated on its premises or by a provider.
In practice. An internal platform offers self-service environments to several business units.
Watch for. Virtual machines alone do not establish a cloud operating model.
Quantization
AI
Represent selected model values with lower precision to reduce storage and potentially computation.
In practice. Evaluate 4-bit weights against the original model using a held-out workload.
Watch for. Smaller weights do not guarantee faster inference or unchanged quality; hardware support matters.
RAG
AI
Generation conditioned on information retrieved from an external collection, rather than model parameters alone.
In practice. Retrieve relevant policy passages and provide them as context for an answer.
Watch for. Retrieval can miss evidence; supplied context does not guarantee a supported answer.
Site reliability engineering (SRE)
Platform
Apply software engineering to operating services with explicit reliability goals and limited manual toil.
In practice. Use an error budget to decide whether to ship a change or address reliability first.
Watch for. Reliability targets reflect user needs and cost; a dashboard alone is not an SRE practice.
SLO
Platform
A target for a measured service indicator, over a defined population and time window.
In practice. At least 99.9% of valid requests succeed over a rolling 30-day window.
Watch for. A target is not a measurement or a contractual guarantee; exclusions must be explicit.
Streaming
Data
Process events as a continuing flow, with explicit rules for time, state and late arrivals.
In practice. Update available inventory as order events arrive.
Watch for. Low latency still requires replay, backpressure and duplicate handling; it does not mean instant or lossless.
VPC
Cloud
A logically isolated virtual network in a cloud provider, with controlled addressing and connectivity.
In practice. Separate application subnets from a database subnet and define their routes.
Watch for. A VPC is a network boundary, not proof of complete workload isolation.
Watermark
Data
A stream-processing signal of event-time progress, used to decide when time-based operations can advance.
In practice. Close a window after its watermark passes the window end, with a policy for late events.
Watch for. A watermark is not a guarantee that no older event will ever arrive.