Analytics Data Factory monitoring premium

Activity run

Activity run is the execution record for one Azure Data Factory or Synapse pipeline activity during a specific pipeline run. In everyday Azure work, teams use it to pinpoint which step ran, failed, retried, timed out, or produced unexpected output. The useful evidence is run ID, activity name, type, start time, duration, status, error message, input, output, and linked-service execution details. Treat the term as an operating handle, not trivia: know who owns it, which boundary it affects, what could break, and which Azure output proves the current state before a production decision.

Aliases
Data Factory activity run, Synapse activity run, pipeline activity execution
Difficulty
intermediate
CLI mappings
4
Last verified
2026-05-09T05:20:00Z

Microsoft Learn

An activity run is one execution of an activity inside a Data Factory or Synapse pipeline run. It records the activity name, type, status, start time, duration, input, output, and troubleshooting details needed to understand pipeline behavior.

Microsoft Learn: Visually monitor Azure Data Factory and Synapse activity runs2026-05-09T05:20:00Z

Technical context

In Azure architecture, Activity run sits in the runtime observability layer for data pipeline orchestration in Azure Data Factory and Azure Synapse. It works with pipeline runs, activity definitions, triggers, integration runtimes, monitoring views, diagnostic logs, and Log Analytics tables. The important distinction is whether the reader is inspecting configuration, runtime behavior, identity, billing, or observability evidence. A strong design records scope, owner, permissions, monitoring signal, and rollback path so the term can be checked consistently across development, test, and production environments.

Why it matters

Activity run matters because it turns an Azure label into a decision point that operators can inspect, govern, and improve. Used well, it keeps work tied to evidence such as run ID, activity name, type, start time, duration, status, error message, input, output, and linked-service execution details. Used poorly, teams may rerun entire pipelines blindly, duplicate writes, miss slow steps, or misdiagnose a linked service failure. The practical value is judgment: knowing which setting or record proves reality, which team owns the next action, and which failure mode to check first during a release, audit, incident, or cost review. Good entries make that decision path clear enough for production use.

Where you see it

Signals, screens, and Azure surfaces where this term usually becomes operational.

Signal 01

Data Factory monitor hub

Signal 02

Synapse pipeline monitoring

Signal 03

activity-run query API

Signal 04

az datafactory activity-run commands

When this becomes relevant

Specific situations where this term helps solve real Azure design, operations, migration, security, reliability, cost, or governance problems.

  • Troubleshooting failed pipeline steps
  • Measuring copy throughput
  • Auditing retries and duration
  • Collecting evidence for data SLA misses

Real-world case studies

Different enterprise-style examples that show the term being used to hit measurable objectives.

Case study 01

Activity run in action

Scenario, objectives, solution, measured impact, and takeaway.

Scenario

Fabrikam Foods, a food distribution organization, had unreliable overnight inventory pipelines and could not identify which step caused missed store updates.

Business/Technical Objectives
  • Locate failing pipeline steps within 10 minutes
  • Measure activity duration against a 90-minute SLA
  • Reduce reruns caused by unclear failures by 50 percent
  • Capture evidence for vendor support tickets
Solution Using Activity run

The team used Activity run as the central control point for the workflow instead of treating it as a background setting. They used activity-run queries for every failed pipeline run. Operators filtered by pipeline run ID, reviewed activity name, type, input, output, duration, retry count, and error details, then routed copy, validation, or transformation failures to the correct support team. Configuration was captured as code where practical, CLI output was saved for release or audit evidence, and monitoring was tied to the specific resource, run, or event pattern so responders could validate behavior without guessing. The final design included an owner, rollback or revoke path, and a standard evidence checklist so the same process could be repeated during audits, incidents, and production release windows.

Results & Business Impact
  • Failed-step identification dropped from 55 minutes to 7 minutes
  • Unnecessary full-pipeline reruns fell by 63 percent
  • SLA breaches were tied to specific slow activities
  • Vendor tickets included activity-run evidence instead of screenshots
Key Takeaway for Glossary Readers

Activity runs give operators the step-level proof needed to troubleshoot data pipelines quickly.

Case study 02

Activity run in action

Scenario, objectives, solution, measured impact, and takeaway.

Scenario

LumenAir Travel, a travel technology organization, needed to prove why flight-pricing data arrived late during peak booking windows.

Business/Technical Objectives
  • Track pipeline latency by activity
  • Separate source delays from transformation bottlenecks
  • Detect retry storms before morning traffic
  • Reduce data-late incidents by 40 percent
Solution Using Activity run

The team used Activity run as the central control point for the workflow instead of treating it as a background setting. They created a monitoring job that queried activity runs after each pricing pipeline. The team compared duration, retry count, input size, output size, and failure messages across copy, lookup, and transformation activities, then alerted when a single activity exceeded historical thresholds. Configuration was captured as code where practical, CLI output was saved for release or audit evidence, and monitoring was tied to the specific resource, run, or event pattern so responders could validate behavior without guessing. The final design included an owner, rollback or revoke path, and a standard evidence checklist so the same process could be repeated during audits, incidents, and production release windows.

Results & Business Impact
  • Data-late incidents fell 44 percent
  • Source throttling was identified as the cause of recurring Monday delays
  • Transformation cluster sizing was tuned using activity duration evidence
  • Morning support escalations dropped by 35 percent
Key Takeaway for Glossary Readers

An activity run turns a vague slow-pipeline complaint into measurable evidence for one execution step.

Case study 03

Activity run in action

Scenario, objectives, solution, measured impact, and takeaway.

Scenario

Arbor University, a higher education organization, needed better visibility into admissions data loads across several departments.

Business/Technical Objectives
  • Expose pipeline execution details to support staff
  • Reduce developer involvement in routine failures
  • Protect sensitive applicant data in monitoring output
  • Document rerun decisions consistently
Solution Using Activity run

The team used Activity run as the central control point for the workflow instead of treating it as a background setting. They standardized activity-run review in the admissions support runbook. Secure output settings were applied to sensitive steps, and support staff used CLI queries to retrieve status, start time, duration, and error details before deciding whether a rerun was safe. Configuration was captured as code where practical, CLI output was saved for release or audit evidence, and monitoring was tied to the specific resource, run, or event pattern so responders could validate behavior without guessing. The final design included an owner, rollback or revoke path, and a standard evidence checklist so the same process could be repeated during audits, incidents, and production release windows.

Results & Business Impact
  • Developer escalations for routine load failures fell 52 percent
  • Applicant data exposure in outputs was eliminated for reviewed activities
  • Rerun decisions became consistent across departments
  • Average morning data validation finished 28 minutes earlier
Key Takeaway for Glossary Readers

Activity-run monitoring gives non-developers enough evidence to operate data pipelines safely.

Why use Azure CLI for this?

Azure CLI is useful for Activity run because it turns portal knowledge into repeatable evidence. az datafactory activity-run query-by-pipeline-run helps retrieve activity-level evidence for a known pipeline run. Use CLI when you need inventory, comparison between environments, release notes, audit proof, or a safe pre-change check. Prefer read-only commands first, save structured output when possible, and treat mutating commands as change-controlled work with subscription, resource group, identity, and rollback details verified before execution.

CLI use cases

  • Inventory the Azure resources or records related to Activity run and confirm the expected scope.
  • Inspect run ID, activity name, type, start time, duration, status, error message, input, output, and linked-service execution details before a release, audit, incident review, or cost discussion.
  • Compare development, test, and production settings so drift is visible before users are affected.
  • Export structured evidence for tickets, runbooks, compliance reviews, or post-incident timelines.

Before you run CLI

  • Confirm the signed-in tenant, subscription, resource group, and target resource name before trusting output.
  • Check whether the command is read-only, mutating, credential-revealing, or potentially destructive.
  • Use the least-privileged identity that can inspect the resource and avoid pasting secrets into shared channels.
  • Decide the output format first, usually table for humans and JSON for automation or saved evidence.
  • Know the rollback or revoke path before running any command that changes state or permissions.

What output tells you

  • The output should identify the current Azure scope and show whether Activity run is configured, active, enabled, or producing evidence.
  • Status, timestamps, IDs, names, and related resource references help connect Activity run to a real owner and workload.
  • Empty output is still evidence: it may mean the feature is disabled, the wrong scope was queried, or the caller lacks permission.
  • Differences between environments usually point to drift, incomplete deployment, stale configuration, or an undocumented exception.

Mapped Azure CLI commands

Activity-run monitoring commands

direct
az datafactory pipeline-run query-by-factory --factory-name <factory> --resource-group <resource-group> --last-updated-after <utc> --last-updated-before <utc>
az datafactory pipeline-rundiscoverAnalytics
az datafactory pipeline-run show --factory-name <factory> --resource-group <resource-group> --run-id <pipeline-run-id>
az datafactory pipeline-rundiscoverAnalytics
az datafactory activity-run query-by-pipeline-run --factory-name <factory> --resource-group <resource-group> --run-id <pipeline-run-id> --last-updated-after <utc> --last-updated-before <utc>
az datafactory activity-rundiscoverAnalytics
az datafactory pipeline-run cancel --factory-name <factory> --resource-group <resource-group> --run-id <pipeline-run-id>
az datafactory pipeline-runremoveAnalytics

Architecture context

In Azure architecture, Activity run sits in the runtime observability layer for data pipeline orchestration in Azure Data Factory and Azure Synapse. It works with pipeline runs, activity definitions, triggers, integration runtimes, monitoring views, diagnostic logs, and Log Analytics tables. The important distinction is whether the reader is inspecting configuration, runtime behavior, identity, billing, or observability evidence. A strong design records scope, owner, permissions, monitoring signal, and rollback path so the term can be checked consistently across development, test, and production environments.

Security

Security for Activity run starts with knowing the access boundary it creates or exposes. Review the activity output may expose paths, parameter values, connection references, or error details that should be handled carefully before trusting the configuration in production. Least privilege, source verification, and clear ownership matter because a small Azure setting can change who can read data, trigger actions, approve permissions, or serve user traffic. Security teams should capture evidence in tickets or runbooks without leaking secrets, tokens, sensitive payloads, or customer data. When possible, pair the term with Microsoft Entra roles, managed identities, policy, logging, and alerting so changes are visible, reviewable, and reversible.

Cost

Cost impact for Activity run may be direct or indirect, but it should still be explicit. The main cost consideration is that failed or repeated runs can consume integration runtime, Spark, SQL, storage, or API capacity without creating useful data. Even when the term is not a billing meter, it can influence the services, retries, alerts, storage, model tokens, compute, or operations effort consumed around it. FinOps review should ask whether the setting is needed, who pays for it, how long evidence is retained, and whether tags, budgets, exports, or Advisor data make the spend explainable. Review the pattern whenever environments are cloned, scaled, or retired.

Reliability

Reliability depends on how Activity run behaves during failure, scale, retries, and change windows. The main reliability concern is accurate failure isolation, retry analysis, idempotent reruns, and recovery decisions for data workflows. Operators should know whether the term affects runtime traffic, orchestration state, alert delivery, recovery evidence, or only management-plane reporting. Before changing it, confirm the rollback path, expected health signal, blast radius, and dependency map. During incidents, use the term to narrow the question: what changed, what is active, what failed, and what evidence proves that the system can safely continue or recover? Keep that evidence close to the change record.

Performance

Performance impact for Activity run depends on where it sits in the workload path. The main performance factor is duration, queue time, throughput, and bottleneck evidence help tune copy, transformation, and downstream steps. Some terms do not speed the application directly, but they improve operational performance by reducing investigation time, noisy processing, or manual triage. Review latency, throughput, queue depth, query shape, token usage, retry behavior, and data volume where they apply. The best test is practical: can the team prove the term improves user experience, deployment speed, incident response, or processing efficiency without hiding a new bottleneck? Measure before and after; assumptions are not evidence.

Operations

Operationally, Activity run should be part of a repeatable runbook, not a portal-only memory. Teams need a standard way of querying activity runs, comparing timing, reviewing errors, exporting evidence, and linking failures to pipeline definitions. The runbook should name the Azure scope, owner, required role, normal state, change procedure, evidence to collect, and escalation path. Good operators also record why a value exists, not just what it is. That context prevents accidental cleanup, noisy alerts, unsafe reruns, stale dashboards, and confusing handoffs between platform, application, data, security, and finance teams. It also makes later reviews faster and less political. This keeps reviews repeatable when pressure is high.

Common mistakes

  • Treating Activity run as a label instead of checking the Azure output that proves its current state.
  • Using the wrong tenant, subscription, project, database, or resource group and then trusting misleading results.
  • Saving sensitive keys, payloads, user data, or permission details in screenshots instead of sanitized evidence.
  • Changing production configuration without documenting the owner, rollback path, alert impact, and expected verification signal.