Storage Storage accounts complete field-manual-complete

Storage account diagnostic settings

Storage account diagnostic settings decide which monitoring data from storage services is collected and where it goes. Without them, teams may see basic platform metrics but miss detailed resource logs needed to investigate reads, writes, deletes, authentication failures, latency, or unusual callers. A setting can send data to Log Analytics for queries, Event Hubs for streaming, or another storage account for archival. For learners, diagnostic settings are the bridge between a storage account doing work and operators having evidence about that work after an incident or audit.

Aliases
storage diagnostics, storage logging, Azure Monitor diagnostic settings for storage, resource logs for storage
Difficulty
advanced
CLI mappings
5
Last verified
2026-05-25

Microsoft Learn

Microsoft Learn explains that Azure Monitor diagnostic settings collect resource logs and route platform metrics or activity log data to destinations such as Log Analytics, Event Hubs, or Storage. For storage accounts, they make service activity observable for security, troubleshooting, and compliance.

Microsoft Learn: Diagnostic settings in Azure Monitor2026-05-25

Technical context

In Azure architecture, diagnostic settings are Azure Monitor configuration applied to a resource or supported child resource. For storage, operators often configure logging for blob, file, queue, and table services so StorageRead, StorageWrite, and StorageDelete style activity can be analyzed. The setting lives in the control plane, but the collected records describe data-plane behavior. Destinations must exist first, and regional constraints or firewall rules can matter. Policies can deploy or audit diagnostic settings at scale, while Log Analytics tables and workbooks turn the emitted logs into operational signals.

Why it matters

Diagnostic settings matter because storage incidents are hard to prove from symptoms alone. A user may report missing blobs, a pipeline may slow down, or security may ask who downloaded data from a container. Without resource logs, the team is left with guesses, client logs, and partial metrics. With diagnostic settings, operators can query operations, caller IP addresses, authentication type, request status, latency, and timestamps depending on the service and log schema. They also support audit requirements that expect evidence, not verbal assurance. The tradeoff is cost and noise: collecting everything everywhere without retention discipline can create expensive logs that nobody reads.

Where you see it

Signals, screens, and Azure surfaces where this term usually becomes operational.

Signal 01

In the Azure portal, Diagnostic settings appears on storage accounts and supported storage services where operators choose log categories, metric routes, and destinations for audits.

Signal 02

Azure CLI az monitor diagnostic-settings list shows existing routes, destination resource IDs, enabled categories, and whether a storage account has observable logs today for audits.

Signal 03

In Log Analytics, tables such as StorageBlobLogs or related Azure Monitor records show request details after diagnostic settings send storage resource logs during incidents and audits.

When this becomes relevant

Specific situations where this term helps solve real Azure design, operations, migration, security, reliability, cost, or governance problems.

  • Prove who read, wrote, or deleted storage data during an audit or suspected exfiltration event.
  • Route blob, file, queue, or table logs to Log Analytics so operations can troubleshoot failed requests.
  • Use Azure Policy to deploy required diagnostic settings for regulated storage accounts at scale.
  • Stream storage logs to Event Hubs for a central SIEM or security analytics platform.
  • Control monitoring cost by collecting required categories and setting retention based on data classification.

Real-world case studies

Different enterprise-style examples that show the term being used to hit measurable objectives.

Case study 01

Online education platform investigates missing lesson assets

Scenario, objectives, solution, measured impact, and takeaway.

Scenario

An online education platform saw random lesson images disappear from Blob Storage, but only basic metrics were enabled on the affected accounts.

Business/Technical Objectives
  • Capture detailed read, write, and delete activity for lesson asset containers.
  • Identify whether deletes came from users, automation, or a broken cleanup job.
  • Create alerts for unusual delete volume.
  • Control log retention so monitoring cost stayed predictable.
Solution Using Storage account diagnostic settings

The cloud operations team enabled diagnostic settings for Blob service resources and routed storage logs to a dedicated Log Analytics workspace. Azure CLI listed existing diagnostic settings, created missing routes, and exported the configuration for change records. The team wrote Kusto queries for delete operations, caller IP address, authentication type, and user agent patterns. A retention policy kept high-detail logs for 45 days, while summary workbooks tracked weekly delete trends. After the first week, logs showed a cleanup job using an old prefix rule that matched active lesson folders, so the team disabled that rule and added an alert for deletes above a daily threshold.

Results & Business Impact
  • Root cause was identified in 36 hours; the prior investigation had run for nine days without proof.
  • Unplanned lesson asset deletes dropped to zero after the cleanup rule was fixed.
  • Support escalations about missing images fell by 68 percent in the following month.
  • Log ingestion stayed within budget by separating detailed retention from summary reporting.
Key Takeaway for Glossary Readers

Diagnostic settings turn storage mysteries into queryable evidence that operators can act on quickly.

Case study 02

Public transit agency streams storage logs to its SOC

Scenario, objectives, solution, measured impact, and takeaway.

Scenario

A public transit agency stored fare reconciliation exports in Azure Storage and needed stronger evidence for security monitoring and regulatory audits.

Business/Technical Objectives
  • Route storage access logs into the central security operations pipeline.
  • Detect suspicious reads from unapproved networks.
  • Prove diagnostic settings remained enabled across new accounts.
  • Keep fare reporting teams from losing access during observability changes.
Solution Using Storage account diagnostic settings

The security engineering group configured diagnostic settings on fare storage services to send resource logs to Event Hubs, where the agency’s SIEM collected them. Azure Policy deployed required settings for new accounts and flagged existing accounts missing routes. Azure CLI was used to validate destination IDs, enabled categories, and activity log changes after each remediation task. Firewall-denied requests and unusual read patterns were correlated with identity logs. The storage team staged changes by account, verified fare export jobs after each setting, and documented the Event Hub namespace, retention, and SOC alert mapping in the runbook.

Results & Business Impact
  • Coverage for regulated fare storage accounts increased from 43 percent to 100 percent in three weeks.
  • The SOC detected and blocked two misconfigured partner IP ranges before month-end reconciliation.
  • Audit evidence collection shrank from ten business days to one afternoon of scripted exports.
  • Fare export job success remained above 99.8 percent during the diagnostic rollout.
Key Takeaway for Glossary Readers

Storage diagnostic settings are a security control when they feed the people and tools responsible for detection.

Case study 03

Biotech lab reins in noisy storage logging

Scenario, objectives, solution, measured impact, and takeaway.

Scenario

A biotech lab enabled every storage diagnostic category for genomics accounts and then saw its Log Analytics bill spike faster than expected.

Business/Technical Objectives
  • Preserve investigation capability for regulated sample data.
  • Reduce low-value log ingestion from temporary analysis accounts.
  • Separate production evidence from exploratory research noise.
  • Give scientists a clear rule for when detailed logs are required.
Solution Using Storage account diagnostic settings

The platform architect reviewed storage diagnostic settings with cost and compliance teams. Production sample accounts kept detailed Blob logs with a 90-day retention target, while temporary analysis accounts routed only required categories and shorter retention. Azure CLI exported current settings and compared them with account tags for data classification. Workbooks showed log volume by account, category, and research group. Azure Policy was updated so regulated accounts still received full diagnostic settings, but sandbox accounts needed an approval tag before enabling high-volume categories. Scientists received a short checklist explaining which storage accounts required evidence-grade logging.

Results & Business Impact
  • Monthly Log Analytics ingestion for storage dropped by 31 percent without reducing regulated account coverage.
  • Production sample investigations still had operation-level evidence for reads, writes, and deletes.
  • Twenty-two temporary accounts were reclassified and moved to shorter retention.
  • Cost review meetings shifted from blame to account-level decisions backed by log volume data.
Key Takeaway for Glossary Readers

The right diagnostic settings collect enough evidence for the workload without turning every storage account into a telemetry fire hose.

Why use Azure CLI for this?

With a decade of Azure operations behind me, I use Azure CLI for diagnostic settings because observability must be repeatable across hundreds of accounts. The portal is fine for one setting, but CLI can list settings, compare destinations, create missing routes, and export evidence in JSON. It also helps detect drift after teams create new storage accounts or child services. During troubleshooting, CLI quickly confirms whether logs were ever enabled and where they were sent. That saves hours of chasing missing data in the wrong workspace. For compliance, scripted diagnostic checks are stronger than screenshots because they can be rerun, diffed, and attached to remediation work.

CLI use cases

  • List diagnostic settings on a storage account or child service to confirm required logging exists.
  • Create a diagnostic setting that sends selected storage resource logs to a Log Analytics workspace.
  • Compare diagnostic destinations across subscriptions to find accounts that drifted from policy.
  • Export diagnostic settings as evidence for auditors after a security or compliance review.
  • Delete or update stale diagnostic settings after resource moves, workspace migrations, or retention changes.

Before you run CLI

  • Confirm whether you are targeting the storage account or a specific blob, file, queue, or table service resource ID.
  • Verify the Log Analytics workspace, Event Hub, or archival storage destination already exists and accepts diagnostic data.
  • Check your permissions for Microsoft.Insights diagnostic settings and storage resources before creating or changing routes.
  • Understand ingestion and retention cost before enabling high-volume categories on busy storage accounts.
  • Use JSON output for automation because diagnostic setting resource IDs and category names are easy to mistype.

What output tells you

  • Diagnostic setting output identifies enabled log categories, metric routes, destination IDs, and whether the configuration is active.
  • A missing setting means detailed resource logs may not exist for future incidents, even if basic metrics are visible.
  • Destination fields show whether data goes to Log Analytics, Event Hubs, storage archival, or multiple supported sinks.
  • Category values reveal which storage operations are observable and which service activities may remain invisible.
  • Activity log entries show diagnostic setting changes, helping detect accidental removal or suspicious logging disablement.

Mapped Azure CLI commands

Storage accounts operations

direct
az storage account list --resource-group <resource-group>
az storage accountdiscoverStorage
az storage account show --name <storage-account> --resource-group <resource-group>
az storage accountdiscoverStorage
az storage account create --name <storage-account> --resource-group <resource-group> --location <region> --sku Standard_LRS
az storage accountprovisionStorage
az storage account update --name <storage-account> --resource-group <resource-group>
az storage accountconfigureStorage
az storage account delete --name <storage-account> --resource-group <resource-group>
az storage accountremoveStorage

Architecture context

Architecturally, storage diagnostic settings are part of the monitoring and evidence plane. I design them with the same seriousness as firewalls or backup, because they decide whether the team can reconstruct storage activity after a failure or data question. The destination choice matters: Log Analytics supports investigation and alerting, Event Hubs supports downstream SIEM pipelines, and storage archival supports retention but not fast analysis. I also separate noisy high-volume accounts from quiet compliance accounts so one workload does not drown out another. Azure Policy should enforce required categories, but the architecture still needs retention, workspace ownership, and query patterns that people actually use.

Security

Security impact is strong because diagnostic settings provide evidence of storage access and potential abuse. Logs can show caller addresses, authentication methods, operation names, status codes, and authorization details depending on service and schema. Send security-relevant logs to a protected Log Analytics workspace or SIEM pipeline, restrict who can modify diagnostic settings, and alert on deletion or destination changes. Remember that logs may contain sensitive metadata, object names, or user identifiers, so workspace access and retention need governance. Attackers with sufficient permission may try to disable logging before exfiltration, making activity log monitoring and policy enforcement important for regulated workloads.

Cost

Cost impact is direct through log ingestion, retention, exports, Event Hubs throughput, and archival storage. High-volume storage accounts can generate large numbers of read, write, and delete records, especially analytics, backup, static website, or data lake workloads. Collecting every category for every account may be defensible for regulated data, but wasteful for temporary accounts. FinOps reviews should compare logging requirements with actual query and alert usage, tune retention, and separate noisy workloads where possible. The cheapest plan is not no logging; it is collecting the evidence that supports operations and compliance without keeping low-value telemetry forever and service ownership reviews.

Reliability

Reliability impact is indirect but important. Diagnostic settings do not make storage more durable, but they make failures diagnosable and recovery decisions faster. When a queue trigger falls behind, file share clients fail, or blob writes slow down, logs help distinguish service throttling, authentication failure, firewall denial, client retry behavior, and application mistakes. Reliable operations also depend on the destination being healthy; if logs route to a workspace or Event Hub that is misconfigured, evidence can disappear. Runbooks should verify diagnostic routing after account creation, region moves, destination firewall changes, and policy remediation so monitoring survives platform changes during incidents.

Performance

Diagnostic settings usually do not change storage service performance, but they affect diagnostic performance. When logs are enabled and routed well, operators can query failures quickly instead of reproducing issues or asking developers for client traces. Poorly designed logging can slow investigations if data lands in the wrong workspace, uses inconsistent retention, or floods tables with unfiltered noise. Alert latency also depends on ingestion timing and query design. Performance-minded teams validate that critical storage operations produce logs within expected time, build focused queries for common incidents, and avoid turning every investigation into a slow, expensive search through unrelated accounts quickly.

Operations

Operators use storage diagnostic settings to enable resource logs, route metrics, prove compliance, troubleshoot requests, and build alerts or workbooks. Day-to-day tasks include listing settings, confirming destinations, validating categories, checking ingestion delay, querying Log Analytics tables, and remediating accounts missing required logging. They should document which logs are required for each service type, how long they are retained, who owns the workspace, and what alerts depend on them. Good operations also clean up diagnostic settings when resources are deleted or renamed, because stale settings can surprise teams if a resource name is reused later and escalation ownership paths clearly.

Common mistakes

  • Enabling diagnostics only on the storage account level while missing service-specific logs needed for blob, file, queue, or table investigations.
  • Sending logs to a workspace nobody monitors, then assuming compliance or alerting is covered.
  • Collecting every log category on high-volume accounts without retention planning or cost review.
  • Forgetting that destination firewalls, regional constraints, or deleted workspaces can break diagnostic routing.
  • Deleting or renaming resources without cleaning up diagnostic settings and related policy remediation state.