Azure Blob StorageStorage

ACG LINK

Azure Blob Storage: Overview and Configuration Example.

Azure Blob Storage is a scalable object storage solution for the cloud, designed to store and manage large amounts of unstructured data, such as text or binary data. It provides high availability, durability, and accessibility to your data from anywhere in the world. Here's a detailed overview of Azure Blob Storage along with a configuration example:

Architecture Diagram

End-to-end architectural topology of Azure Blob Storage, highlighting client ingress protocols (HTTPS, SFTP, NFS v3), Microsoft Entra ID RBAC and SAS security boundaries, container and blob type classifications (Block, Append, Page Blobs and ADLS Gen2), the automated 4-tier lifecycle engine (Hot, Cool, Cold, Archive), regional/geo redundancy models, and Event Grid reactive downstream consumers.

AZURE BLOB STORAGE — OBJECT STORAGE ARCHITECTURE Massive Scalability • Multi-Tier Lifecycle • ADLS Gen2 • Event Grid CLIENTS & INGRESS 🌐 Apps & End Users Web / Mobile / SPAs Uploads, Assets, Docs ⚙️ Backend Services .NET / Java / Python / Go Azure SDKs & REST API 📊 Analytics & Spark Databricks / Synapse ADLS Gen2 / Parquet 🛡️ Enterprise Tools Storage Explorer / CLI AzCopy & Backup Agents 🔑 Protocols & Auth Endpoints: • HTTPS REST (443) • SFTP (SSH Port 22) • NFS v3.0 Protocol Security & Identity: • Microsoft Entra ID (RBAC) • Shared Access Signatures (SAS) • Account Access Keys • User Delegation SAS Network Security: • Private Endpoints (Private Link) • VNet Service Endpoints • IP Firewall Whitelist 💾 AZURE STORAGE ACCOUNT (StorageV2) <account>.blob.core.windows.net STANDARD / PREMIUM 🔒 Security: 256-bit AES Encryption at Rest (Microsoft/Customer-Managed Key) • Soft Delete • Versioning • WORM CONTAINER LAYER: /mycontainer (Organizes blobs; controls public access level) Flat / ADLS Gen2 Hierarchical 📦 Block Blobs Default & General Purpose • Composed of discrete blocks • Up to 50,000 blocks • Max size: ~190.7 TiB Blk 1 Blk 2 Blk 3 → List Best For: • Images, audio, video files • Documents, backups, big data • Data Lake (ADLS Gen2) 📝 Append Blobs Fast Append-Only Writes • Optimized for add operations • Blocks appended at end • Max size: ~195 GiB Data 1 +Data 2 Append Best For: • Application audit trails • Diagnostic & event logs • Continuous telemetry streams 💿 Page Blobs Random Read / Write Pages • 512-byte fixed page size • Targeted page range writes • Max size: up to 8 TiB 512B 512B 512B Seek Best For: • Azure VM OS & Data Disks (VHD) • Azure SQL DB files • Fast random index access ACCESS TIERS & AUTOMATED LIFECYCLE MANAGEMENT Cost Optimization • Policy Rules 🔥 Hot Tier Active & frequent access Highest storage cost Lowest transaction cost 30d ❄️ Cool Tier Infrequent (min 30 days) Lower storage cost Higher read access fee 90d 🧊 Cold Tier Rarely read (min 90 days) Very low storage cost Direct online read SLA 180d 🗄️ Archive Tier Offline (min 180 days) Lowest cost storage Hours to rehydrate ⚙️ Lifecycle Engine: Evaluates prefix/tag filters daily • Transitions tiers • Deletes old versions • Emits tier change metrics 🌎 DATA REDUNDANCY & AVAILABILITY MODELS (High Durability ≥ 99.999999999% 11 9's to 16 9's) LRS (Locally Redundant) 3 copies in 1 DC ZRS (Zone-Redundant) 3 Availability Zones GRS / RA-GRS (Geo) Replication to paired region GZRS / RA-GZRS ZRS + Geo-pair replication EVENTS & CONSUMERS ⚡ Azure Event Grid Event-Driven Reactive Ingestion Native Storage Events: • Microsoft.Storage.BlobCreated • Microsoft.Storage.BlobDeleted • Microsoft.Storage.BlobTierChanged ⚡ Azure Functions BlobTrigger & EventGridTrigger Auto-resizing, OCR, parsing & ETL 🔄 Azure Logic Apps Automated business workflows Email notifications, approval routing 🚌 Azure Service Bus / Queues Decoupled queueing of file events Orderly background file processing 🔬 Azure Synapse / Fabric Serverless SQL querying Delta Lake & Parquet querying in place 📈 Observability & Analytics Azure Monitor Storage Insights: • Ingress/Egress data volumes • Success / Client & Server E2E Latency • Capacity breakdown by Tier & Container Diagnostic Logging: • Read, write, and delete operations • Log Analytics & SIEM integration Events 🗺️ KEY ARCHITECTURAL PILLARS: Massive Scalability: Exabytes capacity per account; up to 190.7 TiB for a single Block Blob. Automated Tiering: Lifecycle policies shift data from Hot → Cool → Cold → Archive to cut costs. Event-Driven: Built-in Event Grid integration notifies downstream services in milliseconds.
Figure 1: High-level architectural topology of Azure Blob Storage Account, Entities, Access Tiers, Security, and Event-Driven Ecosystem.

Features of Azure Blob Storage

Scalability and Durability
Provides scalable storage capacity with the ability to store and manage vast amounts of data. Data is replicated for high durability.
Multiple Storage Tiers
Supports multiple storage tiers, including hot, cool, cold, and archive, to optimize costs based on data access patterns.
Blob Types
Supports different types of blobs, including block blobs, append blobs, and page blobs, each designed for specific use cases.
Data Encryption
Offers encryption at rest and in transit, ensuring the security of stored data.
Access Control and Authorization
Integrates with Microsoft Entra ID (formerly Azure Active Directory) for role-based access control (RBAC) and supports Shared Access Signatures (SAS) for fine-grained authorization.
Versioning
Provides versioning support for blobs, enabling you to track changes and restore previous versions.
Lifecycle Management
Allows you to define rule-based policies for automatic data movement between storage tiers and retention policies.
Event Grid Integration
Integrates with Azure Event Grid for event-driven architectures, enabling you to react to blob storage events (such as blob created or deleted).

Configuration Example

Let's configure an Azure Blob Storage account and upload a file to a blob container using the Azure Storage Explorer:

# Step What to do
1 Login to Azure Portal Navigate to the Azure Portal.
2 Create a Storage Account Click on "Create a resource" and search for "Storage account." Click "Create" to start the Storage Account creation wizard. Specify account details, such as subscription, resource group, storage account name, region, and performance (Standard / Premium).
3 Configure Advanced Settings Configure additional settings, such as account kind (StorageV2 for general-purpose storage), replication (Locally redundant storage — LRS, Geo-redundant storage — GRS, etc.), and access tier (Hot or Cool).
4 Review and Create Review the configured settings and click "Create" to deploy the Storage Account.
5 Access Keys Once the Storage Account is created, navigate to the Storage Account in the Azure Portal. Go to "Settings" > "Access keys" to find the account key, which is required for authentication.
6 Install Azure Storage Explorer Download and install Azure Storage Explorer.
7 Connect to Storage Account Open Azure Storage Explorer and click on "Add an account" to connect to your Azure subscription. Provide the subscription ID and paste one of the access keys obtained from the Storage Account.
8 Create a Blob Container In Azure Storage Explorer, navigate to the Storage Account > Blob Containers. Right-click on "Blob Containers" and select "Create Blob Container." Provide a name for the container, e.g., "mycontainer."
9 Upload a File to Blob Container Right-click on the created container and select "Upload..." Choose a file to upload to the blob container.
10 Access Blob URL Once the file is uploaded, right-click on the file and select "Copy URL" to get the URL of the blob.
11 Blob Access Control (Optional) Configure access control for the blob, such as setting public access levels or generating a Shared Access Signature (SAS) for temporary access.
12 Blob Versioning (Optional) Enable blob versioning in the Azure Portal if versioning is required for the blob.
13 Blob Lifecycle Management (Optional) Configure a lifecycle management policy in the Azure Portal to automatically move blobs between storage tiers or delete old versions.
14 Blob Events (Optional) Set up Azure Event Grid to receive notifications about blob events, such as blob created or deleted.
15 Blob Analytics (Optional) Enable Azure Storage Analytics to capture metrics and logs for monitoring and analysis.