# azure_blob_storage

> For the complete documentation index, see [llms.txt](https://docs.redpanda.com/llms.txt). Component-specific: [connect-full.txt](https://docs.redpanda.com/connect-full.txt)

---
title: azure_blob_storage
latest-connect-version: 4.93.0
latest-operator-version: v26.1.4
latest-console-tag: v3.7.3
latest-redpanda-tag: v26.1.9
docname: inputs/azure_blob_storage
page-component-name: connect
page-version: master
page-component-version: master
page-component-title: Connect
page-relative-src-path: inputs/azure_blob_storage.adoc
page-edit-url: https://github.com/redpanda-data/rp-connect-docs/edit/main/modules/components/pages/inputs/azure_blob_storage.adoc
page-git-created-date: "2024-05-24"
page-git-modified-date: "2026-05-26"
---

<!-- Source: https://docs.redpanda.com/connect/components/inputs/azure_blob_storage.md -->

**Type:** Input ▼

[Input](https://docs.redpanda.com/connect/components/inputs/azure_blob_storage/)[Output](https://docs.redpanda.com/connect/components/outputs/azure_blob_storage/)

**Available in:** [Cloud](https://docs.redpanda.com/cloud-data-platform/develop/connect/components/inputs/azure_blob_storage/%20%22View%20the%20Cloud%20version%20of%20this%20component%22), Self-Managed

Downloads objects within an Azure Blob Storage container, optionally filtered by a prefix.

Introduced in version 3.36.0.

#### Common

```yml
inputs:
  label: ""
  azure_blob_storage:
    storage_account: ""
    storage_access_key: ""
    storage_connection_string: ""
    storage_sas_token: ""
    container: "" # No default (required)
    prefix: ""
    scanner:
      to_the_end: {}
    targets_input: "" # No default (optional)
```

#### Advanced

```yml
inputs:
  label: ""
  azure_blob_storage:
    storage_account: ""
    storage_access_key: ""
    storage_connection_string: ""
    storage_sas_token: ""
    container: "" # No default (required)
    prefix: ""
    scanner:
      to_the_end: {}
    delete_objects: false
    targets_input: "" # No default (optional)
```

Supports multiple authentication methods but only one of the following is required:

-   `storage_connection_string`

-   `storage_account` and `storage_access_key`

-   `storage_account` and `storage_sas_token`

-   `storage_account` to access via [DefaultAzureCredential](https://pkg.go.dev/github.com/Azure/azure-sdk-for-go/sdk/azidentity#DefaultAzureCredential)


If multiple are set then the `storage_connection_string` is given priority.

If the `storage_connection_string` does not contain the `AccountName` parameter, please specify it in the `storage_account` field.

## [](#download-large-files)Download large files

When downloading large files it’s often necessary to process it in streamed parts in order to avoid loading the entire file in memory at a given time. In order to do this a [`scanner`](#scanner) can be specified that determines how to break the input into smaller individual messages.

## [](#stream-new-files)Stream new files

By default this input will consume all files found within the target container and will then gracefully terminate. This is referred to as a "batch" mode of operation. However, it’s possible to instead configure a container as [an Event Grid source](https://learn.microsoft.com/en-gb/azure/event-grid/event-schema-blob-storage) and then use this as a [`targets_input`](#targets_input), in which case new files are consumed as they’re uploaded and Redpanda Connect will continue listening for and downloading files as they arrive. This is referred to as a "streamed" mode of operation.

## [](#metadata)Metadata

This input adds the following metadata fields to each message:

-   blob\_storage\_key

-   blob\_storage\_container

-   blob\_storage\_last\_modified

-   blob\_storage\_last\_modified\_unix

-   blob\_storage\_content\_type

-   blob\_storage\_content\_encoding

-   All user defined metadata


You can access these metadata fields using [function interpolation](https://docs.redpanda.com/connect/configuration/interpolation/#bloblang-queries).

## [](#fields)Fields

### [](#container)`container`

The name of the container from which to download blobs.

This field supports [interpolation functions](https://docs.redpanda.com/connect/configuration/interpolation/#bloblang-queries).

**Type**: `string`

### [](#delete_objects)`delete_objects`

Whether to delete downloaded objects from the blob once they are processed.

**Type**: `bool`

**Default**: `false`

### [](#prefix)`prefix`

An optional path prefix, if set only objects with the prefix are consumed.

**Type**: `string`

**Default**: `""`

### [](#scanner)`scanner`

The [scanner](https://docs.redpanda.com/connect/components/scanners/about/) by which the stream of bytes consumed will be broken out into individual messages. Scanners are useful for processing large sources of data without holding the entirety of it within memory. For example, the `csv` scanner allows you to process individual CSV rows without loading the entire CSV file in memory at once.

Requires version 4.25.0 or later.

**Type**: `scanner`

**Default**:

```yaml
to_the_end: {}
```

### [](#storage_access_key)`storage_access_key`

The storage account access key. This field is ignored if `storage_connection_string` is set.

**Type**: `string`

**Default**: `""`

### [](#storage_account)`storage_account`

The storage account to access. This field is ignored if `storage_connection_string` is set.

**Type**: `string`

**Default**: `""`

### [](#storage_connection_string)`storage_connection_string`

A storage account connection string. This field is required if `storage_account` and `storage_access_key` / `storage_sas_token` are not set.

**Type**: `string`

**Default**: `""`

### [](#storage_sas_token)`storage_sas_token`

The storage account SAS token. This field is ignored if `storage_connection_string` or `storage_access_key` are set.

**Type**: `string`

**Default**: `""`

### [](#targets_input)`targets_input`

> ⚠️ **CAUTION**
>
> This is an experimental field that provides an optional source of download targets, configured as a [regular Redpanda Connect input](https://docs.redpanda.com/connect/components/inputs/about/). Each message yielded by this input should be a single structured object containing a field `name`, which represents the blob to be downloaded.

This requires setting up [Azure Blob Storage as an Event Grid source](https://learn.microsoft.com/en-gb/azure/event-grid/event-schema-blob-storage) and an associated event handler that a Redpanda Connect input can read from. For example, use either one of the following:

-   [Azure Event Hubs](https://learn.microsoft.com/en-gb/azure/event-grid/handler-event-hubs) using the `kafka` input

-   [Namespace topics](https://learn.microsoft.com/en-gb/azure/event-grid/handler-event-grid-namespace-topic) using the `mqtt` input


Requires version 4.27.0 or later.

**Type**: `input`

```yaml
# Examples:
targets_input:
  mqtt:
    topics:
      - some-topic
    urls:
      - example.westeurope-1.ts.eventgrid.azure.net:8883
  processors:
    - unarchive:
        format: json_array
    - mapping: |-
        if this.eventType == "Microsoft.Storage.BlobCreated" {
          root.name = this.data.url.parse_url().path.trim_prefix("/foocontainer/")
        } else {
          root = deleted()
        }
```