> For the complete documentation index, see [llms.txt](https://docs.collibra.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.collibra.com/data-quality-self-hosted/connections/supported-connections/supported-remote-files/connecting-to-azure-blob-storage.md).

# Connecting to Azure Blob Storage

This section contains an overview of Azure Blob Storage.

## General information

<table><thead><tr><th width="152">Field</th><th>Description</th></tr></thead><tbody><tr><td>Data source</td><td>Azure Blob Storage</td></tr><tr><td>Supported versions</td><td>N/A</td></tr><tr><td>Connection string</td><td><code>wasbs://</code></td></tr><tr><td>Packaged?</td><td><img src="https://4121921244-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWCrP7Albs8DfJjIQxUxw%2Fuploads%2Fgit-blob-d06dd40622fc7d030e21f7c0303a90eb28d229fc%2Fok-large%402x.png?alt=media" alt="" data-size="line"> Yes</td></tr><tr><td>Certified?</td><td><img src="https://4121921244-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWCrP7Albs8DfJjIQxUxw%2Fuploads%2Fgit-blob-d06dd40622fc7d030e21f7c0303a90eb28d229fc%2Fok-large%402x.png?alt=media" alt="" data-size="line"> Yes</td></tr><tr><td colspan="2">Supported features</td></tr><tr><td>Analyze data</td><td><img src="https://4121921244-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWCrP7Albs8DfJjIQxUxw%2Fuploads%2Fgit-blob-d06dd40622fc7d030e21f7c0303a90eb28d229fc%2Fok-large%402x.png?alt=media" alt="" data-size="line"> Yes</td></tr><tr><td>Archive breaking records</td><td><img src="https://4121921244-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWCrP7Albs8DfJjIQxUxw%2Fuploads%2Fgit-blob-d06dd40622fc7d030e21f7c0303a90eb28d229fc%2Fok-large%402x.png?alt=media" alt="" data-size="line"> Yes</td></tr><tr><td>Estimate job</td><td><img src="https://4121921244-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWCrP7Albs8DfJjIQxUxw%2Fuploads%2Fgit-blob-d06dd40622fc7d030e21f7c0303a90eb28d229fc%2Fok-large%402x.png?alt=media" alt="" data-size="line"> Yes</td></tr><tr><td>Pushdown</td><td><img src="https://4121921244-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWCrP7Albs8DfJjIQxUxw%2Fuploads%2Fgit-blob-de45f34193ae06a2b093c2dfb8fb80cfda945166%2Fclose-large%402x.png?alt=media" alt="" data-size="line"> No</td></tr><tr><td colspan="2">Processing capabilities</td></tr><tr><td>Spark agent</td><td><img src="https://4121921244-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWCrP7Albs8DfJjIQxUxw%2Fuploads%2Fgit-blob-d06dd40622fc7d030e21f7c0303a90eb28d229fc%2Fok-large%402x.png?alt=media" alt="" data-size="line"> Yes</td></tr><tr><td>Yarn agent</td><td><img src="https://4121921244-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWCrP7Albs8DfJjIQxUxw%2Fuploads%2Fgit-blob-d06dd40622fc7d030e21f7c0303a90eb28d229fc%2Fok-large%402x.png?alt=media" alt="" data-size="line"> Yes</td></tr></tbody></table>

## Minimum user permissions

In order for Collibra DQ to access your Azure Blob Storage containers, you need the following user permissions:

* ROLE\_ADMIN in Collibra DQ.
* Read access on your Blob Storage containers to create a basic Azure Blob connection.
* Read and write access to the Blob Storage containers where breaking records are archived from Collibra DQ. This is only necessary if you use the archive breaking records feature.

## Recommended and required connection properties

<table><thead><tr><th>Required</th><th>Connection Property</th><th>Type</th><th>Value</th></tr></thead><tbody><tr><td><img src="https://4121921244-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWCrP7Albs8DfJjIQxUxw%2Fuploads%2Fgit-blob-d06dd40622fc7d030e21f7c0303a90eb28d229fc%2Fok-large%402x.png?alt=media" alt="" data-size="line"> Yes</td><td>Name</td><td>Text</td><td>The unique name used for your connection.</td></tr><tr><td><img src="https://4121921244-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWCrP7Albs8DfJjIQxUxw%2Fuploads%2Fgit-blob-d06dd40622fc7d030e21f7c0303a90eb28d229fc%2Fok-large%402x.png?alt=media" alt="" data-size="line"> Yes</td><td>Connection URL</td><td>String</td><td><p>The connection string value of your ADLS connection. The URL should contain <code>blob.core.windows.net</code>. Customized URLs are not supported.</p><pre><code>wasbs://&#x3C;container>@&#x3C;account name>.blob.core.windows.net
</code></pre><div data-gb-custom-block data-tag="hint" data-style="success" class="hint hint-success"><p>See the <a href="#connection-url-elements">Connection URL elements</a> section for more information on the syntax.</p></div></td></tr><tr><td><img src="https://4121921244-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWCrP7Albs8DfJjIQxUxw%2Fuploads%2Fgit-blob-de45f34193ae06a2b093c2dfb8fb80cfda945166%2Fclose-large%402x.png?alt=media" alt="" data-size="line"> No</td><td>Target Agent</td><td>Text</td><td>The <a href="/data-quality-self-hosted/installation/agent.md">Agent</a> used to submit your DQ Job.</td></tr><tr><td><img src="https://4121921244-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWCrP7Albs8DfJjIQxUxw%2Fuploads%2Fgit-blob-d06dd40622fc7d030e21f7c0303a90eb28d229fc%2Fok-large%402x.png?alt=media" alt="" data-size="line"> Yes</td><td>Auth Type</td><td>Option</td><td><p>The method to authenticate your connection.</p><div data-gb-custom-block data-tag="hint" data-style="info" class="hint hint-info"><p>The configuration requirements are different depending on the Auth Type you select. See <a href="#authentication">Authentication</a> for more details on available authentication types.</p></div></td></tr><tr><td><img src="https://4121921244-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWCrP7Albs8DfJjIQxUxw%2Fuploads%2Fgit-blob-de45f34193ae06a2b093c2dfb8fb80cfda945166%2Fclose-large%402x.png?alt=media" alt="" data-size="line"> No</td><td>Archive Breaking Records Location</td><td>Option</td><td>When you select this option and have <a href="/data-quality-self-hosted/core-concepts/findings/break-records-and-link-ids/archiving-break-records-from-pullup-jobs.md">followed the steps</a>, you can export CSV files to the Azure Blob location.</td></tr><tr><td><img src="https://4121921244-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWCrP7Albs8DfJjIQxUxw%2Fuploads%2Fgit-blob-de45f34193ae06a2b093c2dfb8fb80cfda945166%2Fclose-large%402x.png?alt=media" alt="" data-size="line"> No</td><td>Driver Properties</td><td>String</td><td>The configurable driver properties for your connection. Multiple properties must be semicolon-delimited, and each property=value pair, including the last one, must end with a semicolon (;). <code>abc=123;test=true;</code></td></tr></tbody></table>

## Connection URL elements

<table><thead><tr><th width="152">Field</th><th>Description</th></tr></thead><tbody><tr><td>File scheme</td><td>The <code>wasbs</code> protocol is used as the scheme identifier.</td></tr><tr><td>Container</td><td>The parent location that holds the files and folders. This is the same as file system in the Azure Data Lake Storage service.</td></tr><tr><td>Account name</td><td>The name given to your storage account during creation.</td></tr><tr><td>Path</td><td>A forward slash delimited <code>/</code> representation of the directory structure.</td></tr><tr><td>File name</td><td>The name of the individual file. This parameter is optional when you address a directory.</td></tr></tbody></table>

## Authentication

Select an authentication type from the dropdown menu. The options available in the dropdown menu are the currently supported authentication types for this data source.

{% tabs %}
{% tab title="Key" %}

<table><thead><tr><th width="152">Field</th><th>Description</th></tr></thead><tbody><tr><td>Storage Account</td><td>The Azure Storage account name.</td></tr><tr><td>Key</td><td>The authentication key for the storage account.</td></tr></tbody></table>
{% endtab %}

{% tab title="SAS" %}

<table><thead><tr><th width="152">Field</th><th>Description</th></tr></thead><tbody><tr><td>Storage Account</td><td>The Azure Storage account name.</td></tr><tr><td>Shared Access Signature</td><td>The string value of the Azure Blob shared access signature.</td></tr></tbody></table>
{% endtab %}
{% endtabs %}

## Configure private endpoints for key-based authentication

{% stepper %}
{% step %}
Fill out the required fields on the Details tab.
{% endstep %}

{% step %}
Select **Key** from the Authentication type dropdown menu, then fill out the **Storage Account** and **Key** fields.
{% endstep %}

{% step %}
In the Driver Properties field on the Properties tab, add **cloud.endpoint=\<endpoint>** to enable the Azure Blob private endpoint for key-based authentication.

{% hint style="info" %}
The **\<endpoint>** value can be any Microsoft cloud endpoint. Depending on the location, Azure uses **\*.windows.net** and **\*.chinacloudapi.cn**, and Microsoft Entra ID uses **<https://login.microsoftonline.com>** and **<https://login.chinacloudapi.cn>**. For more information, go to the official [Microsoft documentation](https://learn.microsoft.com/en-us/azure/china/concepts-service-availability#azure-in-china-rest-endpoints).
{% endhint %}

{% tabs %}
{% tab title="Example" icon="glasses-round" %}
To use the **usgovcloudapi.net** endpoint, add **cloud.endpoint=usgovcloudapi.net**.
{% endtab %}
{% endtabs %}
{% endstep %}

{% step %}
Click **Submit**.
{% endstep %}
{% endstepper %}

## Known limitations

* There is a limitation with Azure Blob connections where a missing folder error occurs when you try to load files from Explorer.
  * A possible one-time workaround is to create the /opt/owl/previewcache folder before you load files from your Azure Blob connection.