> For the complete documentation index, see [llms.txt](https://docs.collibra.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.collibra.com/data-quality-self-hosted/core-concepts/explorer/create-a-dq-job.md).

# Create a DQ job

This page provides an overview of the steps involved in the creation of a DQ job. Select from one of the options below depending on whether you are using Pullup or Pushdown mode.

{% tabs %}
{% tab title="Pullup" %}

## Create a Pullup job

| Step         | Action                                                                                                                   | Description                                                                                                                                                                                                                                                                                                                                                                           |
| ------------ | ------------------------------------------------------------------------------------------------------------------------ | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| 1            | [Select a data source](/data-quality-self-hosted/core-concepts/explorer/create-a-dq-job/connect-to-a-data-source.md)     | Your data source is where your table, file, or view upon which your DQ job runs exists.                                                                                                                                                                                                                                                                                               |
| 2            | [Select a scanning method](/data-quality-self-hosted/core-concepts/explorer/create-a-dq-job/select-a-scanning-method.md) | Determine whether to scan part of your table, file, or view, a sample of it, or its entirety.                                                                                                                                                                                                                                                                                         |
| 3            | [Select your columns](/data-quality-self-hosted/core-concepts/explorer/create-a-dq-job/select-columns.md)                | <p>Select the columns to include in your DQ job. Optionally assign Key columns and Link IDs. Link IDs are required for archiving <a href="/data-quality-self-hosted/core-concepts/findings/break-records-and-link-ids.md">break records</a>.</p><div data-gb-custom-block data-tag="hint" data-style="info" class="hint hint-info"><p>This step is optional for Full Scans.</p></div> |
| 4            | [Select your rows](/data-quality-self-hosted/core-concepts/explorer/create-a-dq-job/select-rows.md)                      | <p>Apply filters and limits to your rows for enhanced scanning.</p><div data-gb-custom-block data-tag="hint" data-style="info" class="hint hint-info"><p>This step is optional for Full Scans.</p></div>                                                                                                                                                                              |
| 5            | [Add transforms](/data-quality-self-hosted/core-concepts/explorer/create-a-dq-job/transform.md)                          | Modify or create new columns to meet specific formatting requirements at the Spark level.                                                                                                                                                                                                                                                                                             |
| 6            | [Create a mapping](/data-quality-self-hosted/core-concepts/explorer/create-a-dq-job/mapping.md)                          | Validate and link source and target column relationships between two data sources.                                                                                                                                                                                                                                                                                                    |
| 7            | [Add DQ layers](/data-quality-self-hosted/core-concepts/explorer/create-a-dq-job/add-layers.md)                          | Customize your DQ job to gain more insights into the health of your data.                                                                                                                                                                                                                                                                                                             |
| 8            | [Review the job sizing](/data-quality-self-hosted/core-concepts/explorer/create-a-dq-job/sizing.md)                      | Review and modify details about your agent resources.                                                                                                                                                                                                                                                                                                                                 |
| 9            | [Review your DQ job](/data-quality-self-hosted/core-concepts/explorer/create-a-dq-job/review.md)                         | Review your query before you submit your DQ job.                                                                                                                                                                                                                                                                                                                                      |
| 10           | [Run your DQ job](/data-quality-self-hosted/core-concepts/explorer/create-a-dq-job/run-your-dq-job.md)                   | Submit your DQ job for processing.                                                                                                                                                                                                                                                                                                                                                    |
| {% endtab %} |                                                                                                                          |                                                                                                                                                                                                                                                                                                                                                                                       |

{% tab title="Pushdown" %}

## Create a Pushdown job

| Step          | Action                                                                                                                   | Description                                                                                                                                                                                                                                                                                                                                                                           |
| ------------- | ------------------------------------------------------------------------------------------------------------------------ | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| 1             | [Select a data source](/data-quality-self-hosted/core-concepts/explorer/create-a-dq-job/connect-to-a-data-source.md)     | Your data source is where your table, file, or view upon which your DQ job runs exists.                                                                                                                                                                                                                                                                                               |
| 2             | [Select a scanning method](/data-quality-self-hosted/core-concepts/explorer/create-a-dq-job/select-a-scanning-method.md) | Determine whether to scan part of your table, file, or view, a sample of it, or its entirety.                                                                                                                                                                                                                                                                                         |
| 3             | [Select your columns](/data-quality-self-hosted/core-concepts/explorer/create-a-dq-job/select-columns.md)                | <p>Select the columns to include in your DQ job. Optionally assign Key columns and Link IDs. Link IDs are required for archiving <a href="/data-quality-self-hosted/core-concepts/findings/break-records-and-link-ids.md">break records</a>.</p><div data-gb-custom-block data-tag="hint" data-style="info" class="hint hint-info"><p>This step is optional for Full Scans.</p></div> |
| 4             | [Select your rows](/data-quality-self-hosted/core-concepts/explorer/create-a-dq-job/select-rows.md)                      | <p>Apply filters and limits to your rows for enhanced scanning.</p><div data-gb-custom-block data-tag="hint" data-style="info" class="hint hint-info"><p>This step is optional for Full Scans.</p></div>                                                                                                                                                                              |
| 5             | [Add DQ layers](/data-quality-self-hosted/core-concepts/explorer/create-a-dq-job/add-layers.md)                          | Customize your DQ job to gain more insights into the health of your data.                                                                                                                                                                                                                                                                                                             |
| 6             | [Review your DQ job](/data-quality-self-hosted/core-concepts/explorer/create-a-dq-job/review.md)                         | Review your query before you submit your DQ job.                                                                                                                                                                                                                                                                                                                                      |
| 7             | [Run your DQ job](/data-quality-self-hosted/core-concepts/explorer/create-a-dq-job/run-your-dq-job.md)                   | Submit your DQ job for processing.                                                                                                                                                                                                                                                                                                                                                    |
| {% endtab %}  |                                                                                                                          |                                                                                                                                                                                                                                                                                                                                                                                       |
| {% endtabs %} |                                                                                                                          |                                                                                                                                                                                                                                                                                                                                                                                       |