> For the complete documentation index, see [llms.txt](https://docs.collibra.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.collibra.com/data-quality-self-hosted/release-notes/data-quality-observability-self-hosted-release-archive/release-2025-02.md).

# Release 2025.02

* [Announcement](#announcement)
* [Enhancements](#enhancements)
* [Fixes](#fixes)

## Release Information

* Release date of Data Quality & Observability (self-hosted) 2025.02: February 24, 2025
* Release notes publication date: January 20, 2025

## Announcement

{% hint style="warning" %}
As a security measure, we are announcing the end of life of the Java 8 and 11 versions of Data Quality & Observability (self-hosted), effective in the August 2025 (2025.08) release.**In this release (2025.02) and the March (2025.03) release**, Data Quality & Observability (self-hosted) is only available on Java 17 and Spark 3.5.3. Depending on your installation of Data Quality & Observability (self-hosted), you can expect the following in this release:

* **Kubernetes installations** 
  * Kubernetes containers automatically contain Java 17 and Spark 3.5.3.
  * If you use custom drivers, ensure they are compatible with Java 17 and Spark 3.5.3.
  * If you use file-based SAML authentication with the `SAML_METADATA_USE_URL` variable set to `false` in the owl-web ConfigMap, update the Meta-Data URL option on the SAML Security Settings page with your metadata file. Use the **file:/opt/owl/config/idp-metadata.xml** format, ensuring the file name begins with the prefix **file:**. For steps on how to configure this, go to the "Enable the SAML SSO sign in option" section in [Configuring SAML authentication](/data-quality-self-hosted/security-configuration/saml-authentication/configuring-saml-authentication.md).
* **Standalone installations**
  * You must [upgrade to Java 17](https://support.collibra.com/hc/en-us/articles/29404286691991-Upgrading-Java-on-CentOS-RHEL-7-8-or-9) and [Spark 3.5.3](/data-quality-self-hosted/installation/agent/upgrade-spark.md) to install Data Quality & Observability (self-hosted) 2025.02.
  * If you use custom drivers, ensure they are compatible with Java 17 and Spark 3.5.3.
  * Follow the latest [steps to upgrade](/data-quality-self-hosted/installation/upgrade-data-quality-observability-self-hosted/upgrade-collibra-data-quality-observability.md) to Data Quality & Observability (self-hosted) 2025.02 with Java 17.
  * If you use file-based SAML authentication with the `SAML_METADATA_USE_URL` variable set to `false` in the owl-env.sh script, update the Meta-Data URL option on the SAML Security Settings page with your metadata file. Use the **file:/opt/owl/config/idp-metadata.xml** format, ensuring the file name begins with the prefix **file:**. For steps on how to configure this, go to the "Enable the SAML SSO sign in option" section in [Configuring SAML authentication](/data-quality-self-hosted/security-configuration/saml-authentication/configuring-saml-authentication.md).
  * We encourage you to migrate to a Kubernetes installation to improve the scalability and ease of future maintenance.

The April 2025 (2025.04) release will contain Java 8, 11, and 17 versions of Data Quality & Observability (self-hosted). This will be the final release to contain Java 8 and 11 builds and Spark versions older than 3.5.3, and will include feature enhancements and bug fixes from the 2025.02 release and critical bug fixes from the 2025.03 and 2025.04 releases. Between 2025.05 and 2025.07, only critical and high-priority bug fixes will be made for Java 8 and 11 versions of Data Quality & Observability (self-hosted). For a breakdown of Java and Spark availability in current and upcoming releases, click "See what is changing" below.

<details>

<summary>See what is changing</summary>

| Data Quality & Observability (self-hosted) version | Java 11                                                                                                                                                                                                                                           | Java 17                                                                                                                                                                                                                                           | Java 21                                                                                                                                                                                                                                         | Spark versions | Additional notes                                                                                      |
| -------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | -------------- | ----------------------------------------------------------------------------------------------------- |
| 2025.08                                            | <img src="https://4121921244-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWCrP7Albs8DfJjIQxUxw%2Fuploads%2Fgit-blob-de45f34193ae06a2b093c2dfb8fb80cfda945166%2Fclose-large%402x.png?alt=media" alt="" data-size="line"> No | <img src="https://4121921244-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWCrP7Albs8DfJjIQxUxw%2Fuploads%2Fgit-blob-d06dd40622fc7d030e21f7c0303a90eb28d229fc%2Fok-large%402x.png?alt=media" alt="" data-size="line"> Yes   | <img src="https://4121921244-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWCrP7Albs8DfJjIQxUxw%2Fuploads%2Fgit-blob-d06dd40622fc7d030e21f7c0303a90eb28d229fc%2Fok-large%402x.png?alt=media" alt="" data-size="line"> Yes | 3.5.6 only     | Fixes for Java 8 and 11 build profiles will be available only for critical and high-priority defects. |
| 2025.09 through 2026.01                            | <img src="https://4121921244-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWCrP7Albs8DfJjIQxUxw%2Fuploads%2Fgit-blob-de45f34193ae06a2b093c2dfb8fb80cfda945166%2Fclose-large%402x.png?alt=media" alt="" data-size="line"> No | <img src="https://4121921244-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWCrP7Albs8DfJjIQxUxw%2Fuploads%2Fgit-blob-d06dd40622fc7d030e21f7c0303a90eb28d229fc%2Fok-large%402x.png?alt=media" alt="" data-size="line"> Yes   | <img src="https://4121921244-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWCrP7Albs8DfJjIQxUxw%2Fuploads%2Fgit-blob-d06dd40622fc7d030e21f7c0303a90eb28d229fc%2Fok-large%402x.png?alt=media" alt="" data-size="line"> Yes | 3.5.6 only     |                                                                                                       |
| 2026.02 through 2026.06                            | <img src="https://4121921244-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWCrP7Albs8DfJjIQxUxw%2Fuploads%2Fgit-blob-de45f34193ae06a2b093c2dfb8fb80cfda945166%2Fclose-large%402x.png?alt=media" alt="" data-size="line"> No | <img src="https://4121921244-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWCrP7Albs8DfJjIQxUxw%2Fuploads%2Fgit-blob-d06dd40622fc7d030e21f7c0303a90eb28d229fc%2Fok-large%402x.png?alt=media" alt="" data-size="line"> Yes   | <img src="https://4121921244-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWCrP7Albs8DfJjIQxUxw%2Fuploads%2Fgit-blob-d06dd40622fc7d030e21f7c0303a90eb28d229fc%2Fok-large%402x.png?alt=media" alt="" data-size="line"> Yes | 4.1.0 only     |                                                                                                       |
| 2026.07 and newer                                  | <img src="https://4121921244-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWCrP7Albs8DfJjIQxUxw%2Fuploads%2Fgit-blob-de45f34193ae06a2b093c2dfb8fb80cfda945166%2Fclose-large%402x.png?alt=media" alt="" data-size="line"> No | <img src="https://4121921244-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWCrP7Albs8DfJjIQxUxw%2Fuploads%2Fgit-blob-de45f34193ae06a2b093c2dfb8fb80cfda945166%2Fclose-large%402x.png?alt=media" alt="" data-size="line"> No | <img src="https://4121921244-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWCrP7Albs8DfJjIQxUxw%2Fuploads%2Fgit-blob-d06dd40622fc7d030e21f7c0303a90eb28d229fc%2Fok-large%402x.png?alt=media" alt="" data-size="line"> Yes | 4.1.0 only     |                                                                                                       |

</details>

&#x20;For more information, go to the [Data Quality & Observability (self-hosted) Java Upgrade FAQ](https://support.collibra.com/hc/en-us/articles/27421373124503-Collibra-Data-Quality-Observability-Java-upgrade-FAQ).
{% endhint %}

## Enhancements

### Platform

* When an externally managed user enables assignment alert notifications and enters an email address on their user profile, findings assigned to that email address now receive alert notifications.
* **SAML\_ENTITY\_BASEURL** is now a required property for SAML authentication.
* To improve the security of our application, we upgraded SAML. As part of the upgrade, the following [Configuring SAML authentication](/data-quality-self-hosted/security-configuration/saml-authentication/configuring-saml-authentication.md) are no longer used:
  * **SAML\_TENANT\_PROP\_FROM\_URL\_ALIAS**
  * **SAML\_METADATA\_USE\_URL**
  * **SAML\_METADATA\_TRUST\_CHECK**
  * **SAML\_INCLUDE\_DISCOVERY\_EXTENSION**
  * **SAML\_SUB\_DOMAIN\_REPLACE\_SOURCE**
  * **SAML\_SUB\_DOMAIN\_REPLACE\_TARGET**
  * **SAML\_MAX\_AUTH\_AGE**

    <div data-gb-custom-block data-tag="hint" data-style="info" class="hint hint-info"><p>If the <strong>SAML_LB_EXISTS</strong> property is set to <strong>true</strong> and <strong>SAML_LB_INCLUDE_PORT_IN_REQUEST</strong> set to <strong>false</strong>, you may need to update <strong>SAML_ENTITY_BASEURL</strong> to include the port in the URL. The <strong>SAML_ENTITY_BASEURL</strong> should match the IdP's ACS URL.Additionally, we recommend using the Collibra DQ UI when signing in with SAML, as SP-initiated sign-on is not fully supported in Collibra DQ.</p></div>

    <div data-gb-custom-block data-tag="hint" data-style="success" class="hint hint-success"><p>We recommend synchronizing the clocks of the Identity Provider (IdP) and Service Provider (Collibra DQ) using Network Time Protocol (NTP) to prevent authentication failures caused by significant clock skew.</p></div>

### Connections

* You can now [limit the schemas](/data-quality-self-hosted/admin-configuration/admin-console/connections/limiting-schemas.md) that are displayed in a JDBC connection in Explorer. This enhancement helps you manage usage and maintain security by restricting access to only the necessary schemas. (idea #CDQ-I-152)

  <div data-gb-custom-block data-tag="hint" data-style="info" class="hint hint-info"><p>When you include a restricted schema in the query of a DQ Job, the query scope may be overwritten when the job runs. While only the schemas you selected when you set up the connection are shown in the Explorer menu, users are not restricted from running SQL queries on any schema from the data source.</p></div>
* [Hive connections](/data-quality-self-hosted/connections/supported-connections/supported-jdbc-data-sources/connecting-to-hive.md) now use the driver class name, `com.cloudera.hive.jdbc.HS2Driver`. Additionally, only Hive versions 2.6.25 and newer are supported.

  <div data-gb-custom-block data-tag="hint" data-style="danger" class="hint hint-danger"><p>If you have a Standalone installation of Data Quality &#x26; Observability (self-hosted) and leverage Hive connections, you must upgrade to the latest 2.6.25 Hive driver to use Data Quality &#x26; Observability (self-hosted) 2025.02.</p></div>

### Jobs

* DQ Jobs on Trino Pushdown connections now allow you to select multiple link ID columns when setting up the dupes monitor.

### Rules

* We are delighted to announce that [rule filtering](/data-quality-self-hosted/core-concepts/dq-rules/rule-builder/working-with-the-rule-workbench/filter-a-data-quality-rule.md) is now generally available. To use rule filtering, an admin needs to set RULE\_FILTER to TRUE in the Application Configuration.
* We are also pleased to announce that [rule tolerance](/data-quality-self-hosted/core-concepts/dq-rules/rule-builder/working-with-the-rule-workbench/apply-a-tolerance-threshold-to-a-data-quality-rule.md) is generally available. However, the RULE\_TOLERANCE\_BETA setting must remain set to TRUE in the Application Configuration until the 2025.04 version.
* You can now define a DQ Dimension when you create a new template or edit an existing one to be applied to all new custom rules created using this template. Additionally, a Dimension column is now shown on the Templates page.
* There is now a dedicated break\_msg column in the rule\_output Metastore table, which shows the break message when a rule break occurs.

### Dataset Manager

* You can now add meta tags up to 100 characters long from the Edit option under the Actions menu on the Dataset Manager. (idea #CDQ-I-74)

## Fixes

### Platform

* We have improved the security of our application.
* To improve the security of our application, Data Quality & Observability (self-hosted) now supports a Content Security Policy (CSP).

### Jobs

* When a scheduled job runs, only the time it is scheduled to run displays in the Scheduled Time column on the Jobs page.
* When you edit and re-run a DQ Job with a source-to-target mapping of data from two different data sources, the `-srcds` parameter on the command line now correctly contains the `src_` prefix before the source dataset, and the DQ Job re-runs successfully.
* When you include a custom column via the source query of a source-to-target mapping, the validate overlay function no longer fails with an error message.
* When you clone a dataset from Dataset Manager, Explorer, or the Job tab on Findings, the Job Name field and the Command Line in the Review step of Explorer now correctly reflect the "temp\_cloned\_dataset" naming convention for cloned datasets.
* DQ Jobs with the same run date can no longer run concurrently.
* Pullup DQ Jobs with names that include dashes, such as "sample-dataset," no longer remain stalled in the "staged" activity when you rerun them.
* The correlation and histogram activities no longer cause DQ Jobs on Databricks Pushdown connections to fail sporadically.
* The correlation activity now displays correctly in the UI and no longer causes DQ Jobs on Pushdown connections to fail.

### Rules

* When you use Freeform SQL queries with `LIKE %` conditions, for example, `SELECT * FROM @public.test where testtext LIKE '%a, c%'`, they now return the expected results.
* SQL Server job queries where the table name is escaped with brackets, for example, `select * from dbo.[Table]`, now process correctly when the job runs.
* The Rule Results Preview button is no longer disabled when the API call to gather the Livy status fails due to an invalid or non-existent session. The API call now correctly manages the cache for Livy sessions terminated due to idle timeout.
* The contents of the Export Rules with Details now include data from the new Tolerance rule setting.
* Data type rules now evaluate the contents of each column, not just the data type of each column to ensure the correct breaks are returned.
* SQL reserved keywords included in string parsing are now correctly preserved in their original case.
* When you update the name of a rule and an alert is configured on it, the alert will now show the updated name when sent.

### Alerts

* When you set a breaking rule as passing, a rule status alert for rules with breaking statuses no longer sends erroneous error messages for that rule.

### Connections

* When you substitute a PWD value as a sensitive variable on the Variables tab of a Databricks connection template, the sensitive variable in the connection URL is now set correctly for source-to-target mappings where Databricks is the source dataset.

### APIs

* The **/v3/jobs/\<jobId>/breaks/rules** endpoint no longer returns a 500 error when using a valid jobId. Instead, it now returns empty files when no results are found for exports without findings.
* When you schedule a Job to run monthly or quarterly, the `jobSchedule` object in the **/v3/datasetDefs** endpoint now reflects your selection.
* When you run the **/v3/rules/{dataset}/{ruleName}/{runId}/breaks** endpoint when Archive Rules Break Records is enabled, break records are now retrieved from the source system instead of the Metastore.
* Meta tags are now correctly applied to new datasets that are created with the **/v3/datasetDefs** endpoint.
* When an integration import job fails, the **/v3/dgc/integrations/jobs** endpoint now returns the correct “failed” status. Additionally, the integration job status “ignored” is now available.

### Integration

* An invalid RunID no longer returns a successful response when using a Pushdown dataset with the **/v3/jobs/run** endpoint.