> For the complete documentation index, see [llms.txt](https://docs.collibra.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.collibra.com/data-quality-self-hosted/release-notes/data-quality-observability-self-hosted-release-archive/release-2023-01.md).

# Release 2023.01

### New Features

#### Admin

* Admin users can now view and modify the DQ license key and license name from the new License page.

#### Platform

* You can now deploy new Helm charts on new and existing releases of Collibra DQ Cloud Native deployments without encountering character size limitations.

#### Reports

* Four new reports are now available by default:
  * The [Missing Jobs Report](/data-quality-self-hosted/core-concepts/reports/missing-jobs-report.md) shows jobs that were expected to run but didn't run as scheduled.
  * The [Hardware Usage Report](/data-quality-self-hosted/core-concepts/reports/hardware-usage-report.md) shows the datasets that required the most total cores to run and more general hardware usage statistics.
  * The [Observability Score Roll-Up Report](/data-quality-self-hosted/core-concepts/reports/observability-score-roll-up-report.md) shows the aggregated scores of all AdaptiveRules (all datasets + all columns) and averages passing and breaking for all columns over 30 days.
  * The [Rules Passing Fraction Roll-Up Report](/data-quality-self-hosted/core-concepts/reports/rules-passing-fraction-roll-up-report.md) shows all the passing rows and total rows scanned for user-defined rules aggregated by dimensions over the past 30 days.

### Enhancements

#### Rules

* The Export LinkIds button is now displayed within the Rules tab of the Findings page. This button was previously only available under the Breaks tab on the Rule Builder page.
  * You can enable LinkIDs from the Scope workflow on the Explorer page to export LinkIds for rule break records.
* The Copy Rules API (/v3/rules/copy) now has the following enhancements:
  * Copied rules now copy to a new dataset correctly regardless of their rule type.
  * Security logs for every rule copy request are now available for admin users to review in the Audit Trail section of the Admin Console.

#### Explorer

* When creating a DQ Job for a table with no rows, the columns are now shown in the Scope section.

#### Platform

* A new property, `LOCAL_REGISTRATION_ENABLED`, in the owl-env.sh script and K8s config map is now available to display or hide the registration link on the Sign in page for local users.
  * For owl-env.sh:
    * The command `export LOCAL_REGISTRATION_ENABLED=true` allows the registration link to display on the Sign in page.

      <div data-gb-custom-block data-tag="hint" data-style="info" class="hint hint-info"><p>Because the registration link is visible by default, this property is also set to true by default.</p></div>
    * The command `export LOCAL_REGISTRATION_ENABLED=false` hides the registration link from the Sign in page.
  * For K8s:
    * The configuration `LOCAL_REGISTRATION_ENABLED:"true"` allows the registration link to display on the Sign in page.

      <div data-gb-custom-block data-tag="hint" data-style="info" class="hint hint-info"><p>Because the registration link is visible by default, this property is also set to true by default.</p></div>
    * The configuration `LOCAL_REGISTRATION_ENABLED:"false"` hides the registration link from the Sign in page.

#### Connections

* SPARK322 and SPARK320 are now shipped with a Spark JDBC connection provider for Standalone deployments.
* When you bring Collibra DQ jars into Databricks, you are now required to set the property `spark.sql.sources.disabledJdbcConnProviderList='basic,oracle,mssql'` at either the Spark Cluster-level or the SparkSession-level before using Collibra DQ's set of functions for Spark profiles 3.2.1 and onwards.

#### Admin

* You can now sort the Date column on the Usage page. Dates now appear in descending order by default.

### Fixes

#### Rules

* Fixed an issue that prevented the descriptions of saved rules from being edited when the rule name contained a greater than symbol after a single quote. (ticket #100114)
* Fixed an issue with rule builder validation that caused a rule syntax exception message to throw. (tickets #99735, 101165)
* Fixed an issue with rules with complex conditions (multiple rlike strings) for Freeform SQL rules that resulted in an exception message. (ticket #100116)

#### DQ Job

* Fixed an issue where behavioral observations made for a dataset did not subtract points from the data quality score. (ticket #98539)

#### Alerts

* Fixed an issue that limited the ability to edit or delete alerts with names containing apostrophes from the UI. (ticket #98864)

#### Outliers

* Fixed an issue where recalibrating an outlier would bulk apply downtrain labeling to it. (ticket #100085)

#### Reports

* Fixed an issue where Completeness Reports were not generated when the Custom Range filter was used. (ticket #99786)

#### DQ Connector

* Fixed an issue with the Collibra DQ - Collibra Platform integration that prevented Rules and Charts from importing. (ticket #104872)

#### Admin

* Fixed an issue with time-based data retention when using linkId that caused too many break records to store in the metastore. (ticket #99072, 102900)

### Known Limitations

#### Rules

* The new Export LinkIds button generates a CSV file limited to viewing only via a spreadsheet program, like Excel.
  * A workaround is to Save/Export the CSV file from the spreadsheet program in order to allow viewing in general text editors.

#### DQ Job

* Remote file jobs with headers containing white spaces fail with a requirement failed exception message.
  * A workaround is to edit the DQ Job command line in the Run CMD tab and place single quotes around the column name in `-q` and double quotes around the entire `-header` flag.

### DQ Security Metrics

![Critical vulnerabilities over 5 months](https://4121921244-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWCrP7Albs8DfJjIQxUxw%2Fuploads%2Fgit-blob-8b6cc447e4c1cabc6d0f5236fe060f3a0dfed8bf%2Fvulns-over-time-2023-01.png?alt=media)

![Critical security vulnerabilities over 5 months](https://4121921244-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FWCrP7Albs8DfJjIQxUxw%2Fuploads%2Fgit-blob-17ea18556c7a213365a66ad0af3ac8f9ca652548%2Fcritical-table-2023-01.png?alt=media)

### Hotfixes

#### Data Quality & Observability (self-hosted) 2023.01.1

* Fixed an issue with Databricks cluster connections to allow `PWD={}` input in the connection string URL. (ticket #104845)
  * You are still required to enter `PWD={your-text-here}` in the URL.
  * This fix only applies to Databricks cluster connections, not to Databricks connections that use SQL-endpoints.
