Capabilities for Databricks Unity Catalog
This section lists the Capabilities of Fivetran HVR when using 'Databricks Unity Catalog'. For more information about the pre-requisites, access privileges, and other configuration requirements, see Databricks Requirements.
Capture
HVR does not support Capture changes from location on Databricks Unity Catalog.
Repository Database
HVR does not support Repository database on Databricks Unity Catalog.
Integrate
HVR supports the following capabilities on Databricks Unity Catalog:
- Integrate changes into location (Databricks Unity Catalog from version 9.0 to version 15.0).
- Burst integration (Integrate with parameter Method=BURST) (Databricks Unity Catalog from version 9.0 to version 15.0).
- Append integration into TimeKey (Integrate with parameter Method=APPEND) (Databricks Unity Catalog from version 9.0 to version 15.0).
- Integrate with parameter BurstCommitFrequency (Databricks Unity Catalog from version 9.0 to version 15.0).
- Continuous integration (Integrate with parameter Method=CONTINUOUS) (Databricks Unity Catalog from version 9.0 to version 15.0).
- ColumnProperties with parameter SoftDelete (Databricks Unity Catalog from version 9.0 to version 15.0).
- Bulk load requires a staging area (location property Staging_Directory) (Databricks Unity Catalog from version 9.0 to version 15.0).
- Creation and update of HVR state tables (Databricks Unity Catalog from version 9.0 to version 15.0).
HVR does not support the following capabilities on Databricks Unity Catalog:
- Tables without a key and without TableProperties with NoDuplicateRows for continuous integration.
- Continuous integrate with parameter OnErrorSaveFailed.
- Disable/enable database triggers during integrate (with parameter NoTriggerFiring).
- Integrate with parameter DbProc.
Bi-directional Replication
HVR does not support Bi-directional Replication on Databricks Unity Catalog.
Refresh and Compare
HVR supports the following capabilities on Databricks Unity Catalog:
- hvrrefresh or hvrcompare from source location (Databricks Unity Catalog from version 9.0 to version 15.0).
- hvrrefresh into target location (Databricks Unity Catalog from version 9.0 to version 15.0).
- Isolated table hvrrefresh (option -i) into target location (Databricks Unity Catalog from version 9.0 to version 15.0).
- Row-wise hvrrefresh into target location (option -g) (Databricks Unity Catalog from version 9.0 to version 15.0).
Other Capabilities
HVR supports the following capabilities on Databricks Unity Catalog:
- International table and column names where DBMS is not configured with UTF-8 encoding (Databricks Unity Catalog from version 9.0 to version 15.0).
- Always treat DBMS table names and column names as case sensitive, even if not configured (equivalent to location property Case_Sensitive_Names always set to TRUE) (Databricks Unity Catalog from version 9.0 to version 15.0).
- Always treat DBMS schema names case sensitive (Databricks Unity Catalog from version 9.0 to version 15.0).
HVR does not support the following capabilities on Databricks Unity Catalog:
- Use distribution key for parallelizing changes within a table (ColumnProperties with parameter DistributionKey).
- Lossless binary float datatypes. No data loss when transporting float values (because base 2 fractions are never converted to base 10). The values for these datatypes, when selected back from the database, might be slightly different from the ones that were inserted. This leads to Compare differences..