Can I use Snowflake's Dynamic Data Masking Feature With Fivetran?
Question
I want to mask personally identifiable information (PII) but also see the original values, so I can't use Fivetran's native column hashing feature. Can I use Snowflake's Dynamic Data Masking feature with Fivetran?
Environment
Destination: Snowflake
Answer
You can utilize Snowflake's Dynamic Data Masking policies only if the policies don't mask primary key columns. When we write data to most of our supported destinations, we execute a merge strategy based on primary key matches we detect. If you mask primary key columns in the target table, we may be unable to identify rows that need updating. As a result, we may assume the rows don't exist and insert non-matched rows, thus creating duplicates.
If you can define the primary key in the source, ensure you select columns that don't contain PII. You can't use Snowflake's Dynamic Data Masking feature if a table contains PII and you can't define the primary key. For example, tables managed by a third party.
You can use Snowflake's Dynamic Data Masking feature for non-primary key columns without issues.