January 2022
Fivetran AWS Ohio Servers
We have added new servers in the AWS Ohio (us-east-2) region.
If you're on a Business Critical plan, you can now select this region in your destination setup form. Connectors configured in a destination run in their designated cloud and region, meaning that your data doesn't leave our region-specific servers during processing. For example, if you configure your connectors to use our servers in Ohio, your data does not leave Ohio during processing.
We now support AWS PrivateLink connections to sources and destinations in the us-east-2 region.
For more information, see our data residency documentation.
Fivetran Azure Australia Servers
We have added new servers in the Azure Australia East (australiaeast) region.
If you're on a Business Critical plan, you can now select this region in your destination setup form. Connectors configured in a destination run in their designated cloud and region, meaning that your data doesn't leave our region-specific servers during processing. For example, if you configure your connectors to use our servers in Australia, your data does not leave Australia during processing.
If you're on an Enterprise or Business Critical plan, this is the default region if you choose Australia as your data processing location and Azure as your cloud provider.
We now support Azure Private Link connections to sources and destinations in the australiaeast region.
For more information, see our data residency documentation.
Transformations for dbt Core
dbt 1.0.0 and 1.0.1 support
We now support dbt 1.0.0 and 1.0.1. You can use these versions to run your projects.
Universal Column Masking
All of our connectors, except Magic Folder connectors, now support Data Blocking and Column Hashing. You can also configure schema change settings for new and existing connectors.
To learn how to use data blocking and hashing, see our Configure Data Blocking and Hashing documentation.
New connectors
Qualtrics
Qualtrics is an online survey tool that allows you to build and distribute surveys, and analyze responses.
Read our Qualtrics connector documentation.
Schema changes
Asana
We now sync a new column, portfolio_id
, and portfolio custom fields to the CUSTOM_FIELD
table.
Coupa
We have added the following new tables:
EASY_FORM_DATA
EASY_FORM_WIDGET_DATA
EASY_FORM_APPROVAL_MAPPING
We have linked the APPROVAL
and EASY_FORM_DATA
tables by adding the easy_form_id
column as a foreign key in the APPROVAL
table.
EASY_FORM_DATA
is a child table of the USER
table. To sync the EASY_FORM_DATA
table, select it on the Schema tab in your Fivetran dashboard and re-sync the USER
table.
Delighted
We have moved the response_person_properties
column from the PERSON
table to the RESPONSE
table.
Fivetran Platform Connector
We have added a new table, USAGE_COST
.
We have added a new column, sync_id
, to the LOG
table.
We have deprecated the CREDITS_USED
table.
GitHub
We have added a new column, stargazers_count
, to the REPOSITORY
table.
We have changed the schema of the REQUESTED_REVIEW_HISTORY
table. We added the requested_reviewer_type
column and changed the requested_id
column.
We now sync the requested_reviewer
and requested_team
as separate requested reviewer types. In the new schema, the requested_id
column's value is the ID from either requested_reviewer
or requested_team
. The requested_reviewer_type
column has either user
or team
as a value, depending on the requested reviewer type. Previously, we synced only requested_reviewer
.
This feature is available for connectors created after February 1, 2022. If you want to enable the feature for connectors created before February 2, 2022, contact our support team.
Greenhouse
We have added a new column, job_post_id
, to the APPLICATION
table.
Jira
We now sync the goal
field of the sprint to the SPRINT
table.
Mailchimp
We have added a new column, status
, to the CAMPAIGN_RECIPIENT
and AUTOMATION_RECIPIENT
tables. The column stores the status of a member:
sent
hard
for a hard bouncesoft
for a soft bounce
We are gradually rolling out this change to all existing connectors.
Microsoft Advertising
We have added a new column, campaign_name
, to the following campaign performance report tables:
CAMPAIGN_PERFORMANCE_HOURLY_REPORT
CAMPAIGN_PERFORMANCE_DAILY_REPORT
CAMPAIGN_IMPRESSION_PERFORMANCE_HOURLY_REPORT
CAMPAIGN_IMPRESSION_PERFORMANCE_DAILY_REPORT
Stripe
We have deprecated the following tables and no longer sync new data to them:
TAX_RATE_INVOICE_MAPPING
TAX_RATE_INVOICE_ITEM_MAPPING
TAX_RATE_SUBSCRIPTION_MAPPING
In May 2021, we renamed these tables but continued syncing to the old tables as well as to the new tables for existing connectors. Now, the data from these tables syncs only to the following renamed tables:
INVOICE_TAX_RATE
INVOICE_ITEM_TAX_RATE
SUBSCRIPTION_TAX_RATE
If your connector was created before May 3, 2021, be sure to update your queries.
If your connector was created after May 3, 2021, you don't need to do anything.
Typeform
We now sync the custom hidden properties of a form response to their own hidden_*
columns in the RESPONSE
table. Previously, we synced these properties to columns without the hidden_
prefix. To update your existing hidden properties data in the destination, re-sync the RESPONSE
table.
Improvements
Amazon DynamoDB
We have added support for AWS PrivateLink connections to Amazon DynamoDB databases. If you're on a Business Critical plan, you can now opt to always connect through a VPC endpoint if your database and fivetran are in the same AWS Region. In the connector setup form, set the Require PrivateLink toggle to ON. For more information, see our setup instructions.
We currently support private connection for the following AWS regions:
- ap-southeast-2
- eu-central-1
- eu-west-1
- eu-west-2
- us-east-1
- us-west-2
Amazon S3
We have added support for AWS PrivateLink connections to S3 buckets. If you're on a Business Critical plan, you can now opt to always connect through a private link if your bucket and destination are in the same AWS Region. In the connector setup form, set the Require PrivateLink toggle to ON. For more information, see our setup instructions.
AppsFlyer
AppsFlyer has changed the retention period for Data Locker events (stored in the AppsFlyer S3 bucket) from 30 days to 14 days. We now retrieve events from the last 14 days. Previously, we retrieved events from the last 30 days.
AWS Lambda
We have added support for AWS PrivateLink connections to AWS Lambda. If you're on a Business Critical plan, you can now opt to always connect using PrivateLink if your AWS Lambda function and destination are in the same AWS Region. For more information, see our AWS Lambda setup guide.
AWS PrivateLink for Snowflake
AWS PrivateLink is now generally available for Snowflake.
For more information, see our Snowflake setup guide.
Azure Blob Storage
We have added support for Azure Private Link connections to Azure Blob Storage. If you're on a Business Critical plan, you can now opt to use Azure Private Link to connect to Fivetran. In the connector setup form, set the Enable Advanced Options toggle to ON, and then select the Connection Method as Connect via Private Link. For more information, see our setup instructions.
Azure SQL Database
For the Azure SQL Database connector, we now support change data capture as an incremental update mechanism. Learn more in our Azure SQL Database documentation.
BigQuery
We now truncate NUMERIC and BIGNUMERIC precision column values above the BigQuery supported limit to the maximum allowed limit. Previously, if we found NUMERIC or BIGNUMERIC values above the BigQuery limit, we converted the values to DOUBLE.
DataType | Precision Limit | Scale Limit |
---|---|---|
NUMERIC | 38 | 9 |
BIGNUMERIC | 76 | 38 |
Facebook Ads
Now, when you set the Sync all metadata toggle to FALSE in the connector setup form, we automatically deselect the corresponding tables on the Schema tab and exclude them from syncs. Previously, we did not deselect the tables on the Schema tab.
Google Ads
You can now configure your Google Ads connector through the Google Ads API. This feature is in Beta.
Google Cloud Storage
You can now opt to use a custom service account to authenticate your Google Cloud Storage bucket. For more information, see our setup instructions. We are gradually rolling out this improvement to all existing connectors.
Sage Intacct
Now, when you delete a record in your source table, we do the following:
- For a parent table, we mark the record as deleted in the destination table. We set the
_fivetran_deleted
column toTRUE
. - For a child table, we don't delete the record from the destination table.
Previously, we permanently deleted the record from the child table in your destination. For more information, see our documentation.
Sailthru
Our Sailthru connector is now generally available.
Read our Sailthru connector documentation.
Shopify Holistic
We have released a pre-built, dbt Core-compatible data model to combine Shopify ecommerce data with data from marketing connectors. The Shopify Holistic model supports combining Shopify data with email and SMS marketing data from Fivetran's Klaviyo data model. Find the model in Fivetran's dbt hub or data models documentation. Learn more about our dbt Core integration in our Transformations for dbt Core documentation*.
* dbt Core is a trademark of dbt Labs, Inc. All rights therein are reserved to dbt Labs, Inc. Fivetran Transformations is not a product or service of or endorsed by dbt Labs, Inc.
SurveyMonkey
Our SurveyMonkey connector is now generally available. Read our SurveyMonkey connector documentation.
The following tables now support history mode for connectors created after January 18, 2022:
SURVEY_PAGE_HISTORY
QUESTION_HISTORY
QUESTION_HEADING_HISTORY
QUESTION_OPTION_HISTORY
SUB_QUESTION_HISTORY
TikTok Ads
Our Tiktok Ads connector is now generally available. Read our TikTok Ads connector documentation.
We have released pre-built, dbt Core-compatible data models for TikTok Ads. Find the models in Fivetran's dbt hub or data models documentation. Learn more about our dbt Core integration in our Transformations for dbt Core documentation*.
* dbt Core is a trademark of dbt Labs, Inc. All rights therein are reserved to dbt Labs, Inc. Fivetran Transformations is not a product or service of or endorsed by dbt Labs, Inc.
Typeform
Our Typeform connector is now generally available.
Read our Typeform connector documentation.
REST API Improvements
New REST API Endpoints to manage role-based access control
We have implemented the following new API endpoints for our REST API:
New resources: Role Management Beta
New endpoints in User Management:
Log events
New sync_id field
We have added the sync_id
field as a common field of the log events.