September 2021

Dashboard Improvements

Connector list auto-refresh

Now, we update the connector list every 5 minutes when you open it in a browser tab and leave the tab inactive. We now also display the last updated datetime of the connector list.

Destination cleanup

Now, you can update the previously synced data when you made a change to a column.

If you un-hash or un-block any columns, we offer to start a table re-sync.

Unblocked columns:

Unhashed columns:

If you hash a column, you can select to either set the existing values of the relevant column in the destination to NULL, or to re-sync the relevant table to re-populate the column with hashed values.

Hashed columns:

If you block a column, you can choose to either set its existing values to NULL, or drop the relevant column in the destination.

Blocked columns:

Improved alert management

We have redesigned the Alerts page in the Fivetran dashboard to make it easier for you to quickly identify and resolve problems in Fivetran.

Learn more about alerts in our Alerts documentation.

Fivetran Business Critical

PrivateLink for Destinations

You can now use PrivateLink as a connection method for the following destinations:

• Redshift
• Snowflake

This feature is in BETA and available only for Business Critical accounts.

Transformations for dbt Core

dbt 0.20.2 support

We now support dbt 0.20.2. You can use this version to run your projects.

Schema changes

Facebook Ads

We no longer support the is_in_middle_of_local_entity_migration field for Ad accounts (ACCOUNT_HISTORY table) because it has been deprecated.

We have added a new metadata table, CUSTOM_CONVERSIONS_HISTORY, to store custom conversions names.

We have added a new table TARGETING_OPTIMIZATION_TYPES with the following fields:

• index
• ad_set_id
• ad_set_updated_time
• key
• value

Height

We have added the following new fields to the TASK table:

• trashedAt
• trashedByUserId
• deletedByUserId

See Height's Task Object documentation for details.

Jira

We now capture deleted projects using webhooks. We're gradually rolling out to all existing connectors.

NOTE: We can't capture projects that were deleted before your Jira connector registered the webhook in your Jira installation.

Pinterest Ads

We now sync the PRODUCT_GROUP_TARGETING report.

We now sync the following Targeting type tables:

• TARGETING_AGE_BUCKET
• TARGETING_APP_TYPE
• TARGETING_GENDER
• TARGETING_GEO
• TARGETING_GEO_METRO
• TARGETING_GEO_REGION
• TARGETING_INTEREST
• TARGETING_LOCALE
• TARGETING_LOCATION

Shopify

We have added a new column, type, to the METAFIELD table.

We have added a new column, template_suffix, to the COLLECTION and PRODUCT tables.

We have added two new columns, created_at and updated_at, to the ABANDONED_CHECKOUT_DISCOUNT_CODE table.

We have added two new columns, currency and metafield, to the CUSTOMER table.

We have added two new columns, tax_exemptions and tax_lines, to the DRAFT_ORDER table.

We have added two new columns, presentment_prices and inventory_quantity_adjustment, to the PRODUCT_VARIANT table.

We have added two new columns, extended_authorization_standard_authorization_expires_at and extended_authorization_extended_authorization_expires_at, to the TRANSACTION table.

We have added the following new columns to the FULFILLMENT table:

• service
• name
• receipt_authorization

Snapchat Ads

We have removed the following tables:

• AD_SQUAD_UNIQUE_IMPRESSION_HOURLY_REPORT
• AD_UNIQUE_IMPRESSION_HOURLY_REPORT
• CAMPAIGN_UNIQUE_IMPRESSION_HOURLY_REPORT

because the Snapchat Marketing API has deprecated the following fields for HOUR granularity:

• attachment_uniques
• attachment_frequency
• frequency
• uniques

Stripe

We have added the following new fields to the CHARGE table:

• billing_detail_address_city
• billing_detail_address_country
• billing_detail_address_line1
• billing_detail_address_line2
• billing_detail_address_postal_code
• billing_detail_address_state
• billing_detail_email
• billing_detail_name
• billing_detail_phone

Zendesk Support

We have added the following new columns to the USER table:

• default_group_id
• iana_time_zone
• report_csv

We have added a new table, TICKET_MACRO_REFERENCE, which stores a tickets’ macro data. For more information, see Zendesk's documentation.

Improvements

Adobe Analytics Data Feed

We have added a new connector setup test. If your data feeds are located in a folder structure, the test checks if you have provided the complete folder path of the data feeds in the setup form.

Apple App Store

We will stop support for single-factor authentication on October 4, 2021. To continue syncing your Apple App Store data, switch to two-factor authentication before October 4, 2021. For instructions to configure two-factor authentication, see our Setup Guide.

We have added a warning alert on your connector dashboard. You must now use two-factor authentication.

Asana

Our Asana connector now uses multithreading when syncing projects. To avoid exceeding API rate limits, we use 3 parallel threads for Asana Basic accounts and 10 parallel threads for Asana Premium, Business, and Enterprise accounts.

Dropbox

We have added support for short-lived access token authorization. To switch to short-lived access token authorization, you must re-authorize your connector. On your connector's dashboard, go to the Setup tab, click Edit connection details, and then click Re-authorize connection. After successful re-authorization, click Save and Test.

We have added the Magic Folder functionality to our Dropbox connector. You can now sync any supported file from your Dropbox folder as a table within a schema in your destination. New Dropbox connectors created after October 7, 2021, will function as a Magic Folder connector. We will continue supporting existing Dropbox file connectors.

Facebook Ads

We have added the Use unified attribution setting toggle to the setup form. It controls the use_unified_attribution_setting query parameter. When this parameter is set to true, the Facebook API returns your ads results using the unified attribution settings defined at ad set level, and ignores the use_account_attribution_setting parameter.

See Facebook's API documentation for more details.

We have added the Sync all metadata toggle to the setup form. It controls the sync_metadata query parameter. When this parameter is set to false, we only sync report data without including metadata.

We have upgraded our Facebook Ads connector from version 11.0 to 12.0 of the Facebook Marketing API. Learn more about the changes in the Facebook Marketing API v12.0 changelog.

Facebook Pages

We have upgraded our Facebook Pages connector from version 11.0 to 12.0 of the Facebook Marketing API. Learn more about the changes in the Facebook Marketing API v12.0 changelog.

Google Search Console

We have added support for fresh data in reports.

Instagram Business

We have upgraded our Instagram Business connector from version 11.0 to 12.0 of the Graph API. Learn more about the changes in the Facebook API v12.0 changelog.

Mixpanel

You can now exclude the following child tables from your syncs:

• ANDROID_INVALID_PUSH_TOKENS
• COLLECTIONS
• DELIVERIES
• JOURNEYS
• MP_INAPP_CAMPAIGNS
• RESPONSES
• SURVEYS
• SURVEY_COLLECTIONS
• SURVEY_RESPONSES

On your Connector Details page, go to the Schema tab and deselect the tables.

NOTE: If you exclude the tables and later want to sync the tables, perform a complete table re-sync of the parent PEOPLE table, because we don't maintain the state of the child tables due to a lack of timestamp support in the source.

MongoDB

We have introduced packed mode, a new sync mode for MongoDB tables. Previously, we only supported unpacked mode. For more details, see our MongoDB documentation.

Oracle

Our Generic Oracle, Oracle RAC, and Oracle E-Business Suite connectors now support multitenant container databases. Learn more in our Supported configurations documentation.

Pendo

We have released pre-built, dbt Core-compatible data models for Pendo. Find the models in Fivetran's dbt hub or data models documentation. Learn more about our dbt Core integration in our Transformations for dbt Core documentation*.

* dbt Core is a trademark of dbt Labs, Inc. All rights therein are reserved to dbt Labs, Inc. Fivetran Transformations is not a product or service of or endorsed by dbt Labs, Inc.

Pipedrive

Our Pipedrive connector is now generally available.

Read our Pipedrive connector documentation.

Redshift

We have added automatic cluster region detection to the Redshift setup form. We now use your Host details to detect the cluster region automatically. For example, during the destination setup, if you enter the Host as datalake-test-cluster.czqj8z4xxnzl.us-west-1.redshift.amazonaws.com, we detect that the cluster region is us-west-1. If we can auto-detect the cluster region successfully, the Cluster region field will not be visible in the setup form.

Sailthru

The Sailthru connector now supports Sailthru Connect. You can now sync Event Stream data from your Sailthru account. For more information, see our setup instructions.

Shopify

The Shopify connector's priority-first syncs now fetch the most recent 15 days' worth of data. Previously, the priority fetch period was 30 days.

We have upgraded our Shopify connector from version 2020-10 to 2021-07 of the Shopify API.

Snowflake

You can now stage your data in Google Cloud Storage (GCS) if your Snowflake destination is deployed on Google Cloud Platform (GCP) for improved performance. Grant the FIVETRAN_ROLE the CREATE INTEGRATION permission using the following query:

GRANT CREATE INTEGRATION ON ACCOUNT TO ROLE FIVETRAN_ROLE;

Webhooks

We have added support for the United Kingdom (UK) regional endpoint. We restrict your data within the data processing location you select in the destination setup form. New connectors will utilize storage based on the data processing location you select.

YouTube Analytics

We have released pre-built, dbt Core-compatible data models for YouTube Analytics. Find the models in Fivetran's dbt hub or data models documentation. Learn more about our dbt Core integration in our Transformations for dbt Core documentation*.

* dbt Core is a trademark of dbt Labs, Inc. All rights therein are reserved to dbt Labs, Inc. Fivetran Transformations is not a product or service of or endorsed by dbt Labs, Inc.

Zuora

The Zuora and Zuora Sandbox connectors now support syncing Custom Objects. We use Data Query to fetch custom object records.

REST API Improvements

Default destination configuration response format

For accounts created after September 9, 2021, we return the connector configuration response in the V2 format by default.

See our Retrieve Connector Details endpoint documentation for details.

New REST API Endpoint

We have implemented a new API endpoint for our REST API, Retrieve connector configuration metadata.

Re-sync multiple tables

You can now re-sync data for multiple tables using the Re-sync Connector Table Data endpoint.

Log events

New log event

We now generate the change_schema_config_via_api log event in our logs when you change a schema sync configuration using our REST API. See our Logs documentation for details.