November 2023

Dashboard Improvements

Logs tab will be disabled

Effective May 1, 2024, Fivetran will disable access to the Logs tab in the Fivetran dashboard, so you will no longer be able to view logs in your browser. Instead, we recommend that you use the Fivetran Platform Connector. It sends the same log information to your destination, as well as data for monitoring connectors, tracking usage, and conducting audits. The MAR that the Fivetran Platform Connector generates is free.

Be sure to set up the Fivetran Platform Connector before May 1, 2024, if you want to have continued access to logs. For supported destinations, we also recommend using the Fivetran Platform Connector Quickstart data model, which prepares the data in analysis-ready models in your destination. You can enable the data model when setting up the Fivetran Platform Connector.

Fivetran Azure Middle East Servers

We have added new servers in the Azure UAE North (Dubai) region.

You can now select Middle East as your data processing location in your destination setup form. Connectors configured in a destination run in their designated cloud and region, meaning that your data doesn't leave our region-specific servers during processing. For example, if you configure your connectors to use our servers in Middle East, your data does not leave Middle East during processing.

We now support Azure Private Link connections to sources and destinations in the Azure UAE North (Dubai) region.

For more information, see our data residency documentation.

Lite Connectors

Lite connectors are now available for the following sources:

• Afterpay
• Attentive
• Buzzsprout
• Calabrio
• Care Quality Commission
• dbt Cloud
• Deputy
• Flexport
• Float
• GetFeedback
• GlobalMeet
• Katana
• LearnUpon
• Linear
• Looker
• Navan
• PartnerStack Vendor
• PowerReviews Enterprise
• Smartwaiver
• Statuspage
• Swoogo
• UpPromote
• Xray
• Zenefits

Transformations for dbt Core

dbt Core versions 1.3.7, 1.4.9 support

We now support dbt Core versions 1.3.7 and 1.4.9. You can use these versions to run your projects.

NOTE: For the above-mentioned versions of dbt Core, we don't support MySQL destinations. These destinations are not currently supported by a custom dbt Core adapter.

Also, we now support Azure Synapse destinations for 1.4.* versions of dbt Core.

* dbt Core is a trademark of dbt Labs, Inc. All rights therein are reserved to dbt Labs, Inc. Fivetran Transformations is not a product or service of or endorsed by dbt Labs, Inc.

End of support of dbt Core versions below 1.0.0.

We no longer support dbt Core versions below 1.0.0. You cannot select those versions anymore when configuring the dbt project.

NOTE: If you are using dbt versions below 1.0.0. in your projects, you will be automatically migrated to dbt version 1.4.9. We will communicate the exact date of the migration by email. Migration to dbt version 1.4.9 might impact the execution of dbt transformations.

We have deprecated the following versions of dbt Core:

• 0.18.0
• 0.18.1
• 0.18.2
• 0.19.0
• 0.19.1
• 0.19.2
• 0.20.0
• 0.20.1
• 0.20.2
• 0.21.0
• 0.21.1

* dbt Core is a trademark of dbt Labs, Inc. All rights therein are reserved to dbt Labs, Inc. Fivetran Transformations is not a product or service of or endorsed by dbt Labs, Inc.

Transformations for dbt Core

If your parent and child dbt models are configured to run on different schedules, the child model now runs without the parent model (dbt run --models +child --exclude parent). Previously, we included parent models in all child model runs.

* dbt Core is a trademark of dbt Labs, Inc. All rights therein are reserved to dbt Labs, Inc. Fivetran Transformations is not a product or service of or endorsed by dbt Labs, Inc.

Updated dbt Quickstart packages

We have updated the Quickstart packages for the following connectors:

• HubSpot to version 0.15.0
• Intercom to version 0.9.0

* dbt Core is a trademark of dbt Labs, Inc. All rights therein are reserved to dbt Labs, Inc. Fivetran Transformations is not a product or service of or endorsed by dbt Labs, Inc.

Schema changes

Amazon Ads

We have added new tables to support the Sponsored Brands and Sponsored Display services.

The names of the new tables for the Sponsored Brands and Sponsored Display services have the SB_ and SD_ prefixes, respectively.

By default, we select all new tables are selected for the synced. You can sync these tables for free until November 17, 2023. Be sure to exclude the tables that you don't want to count towards paid Monthly Active Rows (MAR) before this date.

For more information, see our Amazon Ads ERD.

Braze

We have added the following new tables:

• SEGMENT
• SEGMENT_MEMBER
• SEGMENT_TAG
• WHATSAPP_EVENT

NOTE: To sync the SEGMENT_MEMBER table, you must select the USER table on the Schema tab of your connector details page.

Also, we now sync the following events types from Braze Currents in the WHATSAPP_EVENT table:

• users.messages.whatsapp.Read
• users.messages.whatsapp.Delivery
• users.messages.whatsapp.Failure
• users.messages.whatsapp.Send
• users.messages.whatsapp.Abort
• users.messages.whatsapp.InboundReceive

For more information, see Braze's Message engagement events.

ClickUp

We have added the following new columns to the SUB_TASK table:

• archived
• custom_fields
• custom_id
• description
• folder_id
• list_id
• priority
• project_id
• space_id
• team_id
• text_content
• time_spent
• url

We have added a new column, point, to the TASK table.

We have removed the following columns from the SUB_TASK_ASSIGNEE table:

• color
• email
• initial
• username

We have removed the parent column from the TASK table.

Dixa

We have added the following new tables:

• CUSTOM_ATTRIBUTE
• CUSTOM_ATTRIBUTE_INPUT_OPTION
• CUSTOM_ATTRIBUTE_NESTED_OPTION
• CONVERSATION_CUSTOM_FIELD
• CONVERSATION_CUSTOM_FIELD_VALUE

Facebook Ads

We have added a new AD_VIDEO_THUMBNAIL table. We are gradually rolling out this change to all existing connectors.

Facebook Pages

We have added a new table, POST_COMMENT_HISTORY.

We have added a new column, comment_count, to the POST_HISTORY table. We are gradually rolling out these changes to all existing connectors.

Fivetran Platform Connector

We now sync metadata to the SOURCE_FOREIGN_KEY_METADATA table. For more information, see our Fivetran Platform documentation and sample queries.

Freshdesk

We have added the following new tables:

• AUTOMATION
• AUTOMATION_ACTION
• AUTOMATION_CONDITION
• AUTOMATION_EVENT
• AUTOMATION_PERFORMER_MEMBER

NOTE: We sync these tables once a day to capture deletes.

We have added the following new columns to the BUSINESS_HOUR table:

• sunday_start_time
• sunday_end_time
• monday_start_time
• monday_end_time
• tuesday_start_time
• tuesday_end_time
• wednesday_start_time
• wednesday_end_time
• thursday_start_time
• thursday_end_time
• friday_start_time
• friday_end_time
• saturday_start_time
• saturday_end_time

We have added the following new columns to the COMPANY table:

• account_tier
• health_score
• industry
• org_company_id
• renewal_date

We have added the following new columns to the TICKET table:

• stats_pending_since
• stats_reopened_at
• stats_status_updated_at

We have added the following new columns to the TICKET_HISTORY table:

• stats_pending_since
• stats_reopened_at
• stats_status_updated_at

We are gradually rolling out these changes to all existing connectors.

Impact

We have renamed the contract_payout_adjustment_rule_contract_event_payout_adjustment_id column to contract_event_payout_adjustment_id, in the CONTRACT_PAYOUT_ADJUSTMENT_RULE_VALUE table.

We have renamed the contract_event_payout_restriction_rule_contract_event_payout_restriction_id column to contract_event_payout_restriction_id, in the CONTRACT_EVENT_PAYOUT_RESTRICTION_RULE_VALUE table.

Klaviyo

We have added a new column, integration_object, to the METRIC table.

Kustomer

We have added the following new columns to the CONVERSATION and CONVERSATION_HISTORY tables:

• ended_at
• ended_by
• ended_reason
• spam

We have added two new columns, first_delivered_timestamp and first_delivered_client_type, to the MESSAGE table.

LinkedIn Company Pages

We have added a new column, agent, to the COMMENT_HISTORY table as part of the schema change in the new version of the LinkedIn API.

Pinterest Ads

We have added a new table, PIN_ANALYTICS_REPORT. The pin_stats column, previously removed in the July 2023 update from the PIN_HISTORY table, is now available in the new table. We will gradually roll out this change to all existing Pinterest Ads connectors by December 20, 2023. For more information on the API used to obtain the data, see Pin analytics API documentation.

Qualtrics

We have added the following new tables:

• SMS_DISTRIBUTION
• SMS_DISTRIBUTION_CONTACT
• TICKET

On your Connector Details page, go to the Schema tab and select or deselect these tables from your syncs.

NOTE: We perform a full re-import of the SMS_DISTRIBUTION and SMS_DISTRIBUTION_CONTACT tables that are deselected by default.

We are gradually rolling out these changes to all existing connectors.

Rippling

We have added the following new columns to the EMPLOYEE table:

• entity_id
• identified_gender
• job_family_duties
• job_family_name
• name
• pay_schedule_id
• preferred_first_name
• preferred_last_name
• work_location_nick_name
• work_hour_*

We have added the following new columns to the LEAVE_REQUEST table:

• company
• company_leave_type
• is_paid
• managed_by
• partial_days

Shopify

We have added a new table, PAYOUT. By default, we do not sync this table. However, if you want to sync the new table, select it in the Schema tab of your connector details page. We are gradually rolling out this change to all existing connectors.

Stripe

Effective November 22, 2023, we have deprecated the ORDER and SUBSCRIPTION tables.

Survicate

We have added the following new tables:

• BUTTON_NEXT_RESPONSE
• DATE_RESPONSE
• DROPDOWN_RESPONSE
• EMPTY_RESPONSE
• MULTIPLE_RESPONSE
• RATING_RESPONSE
• SINGLE_RESPONSE
• SMILEY_SCALE_RESPONSE
• TEXT_RESPONSE

We have removed the following tables:

• EMPTY_AND_BUTTON_NEXT_RESPONSE
• RATING_AND_SMILEY_SCALE_RESPONSE
• SINGLE_MULTIPLE_AND_DROPDOWN_RESPONSE
• TEXT_AND_DATE_RESPONSE

Toggl Track

We have made the following changes to the TIME_ENTRY table:

• added the following new columns:

  • billable_amount_in_cents
  • currency
  • hourly_rate_in_cents
  • seconds
  • username

• removed the following columns:

  • duration
  • duronly
  • server_deleted_at
  • workspace_id

Zoho CRM

Effective November 20, 2023, you will no longer be able to sync new data from the ACTIVITY table, as Zoho is deprecating the ACTIVITY endpoint after December 1, 2023. However, you can access the existing ACTIVITY data, in the CALL, EVENT, and TASK tables.

Improvements

Amazon DynamoDB

We have removed the Select tables for packed mode option from the Pack mode field in the connector setup form. For Amazon DynamoDB connectors created on or after November 21, 2023, we now support both the Packed mode and Unpacked mode at the connector level. We have also changed the default value of the Pack mode feature to Packed mode in the connector setup form. Previously, we used unpacked mode as the default value for this feature. When you select a pack mode, all the tables enabled for the sync follow that behavior. We will continue to support both the Pack modes at the table level for Amazon DynamoDB connectors created before November 21, 2023. For more information, see our Amazon DynamoDB pack mode documentation.

We have introduced a new pack mode option to deliver all key-value pairs as JSON strings for all tables. Learn more in our Switching pack modes documentation.

Amazon Kinesis Firehose

We have added a new drop-down menu, JSON Delivery Mode, to the connector setup form. The drop-down menu provides you the option to choose how Fivetran should handle your JSON data. For more information, see our documentation.

Anaplan

We have added support for the following Anaplan regions:

• Australia (AUS)
• Canada (CAN)
• Europe (EU)

AppsFlyer

The AppsFlyer connector now supports custom configuration of the Connection Name field in the setup form to sync Data Locker events. By default, we will continue to populate data-locker-hourly/ as the connection name. You can also opt to customize the connection name in the setup form.

Azure Functions

You can now add custom payloads as key-value pairs when you configure the Azure Functions connector. For more information, see our Azure Functions setup guide.

Brevo

We have renamed our Sendinblue connector to Brevo. This name change applies to the Fivetran dashboard and our documentation.

ClickUp

We have added new lookback windows for the following tables:

• 15 days for the TIME_ENTRY table
• 1 day for the SUB_TASK and TASK tables.

Close

We now incrementally sync the following tables:

• CALL_ACTIVITY
• CREATED_ACTIVITY
• EMAIL_ACTIVITY
• EMAIL_THREAD_ACTIVITY
• LEAD_STATUS_CHANGE_ACTIVITY
• MEETING_ACTIVITY
• NOTE_ACTIVITY
• OPPORTUNITY_STATUS_CHANGE_ACTIVITY
• SMS_ACTIVITY
• TASK_COMPLETED_ACTIVITY

Eloqua

We now delete the contact export definitions created by the Eloqua connector for syncing the CONTACT_LIST_CONTACT and CONTACT_SEGMENT tables. We delete these definitions at the end of each sync, which may temporarily increase your sync durations until the backlog of existing definitions are cleared. We are gradually rolling out this change to all Eloqua connectors.

Google Analytics 4

We have added a new option, Exclude records, in the Filter Type field, in the connector setup form. You can now select Include records or Exclude records options in the report setup panel to filter reports data for Google Analytics 4.

Google Cloud Functions

You can now add custom payloads as key-value pairs when you configure the Google Cloud Functions connector. For more information, see our Google Cloud Functions setup guide.

Google Drive

We have improved the method to detect data ranges to sync in spreadsheets for our Google Drive connectors in the Magic Folder mode. We now sync the entire spreadsheet irrespective of data in the first column. Previously, we skipped the spreadsheet if we found an empty first column and synced rows only till the last non-null value of first column, and skipped the succeeding rows in the other columns.

Klaviyo

We have completed the migration of the Klaviyo connectors created before August 22, 2023, to the Klaviyo API v2023-07-15. For more information, see our September 2023 changelog.

MongoDB

You can now choose to sync your BINARY data with either Base64 or UUID representations in your MongoDB connector setup form. We are gradually rolling this change out first for existing connectors, then for new connectors. Learn more in our Type Transformations and Mapping documentation.

Okta

We have changed the connector type of our Okta connector from Lite to Standard.

OneLake

Our OneLake destination is now generally available. Read our OneLake destination documentation.

We now load OneLake tables in the Tables/ directory in your OneLake lakehouse with the table name in the following format: <schema_name>__<table_name>. Previously, we used to take a prefix path as an input in the setup form and load the files to the Files/prefix_path/schema_name/ directory. This change enables you to query directly from the Tables folder using PowerBI tools, instead of selecting and loading files from the Files folder into the Tables folder manually. To transition into the new flow, save the changes in the destination setup form once again and perform a historical re-sync.

Oracle Fusion Cloud Applications

We have stopped marking the Oracle Fusion Cloud Applications connector tables as Excluded By System on the Schema tab of your connector dashboard when a submitted job schedule fails for a datastore in Oracle.

PostgreSQL

We have made the following changes to the Fivetran Teleport Sync update method:

• We no longer read for changes from columns that were selected and later deselected or update their fivetran_synced dates
• We no longer require a historical re-sync to bring in new data when you select new columns from the schema

Salesforce

We have upgraded our Salesforce connector from version 58.0 to 59.0 of the Salesforce REST API. Learn more about the changes in Salesforce REST API's changelog. We are gradually rolling out this change to all existing connectors.

Salesforce Marketing Cloud

We have converted the following tables to history tables and migrated the existing data in these tables to history mode:

• EMAIL
• LIST
• LIST_SUBSCRIBER

We have added two new tables, CAMPAIGN and CAMPAIGN_ASSET.

We are gradually rolling out these changes to all existing connectors.

SAP ERP on HANA

You can download a new version of the Fivetran NetWeaver API: v1000202. This API version implements the following features:

• SAP date to LocalDate conversion
• Unpack data for STXL

We have added support for HANA 2.0 SPS 3, which is the minimum required HANA DB version. For more information, see our SAP ERP on HANA documentation and SAP ERP on HANA setup guide.

Shopify

We now capture deletes for the METAFIELD table.

Toggl Track

The Toggl Track connector now supports table-level re-syncs.

Zoho CRM

We have improved the sync performance of our Zoho CRM connector. We now incrementally sync the subforms. We also re-import them once a week to capture deletes.

REST API Improvements

AWS Lambda

You can now specify custom payloads as key-value pairs when you configure the Lambda connector using our REST API.

Azure Functions

You can now specify custom payloads as key-value pairs when you configure the Azure Functions connector using our REST API.

Google Cloud Functions

You can now specify custom payloads as key-value pairs when you configure the Google Cloud Functions connector using our REST API.

Log Service Management API

Our Log Service Management API resource is now generally available. You can now leverage the following features:

• Create a Log Service
• Retrieve Log Service Details
• Update a Log Service
• Delete a Log Service
• Run Log Service Setup Tests

OneLake

You can now configure your OneLake destination using the Fivetran REST API.

Revel Systems

We have renamed the api_key:api_secret parameter of the Revel Systems connector to api_key_api_secret.