April 2021

Dashboard Improvements

Connector List

We now support searching connectors by alias keywords, for example, "Adwords" for the "Google Ads" connector or "Salesforce" for the "Pardot" connector. This feature works in the Connector List and in the Add Connector wizard.

Connector List

connector-list

Add Connector

add-connector

Group Control

The menu on the Account page now displays all available groups in the same way as the menu on the Dashboard page. The current account is dispalyed as the top value. You can navigate to the Dashboard page by selecting the corresponding group in the menu.

Old menu:

old-menu

New menu:

new-menu

Recommendations

We now display a list of connector types to try in your Connector list during the trial period. This recommendation is based on the preferences of the users who use the same connector types as you do. The recommended connector type list displays other connector types these users are using.

connector-list

Documentation in Support Portal

We've added all of our documentation found at https://docs.fivetran.com/ to our Support Portal to make it easier to find the answers you're looking for without needing to open a support ticket. You will now be able to find any documentation, best practices, and more from the search within our Support Portal.

Docs in Support Portal

New connectors

Airtable

Airtable is an online collaboration platform for creating and sharing relational databases.

Read our Airtable connector documentation.

Branch

Branch is a mobile measurement and deep linking platform that unifies user measurement across different devices, platforms, and channels.

Read our Branch connector documentation.

Facebook Ads

We have combined the Facebook Ad Account and Facebook Ad Insights connectors into the new Facebook Ads connector to provide meta and reporting data in one place.

Read our Facebook Ads connector documentation.

Height

Height is a collaborative work service that helps to maintain a project workflow.

Read our Height connector documentation.

SAP Concur

SAP Concur provides an integrated online business travel and expense management software solution.

Read our SAP Concur connector documentation.

Twitter Organic

Twitter is a microblogging and social networking service. Fivetran's Twitter connector provides a history of the settings and a detailed report of your organic tweet data.

Read our Twitter Organic connector documentation.

Schema changes

Coupa

We have added two new tables, EXPENSE_LINE_DAILY_PER_DIEM and PER_DIEM_DEDUCTION.

We have renamed the EASYFORM_WIDGET_RULE table to EASY_FORM_WIDGET_RULE.

We have added a new column, custom_fields, to the following tables to sync custom fields as JSON objects:

USER
ORDER_HEADER
INVOICE_HEADER
INVOICE_LINE

We will deprecate the following columns from the USER table after July 30, 2021:

custom_fields_costCenter
custom_fields_dadsArea
custom_fields_dadsDistrict
custom_fields_dadsDivision
custom_fields_dadsStore
custom_fields_division
custom_fields_endDate
custom_fields_orgUnitNName
custom_fields_region

Be sure to update your queries before we deprecate the columns.

Eloqua

We have added a new table, USER_INFO, to support Users endpoints.

We have added the following new columns to the CONTACT table:

account_name
bounceback_date
city
created_by
current_status
description
first_name
is_bounceback
is_subscribed
last_name
postal_code
province
sales_person
subscription_date
title
unsubscription_date
updated_by

GitHub

We have added a new table, LABEL. We have deprecated the label column and added a new column, label_id, to the following tables:

ISSUE_LABEL
ISSUE_LABEL_HISTORY

This feature applies to all GitHub connections set up after April 19, 2021. See the GitHub Schema Information section for details.

Greenhouse

We have added a new table, DEMOGRAPHIC_ANSWER.

We have added a new table, USER_LINKED_CANDIDATE, which stores the user linked candidate IDs.

We have added a new column, is_primary, to the USER_EMAIL table.

We have added a new column, can_email, to the CANDIDATE table.

HubSpot

We have added two new metadata tables, PROPERTY and PROPERTY_OPTION, to sync the properties associated with the following objects:

company
contact
deal
line_item
product
ticket

Lever

We have added the following new columns to the OFFER table:

sent_document_file_name
sent_document_download_url
sent_document_uploaded_at
signed_document_file_name
signed_document_download_url
signed_document_uploaded_at

Marketo

We have added the following new tables to support Marketo API's Segmentation endpoints:

SEGMENTATION
SEGMENT
LEAD_SEGMENT

Recharge

We have added the following new columns to the UTM_TAG table:

campaign
content
data_source
medium
source
term
time_stamp

We will deprecate the following columns of the UTM_TAG table after July 1, 2021:

utm_campaign
utm_content
utm_data_source
utm_medium
utm_source
utm_term
utm_time_stamp

Be sure to update your queries with the new column names before we remove the old columns.

Stripe

We have added a new table, TAX_RATE_INVOICE_MAPPING, which stores the tax rates applied to an invoice.

We have added a new table, APPLE_PAY_DOMAIN. By default, we exclude the table from your syncs. On your Connector Details page, go to the Schema tab and select the table.

We have added the following new columns to the INVOICE table:

default_payment_method_id
payment_intent_id
post_payment_credit_notes_amount
pre_payment_credit_notes_amount
subscription_id

We have added the following new columns to the SUBSCRIPTION table:

default_payment_method
latest_invoice_id
pending_setup_intent_id

We have added a new column, payment_method_types, to the PAYMENT_INTENT table.

We will deprecate the metadata_* columns from the Stripe schema after August 1, 2021. Be sure to update your queries with the metadata column. We sync metadata as JSON objects. For more information on the metadata column, see our documentation.

Xero

We have added three new tables to support Xero's Payroll API:

AUS_PAYROLL_EMPLOYEE
AUS_PAYROLL_LEAVE_APPLICATION
AUS_PAYROLL_TIMESHEET

See Xero's API documentation to learn more about Employees, Leave Applications, and Timesheets.

We have added three new tables to support Xero's Assets API:

ASSET
ASSET_TYPE
SETTINGS

See Xero's API documentation to learn more about Assets, Asset Types, and Settings.

We have added the following new columns to the BANK_TRANSACTION and PAYMENT tables:

batch_payment_id
batch_payment_date
batch_payment_is_reconciled
batch_payment_status
batch_payment_total_amount
batch_payment_type
batch_payment_updated_date_utc

Improvements

Adobe Analytics Data Feed

Our Adobe Analytics Data Feed connector is now generally available.

Read our Adobe Analytics Data Feed connector documentation.

Amazon S3

We have added a new advanced configuration option List Strategy to the connector setup form. Enable the Enable Advanced Options toggle and select the listing strategy you want to use:

complete_listing: The default listing strategy where we list all the files in the bucket and filter new and modified files.
time_based_pattern_listing: An optimized listing strategy to improve sync speeds. We fetch the files in a lexicographic order starting from the last file of the previous sync. You can opt to use this strategy if your files are named based on the date or time they are added to the bucket. For example, if a time-based pattern exists in the bucket leading to every new file being appended in a lexicographically increasing order:
Filename Last Modified
2021/01/01.csv January 1, 2021
2021/01/02.csv January 2, 2021
2021/01/03.csv January 3, 2021
2021/01/04.csv January 4, 2021
NOTE: If we are unable to identify a time-based pattern in the file names, we will use the default strategy and list all the files.

Filename	Last Modified
2021/01/01.csv	January 1, 2021
2021/01/02.csv	January 2, 2021
2021/01/03.csv	January 3, 2021
2021/01/04.csv	January 4, 2021

Braintree

We have improved the sync speed of the Braintree connector by implementing parallelism in our syncs.

Databricks

Our Databricks destination now supports clusters with Databricks Runtime 8.0 and above.

Delighted

Our Delighted connector is now generally available.

Read our Delighted connector documentation.

Google Ad Manager

We have upgraded our Google Ad Manager connector from version 202008 to 202102 of the Ad Manager API and handled deprecations and updates. Learn more about the deprecations and changes in Google Ad Manager's API documentation.

Removed dimensions:
- AD_EXCHANGE_MOBILE_APP_NAME
Removed columns:
- DYNAMIC_ALLOCATION_INVENTORY_LEVEL_WITH_CPD_PERCENT_REVENUE
New dimensions:
- AD_EXCHANGE_DFP_MOBILE_APP_NAME
- AD_EXCHANGE_MOBILE_APP_RESOLVED_ID
- BROWSER_NAME
- CLASSIFIED_YIELD_PARTNER_NAME
- DOMAIN
- MOBILE_APP_RESOLVED_ID
- UNIFIED_PRICING_RULE_ID
- UNIFIED_PRICING_RULE_NAME
- VIDEO_PLACEMENT_NAME
New columns:
- CREATIVE_LOAD_TIME_0_500_MS_PERCENT
- CREATIVE_LOAD_TIME_500_1000_MS_PERCENT
- CREATIVE_LOAD_TIME_1_2_S_PERCENT
- CREATIVE_LOAD_TIME_2_4_S_PERCENT
- CREATIVE_LOAD_TIME_4_8_S_PERCENT
- CREATIVE_LOAD_TIME_GREATER_THAN_8_S_PERCENT
- UNVIEWED_REASON_SLOT_NEVER_ENTERED_VIEWPORT_PERCENT
- UNVIEWED_REASON_USER_SCROLLED_BEFORE_AD_FILLED_PERCENT
- UNVIEWED_REASON_USER_SCROLLED_BEFORE_AD_LOADED_PERCENT
- UNVIEWED_REASON_USER_SCROLLED_BEFORE_1_S_PERCENT
- UNVIEWED_REASON_OTHER_PERCENT
- PAGE_NAVIGATION_TO_TAG_LOADED_TIME_0_500_MS_PERCENT
- PAGE_NAVIGATION_TO_TAG_LOADED_TIME_500_1000_MS_PERCENT
- PAGE_NAVIGATION_TO_TAG_LOADED_TIME_1_2_S_PERCENT
- PAGE_NAVIGATION_TO_TAG_LOADED_TIME_2_4_S_PERCENT
- PAGE_NAVIGATION_TO_TAG_LOADED_TIME_4_8_S_PERCENT
- PAGE_NAVIGATION_TO_TAG_LOADED_TIME_GREATER_THAN_8_S_PERCENT
- PAGE_NAVIGATION_TO_FIRST_AD_REQUEST_TIME_0_500_MS_PERCENT
- PAGE_NAVIGATION_TO_FIRST_AD_REQUEST_TIME_500_1000_MS_PERCENT
- PAGE_NAVIGATION_TO_FIRST_AD_REQUEST_TIME_1_2_S_PERCENT
- PAGE_NAVIGATION_TO_FIRST_AD_REQUEST_TIME_2_4_S_PERCENT
- PAGE_NAVIGATION_TO_FIRST_AD_REQUEST_TIME_4_8_S_PERCENT
- PAGE_NAVIGATION_TO_FIRST_AD_REQUEST_TIME_GREATER_THAN_8_S_PERCENT
- TAG_LOAD_TO_FIRST_AD_REQUEST_TIME_0_500_MS_PERCENT
- TAG_LOAD_TO_FIRST_AD_REQUEST_TIME_500_1000_MS_PERCENT
- TAG_LOAD_TO_FIRST_AD_REQUEST_TIME_1_2_S_PERCENT
- TAG_LOAD_TO_FIRST_AD_REQUEST_TIME_2_4_S_PERCENT
- TAG_LOAD_TO_FIRST_AD_REQUEST_TIME_4_8_S_PERCENT
- TAG_LOAD_TO_FIRST_AD_REQUEST_TIME_GREATER_THAN_8_S_PERCENT
New dimension attributes:
- LINE_ITEM_AVERAGE_NUMBER_OF_VIEWERS

Heap

Our Heap connector is now generally available.

Read our Heap connector documentation.

Jira

Now you can sync the following table groups by selecting the relevant group checkbox on the Schema tab of the connector details page:

BOARD, ISSUE_BOARD, PROJECT_BOARD
PERMISSION_SCHEME, PERMISSION, PERMISSION_HOLDER
SECURITY_SCHEME, SECURITY_LEVEL, SECURITY_SCHEME_LEVEL.

NOTE: When sync is enabled for any of these groups, all tables within the selected groups are re-synced once a day.

Now we sync the historical changes of the key field.

Redshift

We now truncate LOCALDATETIME values to microsecond precision before we load them as TIMESTAMP values to your Redshift destination. For example, if we receive a LOCALDATETIME value 2021-02-01T15:24:47.1234567, we truncate the value and write it to your destination as 2021-02-01T15:24:47.123456.

Xero

We now support the Employees, Leave Applications and Timesheets endpoints of the Xero-Payroll API. To use these endpoints, you must re-authorize your connector in your Fivetran dashboard. On the Connector Details page, go to the Setup tab, click Edit connection details, and then click Re-authorize connection. See Xero's API documentation to learn more about the Employees, Leave Applications, and Timesheets endpoints.

We have released pre-built, dbt Core-compatible data models for Xero. Find the models in Fivetran's dbt hub or data models documentation. Learn more about our dbt Core integration in our Transformations for dbt Core documentation*.

* dbt Core is a trademark of dbt Labs, Inc. All rights therein are reserved to dbt Labs, Inc. Fivetran Transformations is not a product or service of or endorsed by dbt Labs, Inc.

REST API Improvements

REST API Postman Collection

We have published Postman collection, which contains templates to help you create API requests for all endpoints supported by Fivetran.

Schema lookup

We have added a schema filter to our List All Connectors within a Group endpoint. Specify the schema of a connector as a value of the schema GET parameter to perform filtering and retrieve only information for that connector.

Support external OAuth credentials to authorize connectors in Public API

We have expanded the Create a Connector and Modify a Connector public API endpoints. Now you can authorize the following connectors by adding the auth section to payloads: