November 2020

Billing and Usage Tab Updates

We have redesigned the Billing and Usage tabs in your Fivetran dashboard to include detailed information about your MAR and credit consumption:

The Billing tab shows your current and past credit consumption, along with your billing details and a new credit alert. Learn more in our Billing documentation.
The Usage tab shows your monthly MAR usage by destination, connector, or table. Learn more in our Usage documentation.

Consumption Based Pricing

We no longer count Fivetran system tables, including connector-specific system tables, towards your monthly active rows.

New Connector Trial

We now provide a 14-day free trial for all new connectors (regardless of whether the source type is new) added throughout the lifetime of our customer accounts. The trial starts after the initial sync. After the first seven continuous days of the connector's activity within one month, you will receive an estimate of your monthly credit usage and Monthly Active Rows (MAR) for the connector.

To learn more, read our 14-day free connector trial documentation.

Transformations for dbt Core

We now support dbt projects that are not located in the root folder of your Git repository. In the Advanced Options section of the Fivetran setup form, you can now specify the path to the folder that contains your dbt_project.yml file.

Schema changes

Braze

We have fixed a problem with the canvas_step_id column's foreign key in the MESSAGE_VARIATION table. We now map the MESSAGE_VARIATION.canvas_step_id column to the CANVAS_STEP table's id column. Previously, we mapped it to the CANVAS table's id column. We will re-sync the following tables to correct your existing data:

CANVAS
CANVAS_STEP
CANVAS_STEP_SEQ
CANVAS_TAG
CANVAS_VARIATION
MESSAGE_VARIATION

Eloqua

We now add a prefix, custom_, to a custom column name if we find a standard column with the same name in your custom object table.

If your custom object table contains custom columns and standard columns with the same names, contact support to re-sync your custom object table. See our Eloqua ERD for more information on the standard columns in the custom object tables.

HubSpot

We have added the following new tables to support HubSpot's Tickets API:

TICKET
TICKET_COMPANY
TICKET_CONTACT
TICKET_DEAL
TICKET_ENGAGEMENT
TICKET_PROPERTY_HISTORY

See our Service Hub schema for more information.

Jira

We now fully support the cascading select fields in Jira issues. We've added a new parent_id column, which refers to the parent value, to the FIELD_OPTION table. To sync fields of this type for all issues, re-sync your connector.

LinkedIn Ad Analytics

We have removed the following fields from the ACCOUNT_HISTORY table because LinkedIn Ads has deprecated them:

total_budget_amount
total_budget_ends_at
total_budget_currency_code

Microsoft Dynamics 365 CRM

We now create an additional table STRINGMAP to sync the string values and the mapping information of your picklist attributes. Previously, we used to sync only the code values of the picklist attributes. See our documentation for more information.

Recharge

We now use webhooks to capture deletes for the ONE_TIME_PRODUCT, ORDER, and SUBSCRIPTION tables. We have added a is_deleted column to the three tables to track the deleted records.

We have deprecated the ANALYTICS_DATA table. We now sync this data to the UTM_TAG table.

Shopify

We have upgraded our Shopify connector and made the following schema changes:

We now sync the default product image record to the PRODUCT table.
We have added a new table, ORDER_ADJUSTMENTS, which stores the refunded shipping costs and the differences between calculated and actual refund amounts. See Shopify's Refund Order API documentation for more information.
We have added the following new fields to the tables below:
- price_set to the DRAFT_ORDER_LINE table
- type to the ORDER_DISCOUNT_CODE table
- prerequisite_to_entitlement_purchase_* to the PRICE_RULE table
- order_id and total_duties_set to the REFUND table
- is_default and variant_ids to the PRODUCT_IMAGE table
- usage_count and updated_at to the DISCOUNT_CODE table
- variant_title and gift_card to the ABANDONED_CHECKOUT_LINE table
- discounted_price_set and price_set to the ORDER_SHIPPING_LINE table
- presentment_currency and total_duties to the ABANDONED_CHECKOUT table
- acceptsMarketingUpdatedAt and marketingOptInLevel to the CUSTOMER table
- country_code_of_origin and province_code_of_origin to the INVENTORY_ITEM table
We have added three new fields, option1, option2, and option3, to the PRODUCT_VARIANT table.
We have added three new fields, rules, sort_order, and disjunctive, to the CUSTOM_COLLECTION and SMART_COLLECTION tables.
We have added the following new fields to the LOCATION table:
- country_code
- country_name
- localized_country_name
- localized_province_name
- province_code
We have added the following new fields to the ABANDONED_CHECKOUT_DISCOUNT_CODE table:
- created_at
- type
- updated_at
- usage_count
We have added the following new fields to the ABANDONED_CHECKOUT_SHIPPING_LINE table:
- delivery_expectation_range
- delivery_expectation_type
- original_shop_markup
- original_shop_price
- presentment_title
We have added the following new fields to the ORDER_LINE table:
- pre_tax_price_set
- price_set
- product_exists
- tax_code
- total_discount_set
- variant_inventory_management
- variant_title
- destination_location_*
- origin_location_*
We have added the following new fields to the ORDER_LINE_REFUND table:
- subtotal
- subtotal_set
- total_tax
- total_tax_set
We have added the following new fields to the ORDER table:
- confirmed
- current_total_duties_set
- customer_locale
- device_id
- landing_site_ref
- original_total_duties_set
- payment_gateway_names
- presentment_currency
- reference
- source_identifier
- source_url
- subtotal_price_set
- total_discounts_set
- total_line_items_price_set
- total_price_set
- total_price_usd
- total_shipping_price_set
- total_tax_set
- total_tip_received

We have added a new table, TENDER_TRANSACTION. See Shopify's documentation for more information.

Stripe

We have added the following new fields to the ACCOUNT table:

requirements_current_deadline
requirements_currently_due
requirements_disabled_reason
requirements_errors
requirements_eventually_due
requirements_past_due
requirements_pending_verification

We now sync the BANK_ACCOUNT and CARD tables' records using the external_accounts field of the ACCOUNT table. See Stripe's documentation on external accounts for more information.

We have added a new table, CUSTOMER_DISCOUNT, which stores information about customer discounts. See Stripe's documentation on discounts for more information.

We have removed the _fivetran_id field from the INVOICE_DISCOUNT and SUBSCRIPTION_DISCOUNT tables.

Twitter Ads

We have added the following new report tables to support Reach and Average Frequency:

CAMPAIGN_REACH_DAILY_REPORT
CAMPAIGN_REACH_MONTHLY_REPORT
FUNDING_INSTRUMENT_REACH_DAILY_REPORT
FUNDING_INSTRUMENT_REACH_MONTHLY_REPORT

We have added a new table, PREROLL_CALL_TO_ACTIONS_HISTORY, which stores the preroll call-to-actions for an account. See Twitter's documentation for more information.

We have removed the video_mrc_views field from the analytics tables. The video_total_views field stores the same data.

Zendesk Support

We have added a new field, via_source_from_address, to the TICKET table. The via_source_from_address field stores the original address that sent the Zendesk request.

Zuora

We can now sync the USER table using the Data Query feature. Only Zuora platform admin users can access the USER table. See Zuora's documentation for more information. If you'd like to enable the USER table on your connector, contact our support team.

Improvements

Adobe Analytics

We now support Adobe Analytics 2.0 Calculated Metrics. On your connector setup form, in the Calculated Metrics drop-down menu, select the calculated metrics you want to sync. If you'd like to enable this feature on your connector, contact our support team.

Apache Kafka

We now support Avro messages.

We have added support for Simple Authentication and Security Layer (SASL) authentication with PLAIN and SCRAM-SHA-256 mechanisms.

Google Ads

We have released pre-built, dbt Core-compatible data models for Google Ads. Find the models in Fivetran's dbt hub or data models documentation. Learn more about our dbt Core integration in our Transformations for dbt Core documentation*.

* dbt Core is a trademark of dbt Labs, Inc. All rights therein are reserved to dbt Labs, Inc. Fivetran Transformations is not a product or service of or endorsed by dbt Labs, Inc.

Google Campaign Manager 360

We now ignore the following verification metrics in reporting data during the sync for dates prior to six months before the current date:

Blocked Impressions
Classified Impressions
Publisher Problems
Reporting Problems
Serving Problems
Verifiable Impressions
Warnings

Google Search Console

We now use 7 days as the time period for fetching data both in forward and backward parts of priority-first sync. We changed this time period from 30 days to 7 to improve sync speeds. To learn more, see our priority-first sync documentation.

Marketo

You can now exclude the following activity tables from your syncs:

ACTIVITY_ADD_TO_LIST
ACTIVITY_ADD_TO_NURTURE
ACTIVITY_ADD_TO_OPPORTUNITY
ACTIVITY_CHANGE_DATA_VALUE
ACTIVITY_CHANGE_STATUS_IN_PROGRESSION
ACTIVITY_DELETE_LEAD
ACTIVITY_MERGE_LEADS
ACTIVITY_NEW_LEAD
ACTIVITY_REMOVE_FROM_LIST
ACTIVITY_REMOVE_FROM_OPPORTUNITY

On your Connector Details page, go to the Schema tab and deselect the tables.

Oracle E-Business Suite

We now support Oracle E-Business Suite on RAC.

Salesforce

We have upgraded our Salesforce connector from version 45.0 to 50.0 of the Salesforce REST API. We are gradually rolling out this new feature to all existing connectors. If you'd like to enable this feature on your connector, contact our support team.

Segment

Now, when we sync nested dynamic custom columns, we add a prefix, properties_ or traits_, to the custom column names depending on the attribute type, to avoid potential conflicts between the custom column names and the schema column names. For example, we rename a nested custom column timestamp as properties_timestamp or traits_timestamp.

Shopify

You can now exclude the PRICE_RULE and ORDER_ADJUSTMENT tables from the sync. On your connector details page, go to the Schema tab and deselect the tables to reduce your MAR usage.

You can now exclude the following tables from the sync to improve the connector's sync speed:

DISCOUNT_CODE
FULFILLMENT_EVENT
TRANSACTION

On your connector details page, go to the Schema tab and deselect the tables you want to exclude.

Twilio

Our Twilio connector is now generally available.

Read our Twilio connector documentation.

Twitter Ads

We now support Twitter Ads API v8.

Zendesk Support

Our Zendesk Support connector now supports multithreading. We can now use multiple parallel API requests to fetch ticket data from your Zendesk account to your destination, leading to faster sync speeds. The connector’s sync speed depends on your Zendesk API quota. We are gradually rolling out this new feature to all existing connectors.

REST API Improvements

Support external OAuth credentials to authorize connectors in Public API

We have expanded the public API endpoints Create a Connector and Modify a Connector. Now you can authorize the following connectors by adding the auth section to payloads:

Log events

New Log Event

We have added a new log event, diagnostic_access_granted. Read our Logs documentation for more information.