June 2022

Dashboard Improvements

Redesigned setup form fields

We have redesigned the Skip Header Lines and Skip Footer Lines setup form fields for our Amazon S3, Azure Blob Storage, Dropbox, FTP, Google Cloud Storage, and SFTP file connectors. To set these advanced options, enable them using the toggles and specify the number of skipped lines in the input fields.

Compare how the setup form looked before the change:

and how it looks now:

Restored Sync now function for connectors

We have restored the manual sync functionality for your connectors if you have Transformations for dbt Core enabled. When you click the Sync now button in the dashboard, the sync runs. Once the sync is completed, we run all dependent models.

Fivetran Azure Europe Servers

We have added new servers in the Azure West Europe (Netherlands) region.

If you're on a Business Critical plan, you can now select this region in your destination setup form. Connectors configured in a destination run in their designated cloud and region, meaning that your data doesn't leave our region-specific servers during processing. For example, if you configure your connectors to use our servers in Netherlands, your data does not leave Netherlands during processing.

If you're on an Enterprise or Business Critical plan, this is the default region if you choose EU as your data processing location and Azure as your cloud provider.

We now support Azure Private Link connections to sources and destinations in the West Europe region.

For more information, see our data residency documentation.

Transformations for dbt Core

dbt Core versions 1.0.7, 1.0.8, and 1.1.1 support

We now support dbt Core 1.0.7, 1.0.8, and 1.1.1. You can use these version to run your projects.

Schema changes

ADP Workforce Now

We unnested some fields to add _shortName, _longName, _subdivisionType, and _effectiveDate columns per field to the following tables:

• ASSIGNED_WORK_COMMUNICATION
• ASSOCIATED_RATE_QUALIFIER
• BUSINESS_COMMUNICATION
• CLASSIFICATION
• GROUP
• LOCATION
• ORGANIZATIONAL_UNIT
• OTHER_PERSONAL_ADDRESS
• PERSON
• PERSON_ALTERNATE_PREFERRED_NAME
• PERSON_COMMUNICATION
• PERSON_DOCUMENT
• PERSON_FORMER_NAME
• PERSON_GOVERNMENT_ID
• PERSON_PREFERRED_SALUTATION
• PERSON_SOCIAL_INSURANCE_PROGRAM
• PERSON_TITLE_AFFIX
• PERSON_TITLE_PREFIX
• WORK_ASSIGNMENT
• WORKER
• WORKER_ADDITIONAL_REMUNERATION
• WORKER_BASE_REMUNERATION
• WORKER_HOME_WORK_COMMUNICATION
• WORKER_REPORT_TO

Facebook Ads

We have added the following new fields to the AD_SET_HISTORY table:

• promoted_object_custom_conversion_id
• promoted_object_custom_event_str
• promoted_object_offline_conversion_data_set_id
• promoted_object_pixel_aggregation_rule
• promoted_object_pixel_rule
• promoted_object_retention_days

Learn more in Facebook's Ad Set, Promoted Object documentation.

GitHub

We have added a new column, pull_request_review_id to the PULL_REQUEST_REVIEW_COMMENTS table. This column links to the PULL_REQUEST_REVIEW table.

Google Ads

We have added a new report, ASSET_FIELD_TYPE_VIEW.

We have added the following fields that correspond to the relevant asset types in the ASSET report:

• dynamic_real_estate_asset

• dynamic_custom_asset

• dynamic_hotels_and_rentals_asset

• dynamic_flights_asset

• dynamic_travel_asset

• dynamic_local_asset

• dynamic_jobs_asset

  NOTE: You cannot use ASSET as a separate report because it doesn't have the segments.date field. You can find this report as a part of ad_group_ad_asset_view or ad_group_asset.

We have added the following fields to the reports below:

• asset_group_product_group_view.asset_group and asset_group_product_group_view.asset_group_listing_group_filter fields to the ASSET_GROUP_PRODUCT_GROUP_VIEW report
• ad_group_ad_asset_combination_view.enabled field to the AD_GROUP_AD_ASSET_COMBINATION_VIEW report
• customer.conversion_tracking_setting.google_ads_conversion_customer field to the CUSTOMER report

We have added the following fields to the AdGroupCriterionHistory metadata table:

• cpc_bid_micros
• cpm_bid_micros
• cpv_bid_micros

We have added the breadcrumb1 and breadcrumb2 fields to the VideoResponsiveAdHistory metadata table.

Google Campaign Manager 360

We have renamed the account_id column to profile_id. This change affects new connectors created since June 30, 2022.

LinkedIn Ad Analytics

We have removed the approximate_unique_impressions column from the AD_ANALYTICS_BY_CREATIVE and AD_ANALYTICS_BY_CAMPAIGN tables.

We have added the following new columns to the AD_ANALYTICS_BY_CAMPAIGN table:

• average_daily_reach_metrics_approximate_cost_in_currency_per_thousand_members_reached
• average_daily_reach_metrics_approximate_frequency
• average_daily_reach_metrics_approximate_reach
• average_previous_seven_day_reach_metrics_approximate_cost_in_currency_per_thousand_members_reached
• average_previous_seven_day_reach_metrics_approximate_frequency
• average_previous_seven_day_reach_metrics_approximate_reach
• average_previous_thirty_day_reach_metrics_approximate_cost_in_currency_per_thousand_members_reached
• average_previous_thirty_day_reach_metrics_approximate_frequency
• average_previous_thirty_day_reach_metrics_approximate_reach

Mailchimp

We have added a new column, web_id, to the MEMBER table. To sync your historical data from the web_id column, contact our support team.

Pendo

We have added the following columns to the GUIDE_EVENT table:

• ui_element_actions
• ui_element_id
• ui_element_text
• ui_element_type

To sync your historical data from these columns, contact our support team.

We have added a new table, PICKLIST_POLL_RESPONSE, that stores the text response of the PickList poll type.

Pipedrive

We have added the following new columns to the PRODUCT_DEAL table:

• active_flag
• add_time
• comments
• currency
• discount_percentage
• duration
• duration_unit
• enabled_flag
• id
• item_price
• last_edit
• name
• order_nr
• product_variation_id
• quantity
• quantity_formatted
• sum
• sum_formatted
• sum_no_discount
• tax

Zendesk Support

We have added the via_* columns to the following tables:

• TICKET_COMMENT
• TICKET_TAG_HISTORY
• TICKET_FIELD_HISTORY

Improvements

Adjust

Our Adjust connector is now generally available. Read our Adjust connector documentation.

Dropbox

We have added the Merge Mode functionality to our Dropbox connector. For connectors created after June 2, 2022, you can now opt to sync multiple files into a single table in your destination. In the connector setup form, select your sync strategy as Merge Mode or Magic Folder. For more information, see our setup instructions.

Facebook Ads

We have upgraded our Facebook Ads connector to version 14.0 of the Facebook API. For more information, see Facebook's v14.0 changelog.

Facebook Pages

We have upgraded our Facebook Pages connector from version 13.0 to 14.0 of the Facebook Graph API. Learn more about the changes in the Facebook Graph API v14.0 changelog.

GitHub

We now sync all users from any team associated with a repository. Previously, we may have missed syncing some users.

Google Ad Manager

We have upgraded our Google Ad Manager connector from version 202111 to 202205 of the Ad Manager API and handled deprecations and updates. Learn more about the deprecations and changes in Google's Ad Manager API documentation.

• Removed columns:

  • AD_EXCHANGE_ACTIVE_VIEW_ENABLED_IMPRESSIONS
  • AD_EXCHANGE_ACTIVE_VIEW_MEASURABLE
  • AD_EXCHANGE_ACTIVE_VIEW_MEASURED_IMPRESSIONS
  • AD_EXCHANGE_ACTIVE_VIEW_VIEWABLE
  • AD_EXCHANGE_ACTIVE_VIEW_VIEWED_IMPRESSIONS
  • AD_EXCHANGE_AD_CTR
  • AD_EXCHANGE_AD_ECPM
  • AD_EXCHANGE_AD_REQUESTS
  • AD_EXCHANGE_AD_REQUEST_CTR
  • AD_EXCHANGE_AD_REQUEST_ECPM
  • AD_EXCHANGE_AVERAGE_VIEWABLE_TIME
  • AD_EXCHANGE_CLICKS
  • AD_EXCHANGE_COVERAGE
  • AD_EXCHANGE_CPC
  • AD_EXCHANGE_CTR
  • AD_EXCHANGE_DEALS_AD_REQUESTS
  • AD_EXCHANGE_DEALS_BID_RESPONSES
  • AD_EXCHANGE_DEALS_MATCHED_REQUESTS
  • AD_EXCHANGE_DEALS_MATCH_RATE
  • AD_EXCHANGE_ESTIMATED_REVENUE
  • AD_EXCHANGE_IMPRESSIONS
  • AD_EXCHANGE_LIFT
  • AD_EXCHANGE_MATCHED_ECPM
  • AD_EXCHANGE_MATCHED_REQUESTS
  • AD_EXCHANGE_VIDEO_ABANDONMENT_RATE
  • AD_EXCHANGE_VIDEO_AUTO_PLAY
  • AD_EXCHANGE_VIDEO_CLICK_TO_PLAY
  • AD_EXCHANGE_VIDEO_COLLAPSE
  • AD_EXCHANGE_VIDEO_COMPLETE
  • AD_EXCHANGE_VIDEO_COMPLETION_RATE
  • AD_EXCHANGE_VIDEO_DROPOFF_RATE
  • AD_EXCHANGE_VIDEO_EXPAND
  • AD_EXCHANGE_VIDEO_FULL_SCREEN
  • AD_EXCHANGE_VIDEO_MIDPOINT
  • AD_EXCHANGE_VIDEO_MUTE
  • AD_EXCHANGE_VIDEO_PAUSE
  • AD_EXCHANGE_VIDEO_QUARTILE_1
  • AD_EXCHANGE_VIDEO_QUARTILE_3
  • AD_EXCHANGE_VIDEO_RESUME
  • AD_EXCHANGE_VIDEO_REWIND
  • AD_EXCHANGE_VIDEO_SKIPPED
  • AD_EXCHANGE_VIDEO_START
  • AD_EXCHANGE_VIDEO_TOTAL_ERROR_RATE
  • AD_EXCHANGE_VIDEO_TOTAL_VAST_ERROR_COUNT
  • AD_EXCHANGE_VIDEO_TRUEVIEW_SKIP_RATE
  • AD_EXCHANGE_VIDEO_TRUEVIEW_VIEWS
  • AD_EXCHANGE_VIDEO_TRUEVIEW_VTR
  • AD_EXCHANGE_VIDEO_UNMUTE
  • AD_EXCHANGE_VIDEO_VAST2_ERROR_COUNT
  • AD_EXCHANGE_VIDEO_VAST_ERROR_100_COUNT
  • AD_EXCHANGE_VIDEO_VAST_ERROR_101_COUNT
  • AD_EXCHANGE_VIDEO_VAST_ERROR_102_COUNT
  • AD_EXCHANGE_VIDEO_VAST_ERROR_200_COUNT
  • AD_EXCHANGE_VIDEO_VAST_ERROR_201_COUNT
  • AD_EXCHANGE_VIDEO_VAST_ERROR_202_COUNT
  • AD_EXCHANGE_VIDEO_VAST_ERROR_203_COUNT
  • AD_EXCHANGE_VIDEO_VAST_ERROR_300_COUNT
  • AD_EXCHANGE_VIDEO_VAST_ERROR_301_COUNT
  • AD_EXCHANGE_VIDEO_VAST_ERROR_302_COUNT
  • AD_EXCHANGE_VIDEO_VAST_ERROR_303_COUNT
  • AD_EXCHANGE_VIDEO_VAST_ERROR_400_COUNT
  • AD_EXCHANGE_VIDEO_VAST_ERROR_401_COUNT
  • AD_EXCHANGE_VIDEO_VAST_ERROR_402_COUNT
  • AD_EXCHANGE_VIDEO_VAST_ERROR_403_COUNT
  • AD_EXCHANGE_VIDEO_VAST_ERROR_405_COUNT
  • AD_EXCHANGE_VIDEO_VAST_ERROR_500_COUNT
  • AD_EXCHANGE_VIDEO_VAST_ERROR_501_COUNT
  • AD_EXCHANGE_VIDEO_VAST_ERROR_502_COUNT
  • AD_EXCHANGE_VIDEO_VAST_ERROR_503_COUNT
  • AD_EXCHANGE_VIDEO_VAST_ERROR_600_COUNT
  • AD_EXCHANGE_VIDEO_VAST_ERROR_601_COUNT
  • AD_EXCHANGE_VIDEO_VAST_ERROR_602_COUNT
  • AD_EXCHANGE_VIDEO_VAST_ERROR_603_COUNT
  • AD_EXCHANGE_VIDEO_VAST_ERROR_604_COUNT
  • AD_EXCHANGE_VIDEO_VAST_ERROR_900_COUNT
  • AD_EXCHANGE_VIDEO_VAST_ERROR_901_COUNT
  • AD_SERVER_ALL_REVENUE_GROSS
  • AD_SERVER_CPM_AND_CPC_REVENUE_GROSS

• Removed dimensions:

  • AD_EXCHANGE_ADVERTISER_DOMAIN
  • AD_EXCHANGE_ADVERTISER_NAME
  • AD_EXCHANGE_ADVERTISER_VERTICAL
  • AD_EXCHANGE_AD_LOCATION
  • AD_EXCHANGE_AD_TYPE
  • AD_EXCHANGE_AGENCY
  • AD_EXCHANGE_BID_TYPE_CODE
  • AD_EXCHANGE_BRANDING_TYPE_CODE
  • AD_EXCHANGE_BRANDING_TYPE
  • AD_EXCHANGE_BRAND_NAME
  • AD_EXCHANGE_BUYER_NETWORK_ID
  • AD_EXCHANGE_BUYER_NETWORK_NAME
  • AD_EXCHANGE_CHANNEL_NAME
  • AD_EXCHANGE_COUNTRY_CODE
  • AD_EXCHANGE_COUNTRY_NAME
  • AD_EXCHANGE_CREATIVE_SIZES
  • AD_EXCHANGE_CUSTOM_CHANNEL_CODE
  • AD_EXCHANGE_CUSTOM_CHANNEL_ID
  • AD_EXCHANGE_DATE
  • AD_EXCHANGE_DEAL_ID
  • AD_EXCHANGE_DEAL_NAME
  • AD_EXCHANGE_DEVICE_CATEGORY
  • AD_EXCHANGE_DFP_AD_UNIT_ID
  • AD_EXCHANGE_DFP_AD_UNIT
  • AD_EXCHANGE_DFP_MOBILE_APP_NAME
  • AD_EXCHANGE_DSP_BUYER_NETWORK_NAME
  • AD_EXCHANGE_EXPANSION_TYPE
  • AD_EXCHANGE_INVENTORY_OWNERSHIP
  • AD_EXCHANGE_INVENTORY_SIZE_CODE
  • AD_EXCHANGE_INVENTORY_SIZE
  • AD_EXCHANGE_MOBILE_APP_RESOLVED_ID
  • AD_EXCHANGE_MOBILE_CARRIER_NAME
  • AD_EXCHANGE_MOBILE_DEVICE_NAME
  • AD_EXCHANGE_MOBILE_INVENTORY_TYPE
  • AD_EXCHANGE_MONTH
  • AD_EXCHANGE_NETWORK_PARTNER_NAME
  • AD_EXCHANGE_OPERATING_SYSTEM
  • AD_EXCHANGE_PRICING_RULE_ID
  • AD_EXCHANGE_PRICING_RULE_NAME
  • AD_EXCHANGE_REQUEST_SOURCES
  • AD_EXCHANGE_SITE_NAME
  • AD_EXCHANGE_TAG_CODE
  • AD_EXCHANGE_TAG_NAME
  • AD_EXCHANGE_TARGETING_TYPE_CODE
  • AD_EXCHANGE_TARGETING_TYPE
  • AD_EXCHANGE_TRANSACTION_TYPE_CODE
  • AD_EXCHANGE_TRANSACTION_TYPE
  • AD_EXCHANGE_URL_ID
  • AD_EXCHANGE_URL
  • AD_EXCHANGE_USER_BANDWIDTH_NAME
  • AD_EXCHANGE_VIDEO_AD_DURATION_RAW
  • AD_EXCHANGE_VIDEO_AD_DURATION
  • AD_EXCHANGE_VIDEO_AD_TYPE
  • AD_EXCHANGE_WEB_PROPERTY_CODE
  • AD_EXCHANGE_WEEK

• New columns:

  • AD_EXCHANGE_COST_PER_CLICK
  • AD_EXCHANGE_LIFT_EARNINGS
  • AD_EXCHANGE_MATCHED_REQUEST_CTR
  • AD_EXCHANGE_MATCHED_REQUEST_ECPM
  • AD_EXCHANGE_MATCH_RATE
  • AD_EXCHANGE_TOTAL_REQUESTS
  • AD_EXCHANGE_TOTAL_REQUEST_CTR
  • AD_EXCHANGE_TOTAL_REQUEST_ECPM
  • DROPOFF_RATE
  • VIDEO_TRUEVIEW_SKIP_RATE
  • VIDEO_TRUEVIEW_VIEWS
  • VIDEO_TRUEVIEW_VTR

• New dimensions:

  • ADVERTISER_DOMAIN_NAME
  • ADVERTISER_VERTICAL_NAME
  • AD_LOCATION_ID
  • AD_LOCATION_NAME
  • AD_TYPE_ID
  • AD_TYPE_NAME
  • BANDWIDTH_ID
  • BANDWIDTH_NAME
  • BIDDER_ID
  • BIDDER_NAME
  • BRANDING_TYPE_CODE
  • BRANDING_TYPE_NAME
  • BUYER_NETWORK_ID
  • BUYER_NETWORK_NAME
  • BUYING_AGENCY_NAME
  • CARRIER_ID
  • CARRIER_NAME
  • CHANNEL_NAME
  • COUNTRY_CODE
  • DYNAMIC_ALLOCATION_ID
  • DYNAMIC_ALLOCATION_NAME
  • FIRST_LOOK_PRICING_RULE_ID
  • FIRST_LOOK_PRICING_RULE_NAME
  • INVENTORY_OWNERSHIP_CODE
  • INVENTORY_OWNERSHIP_NAME
  • NETWORK_PARTNER_ID
  • NETWORK_PARTNER_NAME
  • OPERATING_SYSTEM_VERSION_ID
  • OPERATING_SYSTEM_VERSION_NAME
  • PROGRAMMATIC_DEAL_ID
  • PROGRAMMATIC_DEAL_NAME
  • SERVING_RESTRICTION_ID
  • SERVING_RESTRICTION_NAME
  • SITE_NAME
  • TARGETING_TYPE_CODE
  • TARGETING_TYPE_NAME
  • URL_ID
  • URL_NAME
  • VIDEO_AD_DURATION
  • VIDEO_AD_TYPE_ID
  • VIDEO_AD_TYPE_NAME
  • WEB_PROPERTY_CODE

Google Ads

We have upgraded our Google Ads connector to version 10.1 of the Google Ads API. For more information, see Google's v10.1 release note.

Google Cloud Logging

We have renamed our Google Stackdriver service to Google Cloud Logging. This name change applies to the Fivetran dashboard and our documentation.

Instagram Business

We have upgraded our Instagram Business connector from version 13.0 to 14.0 of the Graph API. Learn more about the changes in the Facebook API v14.0 changelog.

Intercom

We now re-import the COMPANY_HISTORY and COMPANY_TAG_HISTORY tables once a week. Previously, we re-imported the COMPANY_HISTORY and COMPANY_TAG_HISTORY tables once a day. We are gradually rolling out the new feature to all existing connectors.

Jira

Now we use webhooks to keep the sprints in the up-to-date state in the destination.

NOTE: To use webhooks, you must have the Jira Administrators global permission.

As an alternative, we have added the SPRINT table to the BOARD group of tables, and now we sync all sprints entirely for particular board once a day.

Kantata

We now re-sync the following tables to capture deleted records:

• WORKSPACE_ALLOCATION and EXPENSE - once a day
• STORY_ALLOCATION_DAY table - once a week

LinkedIn Company Pages

We have removed statistic values used for ID calculation of lifetime statistic entities. We update statistic records in the destination when their values change instead of adding new values.

Marketo

We now capture deletes for the following tables:

• CAMPAIGN
• PROGRAM
• PROGRAM_COST
• PROGRAM_TAG

We have added the _fivetran_deleted system column to the above tables.

Mixpanel

You can now exclude the CAMPAIGNS child table from your syncs. On your Connector Details page, go to the Schema tab and deselect the table.

NOTE: If you exclude the table and later want to sync the table, perform a complete table re-sync of the parent PEOPLE table, because we don't maintain the state of the child table due to a lack of timestamp support in the source.

We now display tables on the Schema tab in a nested parent-child format. If you want to sync a child table, you must include the parent table in the sync.

MySQL

Fivetran Teleport Sync is now generally available. Learn more in our Fivetran Teleport Sync for MySQL documentation.

PostgreSQL

Fivetran Teleport Sync is now available in beta. Learn more in our Fivetran Teleport Sync for PostgreSQL documentation.

Salesforce Marketing Cloud

We now support syncing HTML-based emails.

Shopify

We have upgraded our Shopify connector from version 2021-07 to 2022-01 of the Shopify API. For more information, see Shopify's 2022-01 release notes. We have removed the value_type column from the METAFIELD table. Use the type column in place of the value_type column in your queries.

Zoho CRM

We now capture deletes for the CONTACTS module. We sync all the historical deletes for the module, and you may observe a one-time increased Monthly Active Rows (MAR) consumption and higher API quota usage.

REST API Improvements

Adobe Analytics

We have updated the Adobe Analytics connector's REST API configuration parameters to support separate configuration for each table. Learn more in our Adobe Analytics Connector Config documentation.

Google Campaign Manager 360

In the sync mode parameter of the Google Campaign Manager 360 API configuration, we replaced the following:

• AllAccounts value with ALL_PROFILES
• SpecificAccounts value with SPECIFIC_PROFILES