Why Do Connection Syncs Not Run Until Their dbt Transformations Are Complete?

Question

Why do my connection's syncs only run once the dbt transformations associated with that connection are complete?

Environment

• Transformation for dbt Core
• Schedule type: Integrated or Custom

Answer

When you use integrated or custom scheduling, Fivetran starts a new pipeline after the previous one ends. Combining a connection sync and transformation run in one pipeline may cause perceived sync delays.

For example, if a connection is scheduled to sync every hour but its downstream transformation takes two hours, we begin the next sync only after the transformation finishes.