SDK Connection Syncs Are Repeatedly Rescheduled

Issue

My SDK connection's syncs are repeatedly rescheduled rather than completing successfully.

Environment

Fivetran Connector SDK

Resolution

Refactor your SDK connector code to use less memory. Usually this can be done by introducing a loop in your connector code that does the following:

1. Reads a chunk of data from your source.
2. Process the data chunk as needed.
3. Delivers the data chunk to Fivetran.
4. Checkpoints to preserve the sync state.
5. Starts a new iteration with the next chunk of data.

Follow our best practices for large data sets and review our examples for options on how to implement this type of looping in your code.

Cause

The cause of the issue may be the code structure and logic that makes the machine executing your Connector SDK code to run out of memory. See the System Resources documentation section to learn what system resource are available to your SDK connection during a sync.