Error: Increase Oplog Retention Period

Issue

The following error appears on the Fivetran dashboard:

Increase Oplog Retention Period

Environment

Connector: MongoDB

Resolution

To resolve this issue, follow the steps below:

Increase oplog size or connection sync frequency

Choose either of the following options:

• In MongoDB, adjust your oplog size to support the required volume of data sufficiently. We recommend increasing the size to retain seven days worth of data. For more information, see step 4 of our MongoDB setup guide.

• In Fivetran, limit the volume of data processed during each sync by increasing your connection's sync frequency documentation:

  i. In Fivetran, go to your MongoDB connection page.

  ii. Select the Setup tab.

  iii. Update the value in the Sync frequency drop-down menu.

Trigger a historical re-sync

1. In Fivetran, go to your MongoDB connection page.
2. Select the Setup tab.
3. Click Re-sync all historical data.
4. In the confirmation pop-up window, click Re-sync Connection.

To learn more, see How to Trigger Historical Re-Syncs for Fivetran Connections and Tables.

Cause

This issue occurs when the oplog and stream cursors expire between two syncs. This may happen because the oplog size isn't sufficient to support the required volume of data.