MongoDB MAR Management
Connector sync strategy and options
- All MongoDB replication is done by utilizing the system generated
_idprimary key field in conjunction withchangestreamfrom the systems Oplog. - The initial sync will replicate the selected Collections into your destination. This initial historical sync does NOT contribute toward MAR and is provided free for all new connections.
- If additional Collections need to be introduced at a later time, their initial sync will not contribute to MAR.
What contributes towards MAR?
There are 5 primary actions that will contribute to MAR:
- A new document is added to an existing collection.
- A document is removed from an existing collection.
- A field is updated in an existing document.
- A field is removed in an existing document.
- A field is added to an existing document.
Managing MAR for your MongoDB connection
- Initial syncs do not contribute to your Monthly Active Row count.
- Historical re-syncs and incremental syncs do contribute to MAR. A full re-sync completely overwrites the data in your destination with new data from your source.
- Historical re-syncs can be triggered by BOTH the customer or Fivetran under explicit guidance from the customer.
- Monitoring data integrity issues and performing re-syncs to fix them when needed is part of the Fivetran managed service. We only perform, or ask you to perform, re-syncs when it’s absolutely necessary.
- If a collection was imported initially, then unchecked and left for a period of time that exceeds the Oplog retention period, the collection will need to be re-synced. This re-sync will generate MAR.
- Ensure that your Oplog retention period/size is set appropriately to allow for enough Oplog to incrementally sync collections in the event of a service outage or transient network connectivity error. In the event that the connection fails to connect to your instance for a period longer than the Oplog retention period (or at which point the Oplog increases above the specified size), we will need to initiate a re-sync, which will increase MAR.
- We recommend that you do not pause your MongoDB connection for a period that is longer than the Oplog retention period/size. Doing so will require a re-sync, which will increase MAR.