How Often Is My Data Ingested From Adobe Analytics Data Feed?

Use Case

The data ingested by my Adobe Analytics Data Feed connector lands at sporadic times in my destination.

Recommendations

We recommend the following:

• To ensure data is ingested as soon as it is available, configure the sync frequency of the connector to be as short as possible.
• To ensure data integrity, configure the delivery format of the Hit data to be at least Daily.

Context

The connector uses Adobe's Data Feed functionality to ingest hit data from the cloud storage bucket you have configured for the files to land in. Data Feed data is written based on the schedule you apply:

• Hourly - Files are dropped as multiple files on an hourly basis
• Daily - Files are dropped as multiple files on a daily basis

However, if you configure both Hourly and Daily files, Fivetran utilizes the Daily files option by the end of the day to ensure the integrity of the data.

Considerations

• The connector uses a composite primary key, so any long-running sessions that might span over multiple files are always reconciled.

• All files - whether they’re hourly or daily - have a specific naming convention with a date and timestamp that Fivetran can cursor on, ensuring there is never a conflict in the data being ingested.