Bring Your Own GCS Bucket

After following the steps below, you may enter the following information in the Activation Source creation wizard:

1. Bucket Name
2. Project ID
3. Service Account Email
4. Service Account Key

Initial setup

1. Create a GCS Service Account

Log into Google Cloud Console and navigate to IAM & Admin -> Service Accounts

1. Click Create Service Account
2. Enter a Service Account Name
3. Keep the generated Service Account ID, generate a new one, or enter your own
4. Copy the Service Account Email
5. Configure the project permissions for the Service Account

2. Generate a Service Account Key

1. Log into Google Cloud Console and navigate to IAM & Admin -> Service Accounts

2. Click the name of your Service Account

   

3. Open the Keys tab and click Add Key -> Create New Key

   

4. Choose the key type "JSON" and click Create

   

5. Save the generated .json file in a secure location.

3. Create a GCS Bucket

1. Log into Google Cloud Console and navigate to your Project

2. Go to Cloud Storage -> Buckets and click Create

   

3. Give your bucket a name

4. Configure the bucket settings

   1. Location: choose the same location setting as your BigQuery project
   2. Storage Class: Standard
   3. Check Enforce Public Access Prevention
   4. Access Control: Uniform
   5. Leave versioning, and encryption on defaults.
   6. Lifecycle Policy: Lifecycle rules should be enabled to:
      1. Action: Delete object
      2. Object condition: 14+ days since object was created Name matches prefix 'sync-unloads/'.

5. Once the bucket has been created, navigate to Permissions

6. Grant your Service Account the permissions

   1. Storage Object User
   2. Storage Object Creator

4. Finish up

Provide the bucket name, project ID, and service account credentials to the Activation Source creation wizard. Press "Connect" to validate the connection. The wizard will continue only if the provided bucket is configured correctly.

Configuring a bucket for temporary warehouse unloads from BigQuery

When creating your BigQuery connection

1. In Activations, create a connection to BigQuery using the appropriate Project ID and Location.
2. Paste the contents of the Service Account Key JSON file (from above) into the Service Account Key JSON (Optional) box.
3. Click Connect and Confirm

   1. Note: There is no need to copy and run the GCP Console commands

      provided in-app when following this setup guide. Please ignore them.

Ongoing maintenance

After you set up your bucket, you don't need to take further action. Fivetran will automatically create and remove files as needed, and the lifecycle retention policies you defined in the previous step will automatically remove any stale data in the unlikely event that we fail to do so.

We strongly recommend that once set up, you do not modify the bucket or any of the keys it contains in any way. Adding, removing, modifying, or renaming data in your Activations bucket is not supported and will likely cause activation syncs to fail. In addition, the Activations bucket should not be simultaneously employed for any other purposes.

If you need to rename your bucket or service account, please contact Fivetran Support.