Databricks API Configuration
Request
POST https://api.fivetran.com/v1/destinations
{
"group_id": "group_id",
"service": "databricks",
"region": "GCP_US_WEST1",
"time_zone_offset": "+3",
"trust_certificates": true,
"trust_fingerprints": true,
"run_setup_tests": true,
"daylight_saving_time_enabled": true,
"hybrid_deployment_agent_id": "hybrid_deployment_agent_id",
"private_link_id": "private_link_id",
"networking_method": "Directly",
"proxy_agent_id": "proxy_agent_id",
"config": {
"auth_type": "PERSONAL_ACCESS_TOKEN | OAUTH2",
"create_external_tables": true,
"storage_account_name": "string",
"connection_type": "Directly | PrivateLink",
"aws_secret_access_key": "string",
"catalog": "string",
"storage_account_key": "string",
"cloud_provider": "AZURE | GCP | AWS",
"http_path": "sql/protocolv1/o/2873663545782684434-15262-272625-fives565",
"oauth2_secret": "your_oauth_secret",
"server_host_name": "87a8z-3da23-3da8d-cloud.databricks.com",
"s3_bucket_auth_type": "IAM_ROLE | IAM_USER",
"bucket": "string",
"external_storage_cloud_provider": "AZURE | GCP | AWS",
"aws_access_key_id": "string",
"port": 443,
"bucket_region": "string",
"create_external_volumes": true,
"azure_storage_account_auth_type": "Storage Account Key",
"oauth2_client_id": "your_oauth_client_id",
"external_volume_location": "s3://bucket/prefix_path",
"personal_access_token": "your_databricks_personal_access_token",
"external_location": "/some_external_location"
}
}
Config parameters
Name | Description |
---|---|
auth_type | Authentication type |
create_external_tables | Whether to create external tables |
storage_account_name | Your storage account name |
connection_type | |
aws_secret_access_key | Your user's secret access key |
catalog | Catalog name |
storage_account_key | Your storage account key |
cloud_provider | Databricks deployment cloud |
http_path | HTTP path |
oauth2_secret | OAuth 2.0 secret |
server_host_name | Server name |
s3_bucket_auth_type | Authentication method for the S3 bucket you want to use as the external staging for Hybrid Deployment. |
bucket | Your bucket |
external_storage_cloud_provider | |
aws_access_key_id | Your user's access key ID |
port | Server port number |
bucket_region | Your bucket's region |
create_external_volumes | Specifies whether you want Fivetran to create external volumes for unstructured data files. |
azure_storage_account_auth_type | Authentication method for the Azure container you want to use as the external staging for Hybrid Deployment. |
oauth2_client_id | OAuth 2.0 client ID |
external_volume_location | Specifies the external volume path where you want Fivetran to create the unstructured files. |
personal_access_token | Personal access token |
external_location | External location to store Delta tables. Default value: "" (null). By default, the external tables will reside in the /{schema}/{table} path, and if you specify an external location in the {externalLocation}/{schema}/{table} path. |