Databricks

Select Databricks Bulk Loader (Avro) or DatabricksBulk Loader (CSV).To write a table with field names that total more than 4000 characters, use CSV instead of Avro. The delimiter used for CSV is the start of heading (SOH) character.

Select the Connection String dropdown, and then select New Databricks connection.

Select an existing ODBC data source, or select ODBC Admin to create one.

Enter a username and password. These fields cannot be blank.

Enter the Databricks URL

https://abc-abc123-123a.cloud.databricks.com

Select Databricks Delta Lake Bulk Loader (Avro) or Databricks Delta Lake Bulk Loader (CSV).To write a table with field names that total more than 4000 characters.

Select the Connection String dropdown, and then select New database connection.

Select an existing ODBC data source, or select ODBC Admin to create one.

Enter a username and password. These fields cannot be blank. Alteryx supports personal access tokens. The username is “token”. The password is the personal access token.

Select a Staging Method (supported for both AWS and Azure):

1. For Amazon S3

   1. Enter the AWS Access Key and Secret Key to authenticate;

   2. Select an Endpoint or leave as Default;

   3. Select Use Signature V4 for Authentication;

   4. Select the level of Server-Side Encryption needed, None is the default;

   5. Select a Bucket Name to use as the staging location.

      With Designer 2024.1 Databricks Bulk loader supports AWS IAM (Identity and Access Management) authentication.

2. For Azure ADLS

   Important

   For bulk loading for Azure there is only ADLS Gen 2 support.

   1. Select the ADLS Container;

   2. Enter the Shared Key;

   3. Enter the Storage Account;

   4. Enter an optional Temp Directory. When entering the Temp Directory, don’t repeat the Container name.

      example

      If the folder structure is Container/MyTempFolder/TempTables, only enter “MyTempFolder/TempTables”.

      If the directory entered here does not already exist, Alteryx will create one.

      Alteryx will create one sub-folder with the table name for each table that is staged.

3. Select OK to apply.

   With Designer 2023.2, Databricks Bulk loader supports Azure AD authentication for ADLS staging. This feature improves the security of Databricks Bulk Loader by allowing organizations to granularly manage access to individual containers within a storage account.

   To learn more about how to use Azure AD authentication for ADLS staging with Databricks Bulk Loader, refer to this Community page.