Skip to main content

Databricks Unity Catalog Volumes Configuration

Alteryx Analytics Cloud (AAC) now supports Unity Catalog volumes as alternative to the personal staging location that has been deprecated by Databricks. The Unity Catalog can now be used as internal staging location for writing data to Databricks from Alteryx Analytics Cloud (AAC).

To configure Databricks Unity Catalog as a staging location for your AAC instance, as admin complete the following steps:

  1. Generate a Personal Access Token for Databricks admin;

  2. Create a new Unity Catalog volume to be assigned to your AAC Databricks workspace;

  3. Create a new Databricks workspace in your AAC account;

  4. Use your newly created AAC Databricks workspace to configure a new connection.

Step 1: Generate a Personal Access Token for Databricks Admin

  1. Navigate to your Databricks account, select your user icon at the top right corner and select settings.

  2. Select Developer.

  3. Next to Access tokens, select Manage.

  4. Select Generate new token.

  5. Copy and save the token value.

Step 2: Create New Unity Catalog Volume to be Assigned to Your AAC Databricks Workspace

  1. As account admin, go to your Databricks workspace.

  2. Navigate to catalog, choose a catalog and a schema, and select Create Volume.

  3. Specify the volume name, select the volume type, provide descriptive name (for example "aacp_volume"), and select Create.

  4. Save the volume name, you will need it in next steps.

Step 3: Create New Databricks Workspace in Your AAC Account

  1. As AAC admin, navigate to your AAC account, select your user icon and choose workspace admin.

  2. Navigate to Databricks tab and select New workspace.

  3. Specify your Databricks workspace url and the personal access token you collected in previous step and select Authenticate.

  4. In the new workspace configuration, provide a descriptive name for your Databricks workspace in AAC, and provide required configuration.

  5. Select the SQL warehouse.

  6. In the Unity Catalog Volumes configuration, perform the following steps to configure your AAC workspace with existing volume:

    • Select Existing volumes option.

    • Select the catalog name of the unity catalog which you created your volume in.

    • Select the schema name which you created your volume in.

    • Select the volume name you specified in the Step 2 of this guide.

  7. Optionally: If you want to create a new volume for your AAC workspace, you may choose to create a new Volume. In the Unity Catalog Volumes configuration, perform the following steps to configure your AAC workspace:

    • Select the catalog name of the unity catalog which you created your volume in.

    • Select the schema name which you created your volume in.

    • Provide descriptive name for your Unity Catalog Volume.

  8. Go through remaining configuration and select Save.

Step 4: Use the New AAC Databricks Workspace to Configure a New Connection

  1. As an AAC workspace user, navigate to Connections.

  2. Select Create connection and choose Databricks from the list of connections.

  3. Set a descriptive connection name, select the Databricks workspace your admin has configured for you and provide your Personal Access Token (PAT).

  4. Select Test connection to validate the connection.

  5. Select Create to save the connection.

You can now use your newly created Databricks connection in AAC workflow.