Skip to main content

Databricks Unity Catalog Volumes Configuration

Alteryx Analytics Cloud (AAC) now supports Unity Catalog volumes as alternative to the personal staging location that has been deprecated by Databricks. The Unity Catalog can now be used as internal staging location for writing data to Databricks from Alteryx Analytics Cloud (AAC).

To configure Databricks Unity Catalog as a staging location for your AACAAC instance, as admin complete the following steps:

  1. Generate a Personal Access Token for Databricks admin;

  2. Create a new Unity Catalog volume to be assigned to your AACAAC Databricks workspace;

  3. Create a new Databricks workspace in your AACAAC account;

  4. Use your newly created AACAAC Databricks workspace to configure a new connection.

Step 1: Generate a Personal Access Token for Databricks Admin

  1. Navigate to your Databricks account, select your user icon at the top right corner and select settings.

  2. Select Developer.

  3. Next to Access tokens, select Manage.

  4. Select Generate new token.

  5. Copy and save the token value.

Step 2: Create New Unity Catalog Volume to be Assigned to Your AACAAC Databricks Workspace

  1. As account admin, go to your Databricks workspace.

  2. Navigate to catalog, choose a catalog and a schema, and select Create Volume.

  3. Specify the volume name, select the volume type, provide descriptive name (for example "aacp_volume"), and select Create.

  4. Save the volume name, you will need it in next steps.

Step 3: Create New Databricks Workspace in Your AACAAC Account

  1. As AACAAC admin, navigate to your AACAAC account, select your user icon and choose workspace admin.

  2. Navigate to Databricks tab and select New workspace.

  3. Specify your Databricks workspace url and the personal access token you collected in previous step and select Authenticate.

  4. In the new workspace configuration, provide a descriptive name for your Databricks workspace in AACAAC, and provide required configuration.

  5. Select the SQL warehouse.

  6. In the Unity Catalog Volumes configuration, perform the following steps to configure your AACAAC workspace with existing volume:

    • Select Existing volumes option.

    • Select the catalog name of the unity catalog which you created your volume in.

    • Select the schema name which you created your volume in.

    • Select the volume name you specified in the Step 2 of this guide.

  7. Optionally: If you want to create a new volume for your AACAAC workspace, you may choose to create a new Volume. In the Unity Catalog Volumes configuration, perform the following steps to configure your AACAAC workspace:

    • Select the catalog name of the unity catalog which you created your volume in.

    • Select the schema name which you created your volume in.

    • Provide descriptive name for your Unity Catalog Volume.

  8. Go through remaining configuration and select Save.

Step 4: Use the New AACAAC Databricks Workspace to Configure a New Connection

  1. As an AACAAC workspace user, navigate to Connections.

  2. Select Create connection and choose Databricks from the list of connections.

  3. Set a descriptive connection name, select the Databricks workspace your admin has configured for you and provide your Personal Access Token (PAT).

  4. Select Test connection to validate the connection.

  5. Select Create to save the connection.

You can now use your newly created Databricks connection in AACAAC workflow.