Apache Spark on Microsoft Azure HDInsight

Enter the Storage URL for the storage (ADLS Gen1 Storage) to use with your connection. The HTTPS protocol is required for this URL.

Enter the Tenant ID GUID. This is found in the properties under your Microsoft Azure Active Directory > Properties > Directory ID.

Enter the Client ID. In Microsoft Azure, this information is also known as an Application ID. This is found in the properties under your Microsoft Azure Active Directory > App registrations. You can find more information on the Microsoft Documentation > Get application ID and authentication key page.

Enter the Client Secret. In Microsoft Azure, this information is generated as an authentication key string from the Application ID. You can find more information on the Microsoft Azure Integrating applications with Azure Active Directory page.

Set the Poll Interval (ms), the time between checks from Alteryx for Apache Spark code execution requests. The default is 1,000 ms, or 1 second.

Set the Wait Time (ms), the time that Alteryx waits for execution requests to complete. Operations that take longer than the set wait time result in a time out error. The default is 60,000 ms, or 1 minute.

The Apache Spark Configuration Options customize the created Apache Spark context and allow advanced users to override the default Apache Spark settings.

Select the + icon to add another row to the configuration options table.

Select the save icon to save the current advanced settings as a JSON file. The file can then be loaded into the advanced settings of another connection.

Select the open icon to load a JSON file into the configuration options table.