Data Intelligence Tool
Use the Data Intelligence tool to analyze, classify, and extract information from text using Databricks AI functions.
The Data Intelligence tool provides these functions:
Sentiment Analysis
Classify
Extract
Configure the Tool
Use these options to configure the Data Intelligence tool.
AI Function
From AI Function, select the function that you want to use:
Sentiment Analysis: Analyze the sentiment of text in a selected column.
Classify: Classify text based on specified labels.
Extract: Extract specified entities from text.
The available configuration options depend on the AI function that you select.
Sentiment Analysis
To configure Sentiment Analysis:
From Column to Analyze, select the column that contains the text that you want to analyze.
In Output Column Name, enter a name for the column that contains the sentiment analysis result.
Classify
To configure Classify:
From Column to Classify, select the column that contains the text that you want to classify.
Use Label to specify the labels that you want to use to classify the text. You must add at least 2 labels and can add up to 20 labels.
For example, to classify text by urgency, add the labels urgent and not_urgent.
In Output Column Name, enter a name for the column that contains the classification result.
Extract
When you select Extract:
From Column to Extract, select the column that contains the text from which you want to extract entities.
Use Label to specify the entities that you want to extract from the selected column. You can add up to 20 labels.
For example, when you process invoice data, add vendor_name, invoice_id, and total_amount as labels.
In Output Column Name, enter a name for the column that contains the extracted result.
Databricks Functions
The Data Intelligence tool uses these Databricks AI functions:
Function | Databricks Function |
|---|---|
Sentiment Analysis |
|
Classify |
|
Extract |
|
Queries for these functions run directly on Databricks.
Limitations
The Data Intelligence tool uses Databricks AI functions. These functions require a supported Databricks warehouse.