Directory Tool (Live Query for Google BigQuery)
Use the Directory tool to return a list of files from a cloud storage location along with file details.
Use this tool when you want to identify available files and review file metadata before processing them in a workflow with Google BiqQuery tools.
Tool Availability
The Directory tool is available in the In/Out tool palette.
Before using this tool...
From a Cloud Native workflow, go to Options.
Verify that Enable LiveQuery is enabled.
Verify that the Selected Connection displays a BigQuery connection.
Tool Configuration
Path to Data
In Path to Data, enter a Google Cloud Storage wildcard path to the files that you want to read.
For example:
gs://bucket/path/*.pdf
Output
The tool outputs the file paths and associated metadata for the files matching the wildcard path you entered.
Permission Required
To use this tool, assign the bigquery.connections.delegate permission to the BigQuery project or credentials (service account key or OAuth):