Skip to main content

Google BigQuery Input Tool Icon Google BigQuery Input Tool

Use Google BigQuery Input to query a table from Google BigQuery and read it into Designer. Visit Google BigQuery for information about known limitations. More information about Google BigQuery can be found on the Google Big Query Documentation site.

Important

The Google BigQuery Input tool is deprecated. You can still use the Input Data tool  to connect to Google BigQuery.

Sign In to Google BigQuery

You can log in to Google BigQuery with service-to-service or end-user credentials.

Use Service-to-service authentication over End user authentication whenever possible. Managing distinct keys for various applications authenticating for the same service account allows the revocation of access for a specific application without requiring the other applications to update their authentication credentials.

Note

Contact your Google Cloud Administrator for help with your Google BigQuery credentials.

Service-to-Service Authentication

Service-to-service authentication requires a Google Service Account File, also known as a service account JSON key file.

You can obtain a service account JSON key file from the Google Cloud Console or you can create a new key for an existing service account. You can find more information about Google BigQuery on the Google Big Query Documentation site under Creating and Managing Service Account Keys.

Service-to-Service Authentication

  1. In Authentication mode, select Service-to-Service.

  2. Click Select a file to select your Google service account file.

  3. In Open File, browse to and select the JSON file that contains your Google service account key.

    Selecting the file enters your Google Cloud Service account key ID and Service account email, and then displays the BigQuery Table Input Config window. If your key file is invalid, an error displays.

End-User Authentication

  1. In Authentication mode, select End user.

  2. Enter your Client ID and Client Secret.

  3. Select Log in.

  4. In Sign in with Google, enter your Google email and password then select Allow to approve the connector's permission to access Google BigQuery on your behalf.

  5. Select Next.

Configure the Tool

  1. In BigQuery Table Input Config, select Select table. Designer displays the tables you have access to.

    Note

    While the table list within the BigQuery Input Tool will show you views and external tables available within the project, these can currently only be queried with the custom query option using a SELECT statement. An attempt to query a view or external table by selecting from the table list view will result in an error.

  2. Select a project, expand a dataset, and then select a BigQuery table. Once you select a table, Designer displays the table's fully-qualified identifier.

    • To refresh the metadata, select the refresh icon.

    • Select Change table to select a different table.

  3. Select options.

    • Limit the number of results returned: Sets the number of rows in the report to return.

    • Use a custom query: Select a SQL type and then Select a project to query. Enter your custom query including any LIMIT clause.

    • Infer max repeated record limit: Not available with custom query. Select this option and then indicate a Max field length to set the repeated record limit to the maximum number of repeated records in the results returned from your Google BigQuery table. If you limit the number of records, then Designer will only inspect that set of records to infer the max repeated record limit.

    • Pre SQL Statement: Enter a custom query that will run in BigQuery before the main query begins. By default the value is "Empty" so that no Pre SQL Statement will run.

    • Post SQL Statement: Enter a custom query that will execute after the main query finishes. By default the value is "Empty" so that no Post SQL Statement will run.

  4. Run the workflow.

In this section: