Docs » Integrations Guide » Integrations Reference » Google BigQuery

../../_images/integration_googlebigquery.png Google BigQuery ๐Ÿ”—

DESCRIPTION ๐Ÿ”—

Use SignalFx to monitor Google BigQuery via Google Cloud Platform.

FEATURES ๐Ÿ”—

Built-in dashboards ๐Ÿ”—

  • BigQuery Overview: Overview of project level metrics for Google BigQuery.

    ../../_images/google_bigquery.png

INSTALLATION ๐Ÿ”—

To access this integration, connect to Google Cloud Platform.

USAGE ๐Ÿ”—

Interpreting Built-in dashboards ๐Ÿ”—

BigQuery Overview

  • Queries Count - Number of in flight queries.
  • Queries Trend - Shows the trend of number of in flight queries.
  • Scanned Bytes / min - Number of bytes scanned per minute.
  • Average Execution Time - Distribution of queries execution times in seconds.
  • Slots Allocated vs. Slots Available - Number of BigQuery slots currently allocated for the project vs total number of BigQuery slots available for the project.
  • Scanned Bytes Billed / min - Amount of Scanned bytes billed per minute.
  • Top Uploaded Bytes Billed per Table - Tables with top 5 uploaded bytes billed per minute.
  • Top Stored Bytes per Table - Tables with top 5 stored bytes.
  • Top Uploaded Bytes per Table - Tables with top 5 uploaded bytes.
  • Table Count - Total number of tables in the project.
  • Rows Uploaded / min per Table - List number of rows uploaded per min aggregated by table.

METRICS ๐Ÿ”—

Metric Name Description Type
query/count Query count gauge
query/execution_times Query execution times gauge
query/scanned_bytes Scanned bytes counter
query/scanned_bytes_billed Scanned bytes billed counter
query/statement_scanned_bytes Statement scanned bytes counter
query/statement_scanned_bytes_billed Statement scanned bytes billed counter
slots/allocated Slots used by project, reservation, and job type gauge
slots/allocated_for_project Slots used by project gauge
slots/allocated_for_project_and_job_type Slots used by project and job type gauge
slots/allocated_for_reservation Slots used by project in reservation gauge
slots/total_allocated_for_reservation Slots used across projects in reservation gauge
slots/total_available Total slots gauge
storage/stored_bytes Stored bytes gauge
storage/table_count Table count gauge
storage/uploaded_bytes Uploaded bytes counter
storage/uploaded_bytes_billed Uploaded bytes billed counter
storage/uploaded_row_count Uploaded rows counter

query/count ๐Ÿ”—

gauge

In flight queries.

query/execution_times ๐Ÿ”—

gauge

Distribution of queries execution times.

query/scanned_bytes ๐Ÿ”—

counter

Scanned bytes.

query/scanned_bytes_billed ๐Ÿ”—

counter

Scanned bytes billed.

query/statement_scanned_bytes ๐Ÿ”—

counter

Scanned bytes broken down by statement type.

query/statement_scanned_bytes_billed ๐Ÿ”—

counter

Scanned bytes billed broken down by statement type.

slots/allocated ๐Ÿ”—

gauge

Number of BigQuery slots currently allocated for project. Slot allocation can be broken down based on reservation and job type.

slots/allocated_for_project ๐Ÿ”—

gauge

Number of BigQuery slots currently allocated for query jobs in the project.

slots/allocated_for_project_and_job_type ๐Ÿ”—

gauge

Number of BigQuery slots currently allocated for the project and job type.

slots/allocated_for_reservation ๐Ÿ”—

gauge

Number of BigQuery slots currently allocated for project in the reservation.

slots/total_allocated_for_reservation ๐Ÿ”—

gauge

Number of BigQuery slots currently allocated across projects in the reservation. This is only reported while the project is using slots in the reservation.

slots/total_available ๐Ÿ”—

gauge

Total number of BigQuery slots available for the project.

storage/stored_bytes ๐Ÿ”—

gauge

Number of bytes stored.

storage/table_count ๐Ÿ”—

gauge

Number of tables.

storage/uploaded_bytes ๐Ÿ”—

counter

Uploaded bytes.

storage/uploaded_bytes_billed ๐Ÿ”—

counter

Uploaded bytes billed.

storage/uploaded_row_count ๐Ÿ”—

counter

Uploaded rows.

For more information about the metrics emitted by Google BigQuery, visit the serviceโ€™s metric page at https://cloud.google.com/monitoring/api/metrics#gcp-bigquery