Skip to content

BigQuery slot computation: double counting #4

@sourygna-cts

Description

@sourygna-cts

When doing some aggregations to compute the amount of slots per unit of time (like in the queries: query_slots_per_second.sql & slots_by_second.sql), then the following filter should be added in the WHERE condition:

statement_type != 'SCRIPT'

Otherwise, the amount of slots will be counted twice in some situations. This is mentioned in this doc https://cloud.google.com/bigquery/docs/information-schema-jobs-timeline :

For script jobs, the parent job also reports the total slot usage from its children jobs. To avoid double counting, use WHERE statement_type != "SCRIPT" to exclude the parent job.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions