Skip to content

bench/rttanalysis: TestBenchmarkExpectationShard2 failed #170238

@cockroach-teamcity

Description

@cockroach-teamcity

bench/rttanalysis.TestBenchmarkExpectationShard2 failed with artifacts on master @ 0df8f1e51989a24003edd76235320b0ab4909d22:

    validate_benchmark_data.go:120: success: expected ORMQueries/pg_attribute to perform KV lookups in [3, 3], got 3
    validate_benchmark_data.go:120: success: expected ORMQueries/introspection_description_join to perform KV lookups in [5, 5], got 5
    validate_benchmark_data.go:120: success: expected ORMQueries/has_schema_privilege to perform KV lookups in [0, 0], got 0
    validate_benchmark_data.go:120: success: expected ORMQueries/has_sequence_privilege to perform KV lookups in [0, 0], got 0
    validate_benchmark_data.go:120: success: expected ORMQueries/has_table_privilege to perform KV lookups in [0, 0], got 0
    validate_benchmark_data.go:120: success: expected ORMQueries/has_column_privilege_using_attnum to perform KV lookups in [0, 0], got 0
    validate_benchmark_data.go:120: success: expected ORMQueries/has_column_privilege_using_column_name to perform KV lookups in [0, 0], got 0
    validate_benchmark_data.go:120: success: expected ORMQueries/pg_my_temp_schema to perform KV lookups in [1, 1], got 1
    validate_benchmark_data.go:120: success: expected ORMQueries/pg_my_temp_schema_multiple_times to perform KV lookups in [1, 1], got 1
    validate_benchmark_data.go:120: success: expected ORMQueries/pg_is_other_temp_schema to perform KV lookups in [6, 6], got 6
    validate_benchmark_data.go:120: success: expected ORMQueries/pg_is_other_temp_schema_multiple_times to perform KV lookups in [6, 6], got 6
    validate_benchmark_data.go:120: success: expected ORMQueries/information_schema._pg_index_position to perform KV lookups in [3, 3], got 3
    validate_benchmark_data.go:120: success: expected ORMQueries/hasura_column_descriptions to perform KV lookups in [5, 5], got 5
    validate_benchmark_data.go:120: success: expected ORMQueries/hasura_column_descriptions_modified to perform KV lookups in [4, 4], got 4
    validate_benchmark_data.go:120: success: expected ORMQueries/hasura_column_descriptions_8_tables to perform KV lookups in [19, 19], got 19
    validate_benchmark_data.go:120: success: expected ORMQueries/prisma_column_descriptions_updated to perform KV lookups in [4, 4], got 4
    validate_benchmark_data.go:120: success: expected ORMQueries/prisma_column_descriptions to perform KV lookups in [5, 5], got 5
    validate_benchmark_data.go:120: success: expected ORMQueries/column_descriptions_json_agg to perform KV lookups in [5, 5], got 5
    validate_benchmark_data.go:120: success: expected ORMQueries/prisma_types_4 to perform KV lookups in [4, 4], got 4
    validate_benchmark_data.go:120: success: expected ORMQueries/npgsql_types to perform KV lookups in [4, 4], got 4
    validate_benchmark_data.go:120: success: expected ORMQueries/npgsql_fields to perform KV lookups in [4, 4], got 4
    validate_benchmark_data.go:120: success: expected ORMQueries/asyncpg_types to perform KV lookups in [3, 4], got 3
    validate_benchmark_data.go:120: success: expected ORMQueries/liquibase_migrations to perform KV lookups in [4, 4], got 4
    validate_benchmark_data.go:120: success: expected ORMQueries/sqlalchemy_indexes to perform KV lookups in [3, 3], got 3
    validate_benchmark_data.go:120: success: expected DropView/drop_1_view to perform KV lookups in [14, 14], got 14
    validate_benchmark_data.go:120: success: expected ORMQueries/django_indexes to perform KV lookups in [3, 3], got 3
    validate_benchmark_data.go:120: success: expected DropView/drop_2_views to perform KV lookups in [15, 15], got 15
    validate_benchmark_data.go:120: success: expected ORMQueries/prisma_types_16 to perform KV lookups in [4, 4], got 4
    validate_benchmark_data.go:120: success: expected Discard/DISCARD_ALL,_1_tables_in_1_db to perform KV lookups in [14, 14], got 14
    validate_benchmark_data.go:120: success: expected AlterTableAddCheckConstraint/alter_table_add_3_check_constraints to perform KV lookups in [14, 14], got 13
    validate_benchmark_data.go:120: success: expected TriggerResolution/insert_into_table_with_after_trigger to perform KV lookups in [1, 1], got 2
    validate_benchmark_data.go:120: success: expected AlterTableDropConstraint/alter_table_drop_1_check_constraint to perform KV lookups in [13, 13], got 13
    validate_benchmark_data.go:117: fail: expected TriggerResolution/insert_into_table_with_before_trigger to perform KV lookups in [1, 1], got 4
    validate_benchmark_data.go:120: success: expected AlterTableAddCheckConstraint/alter_table_add_1_check_constraint to perform KV lookups in [14, 14], got 13
    validate_benchmark_data.go:120: success: expected AlterTableAddCheckConstraint/alter_table_add_2_check_constraints to perform KV lookups in [14, 14], got 13
    validate_benchmark_data.go:120: success: expected AlterTableDropConstraint/alter_table_drop_2_check_constraints to perform KV lookups in [13, 13], got 13
    validate_benchmark_data.go:120: success: expected ORMQueries/liquibase_migrations_on_multiple_dbs to perform KV lookups in [15, 15], got 15
    validate_benchmark_data.go:73: see the -rewrite flag to re-run the benchmarks and adjust the expectations
    validate_benchmark_data.go:74: usage: ./dev test --rewrite pkg/bench/rttanalysis -f=TestBenchmarkExpectation/ --test-args '-rewrite-iterations=N'
    validate_benchmark_data.go:107: -- test log scope end --
test logs left over in: /artifacts/tmp/_tmp/218f1ec986fb6ea2d7ae17fff6ee251f/logTestBenchmarkExpectationShard23843898458
--- FAIL: TestBenchmarkExpectationShard2 (259.04s)
=== RUN   TestBenchmarkExpectationShard2/TriggerResolution
--- FAIL: TestBenchmarkExpectationShard2/TriggerResolution (247.65s)
=== RUN   TestBenchmarkExpectationShard2/TriggerResolution/insert_into_table_with_before_trigger
    test_server_shim.go:146: using test tenant configuration from testserver factory defaults
    test_server_shim.go:150: cluster virtualization disabled due to issue: #83461 (expected label: C-bug)
    rtt_analysis_bench.go:224: TriggerResolution/insert_into_table_with_before_trigger: got 4, expected 1
    rtt_analysis_bench.go:230: wrote jaeger trace to /artifacts/tmp/_tmp/218f1ec986fb6ea2d7ae17fff6ee251f/logTestBenchmarkExpectationShard23843898458/TriggerResolution_insert_into_table_with_before_trigger.jaeger.json
--- FAIL: TestBenchmarkExpectationShard2/TriggerResolution/insert_into_table_with_before_trigger (247.65s)
Help

See also: How To Investigate a Go Test Failure (internal)

/cc @cockroachdb/sql-foundations

This test on roachdash | Improve this report!

Jira issue: CRDB-63895

Metadata

Metadata

Assignees

Labels

C-autosolveIssues that are candidates for autosolving by the autosolver botC-test-failureBroken test (automatically or manually discovered).O-robotOriginated from a bot.P-2Issues/test failures with a fix SLA of 3 monthsT-sql-foundationsSQL Foundations Team (formerly SQL Schema + SQL Sessions)branch-masterFailures and bugs on the master branch.

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions