[Bug]: AttributeError: Unknown field for BuildOptions: machineType when using --cloud_build_machine_type with google-cloud-build >= 3.35

[paul1u5]

What happened?

Versions:

• apache-beam from 2.72 to 2.75.0
• google-cloud-build 3.37.0

Description:

Running a Dataflow job with --prebuild_sdk_container_engine cloud_build and --cloud_build_machine_type fails with:

AttributeError: Unknown field for BuildOptions: machineType
  File ".../sdk_container_builder.py", line 246, in _invoke_docker_build_and_push
    build.options.machineType = self._cloud_build_machine_type

Fix:

In sdk_container_builder.py line 246, change:

build.options.machineType = self._cloud_build_machine_type
to
build.options.machine_type = self._cloud_build_machine_type

Issue Priority

Priority: 1 (data loss / total loss of function)

Issue Components

• Component: Python SDK
• Component: Java SDK
• Component: Go SDK
• Component: Typescript SDK
• Component: IO connector
• Component: Beam YAML
• Component: Beam examples
• Component: Beam playground
• Component: Beam katas
• Component: Website
• Component: Infrastructure
• Component: Spark Runner
• Component: Flink Runner
• Component: Prism Runner
• Component: Twister2 Runner
• Component: Hazelcast Jet Runner
• Component: Google Cloud Dataflow Runner

[Abacn]

Thanks for reporting it. Checked that this bug (field name mismatch) has always been around in Beam source. Does this only get triggered in google-cloud-build >= 3.35?

EDIT: I see, it's exposed by #37309 (Beam 2.72.0+)