Skip to content

Commit 42b70d4

Browse files
committed
refactor(bigquery): remove hardcoded DATE/DATETIME/JSON, require type_overrides
1 parent 7ebf874 commit 42b70d4

5 files changed

Lines changed: 103 additions & 350 deletions

File tree

CHANGES.md

Lines changed: 1 addition & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -63,13 +63,9 @@
6363
* New highly anticipated feature X added to Python SDK ([#X](https://github.com/apache/beam/issues/X)).
6464
* New highly anticipated feature Y added to Java SDK ([#Y](https://github.com/apache/beam/issues/Y)).
6565

66-
## I/Os
67-
68-
* Added DATE, DATETIME, and JSON type support to BigQuery I/O for use with Storage Write API and BEAM_ROW format (Python) ([#25946](https://github.com/apache/beam/issues/25946)).
69-
7066
## New Features / Improvements
7167

72-
* Added `type_overrides` parameter to `WriteToBigQuery` allowing users to override default BigQuery to Python type mappings when using Storage Write API (Python) ([#25946](https://github.com/apache/beam/issues/25946)).
68+
* Added `type_overrides` parameter to `WriteToBigQuery` allowing users to specify custom BigQuery to Python type mappings when using Storage Write API. This enables support for types like DATE, DATETIME, and JSON (Python) ([#25946](https://github.com/apache/beam/issues/25946)).
7369

7470
# [2.71.0] - Unreleased
7571

sdks/python/apache_beam/io/gcp/bigquery_schema_tools.py

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -49,9 +49,6 @@
4949
"BYTES": bytes,
5050
"TIMESTAMP": apache_beam.utils.timestamp.Timestamp,
5151
"GEOGRAPHY": str,
52-
"DATE": str,
53-
"DATETIME": str,
54-
"JSON": str,
5552
#TODO(https://github.com/apache/beam/issues/20810):
5653
# Finish mappings for all BQ types
5754
}

0 commit comments

Comments
 (0)