Skip to content

Commit 4633fdf

Browse files
committed
refactor(bigquery): remove hardcoded DATE/DATETIME/JSON, require type_overrides
1 parent 69ea79b commit 4633fdf

5 files changed

Lines changed: 103 additions & 346 deletions

File tree

CHANGES.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -71,7 +71,7 @@
7171

7272
* (Python) Added exception chaining to preserve error context in CloudSQLEnrichmentHandler, processes utilities, and core transforms ([#37422](https://github.com/apache/beam/issues/37422)).
7373
* (Python) Added `take(n)` convenience for PCollection: `beam.take(n)` and `pcoll.take(n)` to get the first N elements deterministically without Top.Of + FlatMap ([#X](https://github.com/apache/beam/issues/37429)).
74-
* Added `type_overrides` parameter to `WriteToBigQuery` allowing users to specify custom BigQuery to Python type mappings when using Storage Write API (Python) ([#25946](https://github.com/apache/beam/issues/25946)).
74+
* Added `type_overrides` parameter to `WriteToBigQuery` allowing users to specify custom BigQuery to Python type mappings when using Storage Write API. This enables support for types like DATE, DATETIME, and JSON (Python) ([#25946](https://github.com/apache/beam/issues/25946)).
7575
* X feature added (Java/Python) ([#X](https://github.com/apache/beam/issues/X)).
7676

7777
## Breaking Changes

sdks/python/apache_beam/io/gcp/bigquery_schema_tools.py

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -49,9 +49,6 @@
4949
"BYTES": bytes,
5050
"TIMESTAMP": apache_beam.utils.timestamp.Timestamp,
5151
"GEOGRAPHY": str,
52-
"DATE": str,
53-
"DATETIME": str,
54-
"JSON": str,
5552
#TODO(https://github.com/apache/beam/issues/20810):
5653
# Finish mappings for all BQ types
5754
}

0 commit comments

Comments
 (0)