Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
98 commits
Select commit Hold shift + click to select a range
40cc50c
sdks/python: enrich data with CloudSQL
moawnallah Mar 24, 2025
507d3ec
sdks/python: unit test `CloudSQLEnrichmentHandler`
moawnallah Mar 24, 2025
b4c11d3
sdks/python: itest `CloudSQLEnrichmentHandler`
moawnallah Mar 25, 2025
43943b1
website+sdks: doc `CloudSQLEnrichmentHandler`
moawnallah Mar 25, 2025
846c30d
sdks/python: address claudevdm feedback (1)
moawnallah Apr 11, 2025
9a1ed45
sdks/python: address claudevdm feedback (1)(test)
moawnallah Apr 11, 2025
9261459
sdks/python: address claudevdm feedback (1)(itest)
moawnallah Apr 11, 2025
ecbb61d
sdks: update doc `CloudSQLEnrichmentHandler`
moawnallah Apr 11, 2025
83e7154
sdks/python: fix linting issues
moawnallah Apr 11, 2025
4fa1830
website: add missing `enrichment-cloudsql.md`
moawnallah Apr 13, 2025
4251a76
nits: remove commented code
moawnallah Apr 13, 2025
ab7cf7b
sdks/python: remove `SQL_TABLE_ID` env variable
moawnallah Apr 13, 2025
669d2d4
sdks/python: fix formatting issues
moawnallah Apr 13, 2025
7209335
sdks/python: address claudevdm feedback (2)
moawnallah May 21, 2025
abb89b7
sdks/python: address claudevdm feedback (3)
moawnallah May 28, 2025
d95e926
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
moawnallah Jun 6, 2025
bc84430
multi: fix pymssql mac os deps
moawnallah Jun 6, 2025
7a56f0e
multi: use pytds sql server database adapter
moawnallah Jun 6, 2025
cc7c7f0
sdks/python: use `VARCHAR` datatype
moawnallah Jun 6, 2025
7a7436d
sdks/python: address claudevdm feedback (4)
moawnallah Jun 12, 2025
43ea944
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
moawnallah Jun 12, 2025
faff130
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
moawnallah Jun 13, 2025
5a472b7
fix setup.py
moawnallah Jun 13, 2025
ab0a6de
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
moawnallah Jun 27, 2025
1083b18
sdks/python: fix linting issues
moawnallah Jun 27, 2025
fe6d7d0
sdks/python: connect to beam cloudsql itest instance
moawnallah Jun 27, 2025
0e89819
.github: trigger postcommits python
moawnallah Jun 27, 2025
3a0bfc1
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
moawnallah Jun 27, 2025
ef10655
sdks/python: update base image requirements
moawnallah Jun 27, 2025
40cdd73
.github: trigger beam postcommit python sdk
moawnallah Jun 27, 2025
8c755bb
examples+transforms: configure sql databases for transform exmaples
moawnallah Jun 28, 2025
72d8725
apache_beam: fix dependencies
moawnallah Jun 28, 2025
5a4ed41
sdks/python: update `get_connector_handler` python docstring
moawnallah Jun 28, 2025
e214ce5
sdks/python: fix linting for cloudsql
moawnallah Jun 28, 2025
b2202c4
.github: trigger post commits python
moawnallah Jun 28, 2025
b06eff7
sdks/python+website: update docs and fix linting issues
moawnallah Jun 28, 2025
082571d
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
moawnallah Jun 28, 2025
2abba91
CHANGES.md: update release notes
moawnallah Jun 28, 2025
3cd98e4
.github: trigger postcommit python CI
moawnallah Jun 28, 2025
ce0da2f
sdks/python: fix linting issues
moawnallah Jun 29, 2025
9b546ab
.github: trigger postcommit python CI
moawnallah Jun 29, 2025
5931d65
sdks/python: fix linting issues
moawnallah Jun 29, 2025
e57cba6
.github: trigger postcommit python CI
moawnallah Jun 29, 2025
7e13c17
sdks/python: fix `examples` CI for cloudSQL enrichment
moawnallah Jun 29, 2025
37eeec2
.github: trigger postcommit python CI
moawnallah Jun 29, 2025
73b55ff
.github/workflows: include `ALLOYDB_PASSWORD` env in precommit python…
moawnallah Jun 29, 2025
a6775a7
sdks/python: fix linting issues for `cloudsql`
moawnallah Jun 29, 2025
82602ed
sdks/python: fix linting issues for `enrichment_test.py`
moawnallah Jun 29, 2025
c906209
.github: trigger postcommit
moawnallah Jun 29, 2025
7a92a99
.github+website+sdks/python: remove non-functional docs
moawnallah Jun 29, 2025
da35a23
.github: trigger postcommit python CI
moawnallah Jun 29, 2025
44aac80
sdks/python: generate unique table for itest
moawnallah Jul 2, 2025
e0affe2
.github: enable access to `ALLOYDB_PASSWORD` in precommit py transforms
moawnallah Jul 2, 2025
38263c2
.github: trigger post commit python
moawnallah Jul 2, 2025
cbaea63
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
moawnallah Jul 2, 2025
f1e78b8
sdks/python: update py39 image requirements
moawnallah Jul 2, 2025
fc2e073
.github: trigger postcommit python
moawnallah Jul 2, 2025
a95d984
sdks/python: update image requirements
moawnallah Jul 2, 2025
4da20c9
.github: trigger postcommit python
moawnallah Jul 2, 2025
6e35a60
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
moawnallah Jul 7, 2025
a78be8a
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
moawnallah Jul 8, 2025
2f38a59
.github: trigger postcommit python
moawnallah Jul 8, 2025
7819821
sdks/python: fix local unbound variable
moawnallah Jul 8, 2025
759f307
.github: trigger postcommit python
moawnallah Jul 8, 2025
47d8da5
sdks/python: remove params
moawnallah Jul 8, 2025
363873f
.github: trigger beam post commit python
moawnallah Jul 8, 2025
13ee4f3
sdks/python: experiment with my google cloud
moawnallah Jul 9, 2025
6f67233
sdks/python: revert `ALLOYDB_PASSWORD` env var in precommit py transf…
moawnallah Jul 9, 2025
95214e3
sdks/python: skip cloudsql tests if `ALLOYDB_PASSWORD` not set
moawnallah Jul 9, 2025
948b8ba
.github: trigger postcommit python
moawnallah Jul 9, 2025
09e3606
sdks/python: address gemini feedback
moawnallah Jul 13, 2025
bf059d1
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
moawnallah Jul 19, 2025
7b6ba8f
.github: trigger postcommit python
moawnallah Jul 19, 2025
b915a1a
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
moawnallah Jul 21, 2025
84d5e4f
.github: trigger postcommit python
moawnallah Jul 21, 2025
5462138
sdks/python: fix linting issues
moawnallah Jul 21, 2025
a55ab60
sdks/python: fix linting issues
moawnallah Jul 22, 2025
42652ac
.github: trigger post commit python
moawnallah Jul 22, 2025
b77232f
sdks/python: fix linting issues
moawnallah Jul 22, 2025
ffd2f38
.github: trigger postcommit python
moawnallah Jul 22, 2025
318a8bf
sdks/python: fix linting issues
moawnallah Jul 22, 2025
2f21f7f
.github: trigger postcommit python
moawnallah Jul 22, 2025
b8f7e7a
sdks/python: fix linting issues
moawnallah Jul 22, 2025
17cff20
.github: trigger postcommit python
moawnallah Jul 22, 2025
7be26c1
sdks/python: fix linting issues
moawnallah Jul 22, 2025
7fbeb5c
sdks/python: fix SQL injection
moawnallah Aug 3, 2025
c706a7d
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
moawnallah Aug 3, 2025
f9d0005
CHANGES.md: update release notes
moawnallah Aug 3, 2025
4c69da0
sdks/python: fix formatting issues
moawnallah Aug 3, 2025
d8c4ae1
sdks/python: fix linting issues
moawnallah Aug 3, 2025
4da4af1
sdks/python: update py image requirements
moawnallah Aug 3, 2025
a81fe24
.github: trigger postcommit python
moawnallah Aug 3, 2025
eb5e34f
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
moawnallah Aug 15, 2025
3f16f13
sdks/python: try to fix python doc linting issues
moawnallah Aug 15, 2025
436a97b
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
moawnallah Aug 16, 2025
ac0c137
sdks/python: fix linting issues
moawnallah Aug 16, 2025
1ca2967
Merge remote-tracking branch 'upstream/master' into enrichWithCloudSQL
moawnallah Aug 20, 2025
6a668d3
.github: trigger postcommit python
moawnallah Aug 20, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/trigger_files/beam_PostCommit_Python.json
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
{
"comment": "Modify this file in a trivial way to cause this test suite to run.",
"modification": 35
"modification": 33
}

1 change: 0 additions & 1 deletion .github/workflows/beam_PreCommit_Python_Transforms.yml
Original file line number Diff line number Diff line change
Expand Up @@ -53,7 +53,6 @@ env:
DEVELOCITY_ACCESS_KEY: ${{ secrets.DEVELOCITY_ACCESS_KEY }}
GRADLE_ENTERPRISE_CACHE_USERNAME: ${{ secrets.GE_CACHE_USERNAME }}
GRADLE_ENTERPRISE_CACHE_PASSWORD: ${{ secrets.GE_CACHE_PASSWORD }}
ALLOYDB_PASSWORD: ${{ secrets.ALLOYDB_PASSWORD }}
Comment thread
damccorm marked this conversation as resolved.

jobs:
beam_PreCommit_Python_Transforms:
Expand Down
4 changes: 4 additions & 0 deletions CHANGES.md
Original file line number Diff line number Diff line change
Expand Up @@ -76,6 +76,10 @@
* BigtableRead Connector for BeamYaml added with new Config Param ([#35696](https://github.com/apache/beam/pull/35696))
* Introduced a dedicated module for JUnit-based testing support: `sdks/java/testing/junit`, which provides `TestPipelineExtension` for JUnit 5 while maintaining backward compatibility with existing JUnit 4 `TestRule`-based tests (Java) ([#18733](https://github.com/apache/beam/issues/18733), [#35688](https://github.com/apache/beam/pull/35688)).
- To use JUnit 5 with Beam tests, add a test-scoped dependency on `org.apache.beam:beam-sdks-java-testing-junit`.
* Google CloudSQL enrichment handler added (Python) ([#34398](https://github.com/apache/beam/pull/34398)).
Beam now supports data enrichment capabilities using SQL databases, with built-in support for:
- Managed PostgreSQL, MySQL, and Microsoft SQL Server instances on CloudSQL
- Unmanaged SQL database instances not hosted on CloudSQL (e.g., self-hosted or on-premises databases)

## Breaking Changes

Expand Down
Loading
Loading