Commit a54f702
authored
chore(airflow): bump Airflow example to 2.11.x, fix cached_property imports (#77)
Bumps airflow/requirements-dev.txt to the latest Airflow 2.x series:
- apache-airflow ~=2.2.2 -> ~=2.11.0
- apache-airflow-providers-amazon ~=4.0 -> ~=9.22
- pytest ~=7.1.2 -> ~=9.0
Also fixes long-standing import errors in the custom EMR Serverless
operator/hook: airflow.compat.functools was removed in Airflow 2.4, so
those imports are replaced with stdlib functools.cached_property. The
dead Python 3.7 fallback block in operators/emr.py is also removed
(Airflow 2.9+ requires Python 3.8+, 2.11 requires 3.9+).
Clears Dependabot alerts: #47 #48 #49 #52 #53 #55 #56 #57 #58 #59 #60
#61 #62 #63 #64 #65 #68 #75 #76 #77 #78 #79 #81 #86 (24 alerts total).
Alerts #87 #88 #89 require Airflow 3.2.0 which is incompatible with
custom operator APIs and out of scope here.
Verified:
- apache-airflow 2.11.0 + providers-amazon 9.26.0 + pytest 9.0.3 install
cleanly under Python 3.11
- All custom hooks/operators/sensors import without error
- test_dag_integrity passes
- test_simple_submit has pre-existing issues using removed DAG.run() and
schedule_interval APIs; those are integration tests against live EMR-S,
out of scope for this PR1 parent 0e296dc commit a54f702
3 files changed
Lines changed: 6 additions & 13 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
17 | 17 | | |
18 | 18 | | |
19 | 19 | | |
| 20 | + | |
20 | 21 | | |
21 | 22 | | |
22 | 23 | | |
23 | 24 | | |
24 | 25 | | |
25 | | - | |
26 | 26 | | |
27 | 27 | | |
28 | 28 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
17 | 17 | | |
18 | 18 | | |
19 | 19 | | |
20 | | - | |
| 20 | + | |
21 | 21 | | |
22 | 22 | | |
23 | 23 | | |
| |||
29 | 29 | | |
30 | 30 | | |
31 | 31 | | |
32 | | - | |
33 | | - | |
34 | 32 | | |
35 | 33 | | |
36 | | - | |
37 | | - | |
38 | | - | |
39 | | - | |
40 | | - | |
41 | 34 | | |
42 | 35 | | |
43 | 36 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | | - | |
2 | | - | |
3 | | - | |
4 | | - | |
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
0 commit comments