Skip to content

Commit 70aa5f5

Browse files
MikaelSmithImpala Public Jenkins
authored andcommitted
IMPALA-15026: Update Python infra dependencies for CVEs
Updates infra/python/deps to address CVEs highlighted by dependabot. Omits updating pytest because going to version 9 requires more work. Testing: tested adls and gcovr requirements with env TARGET_FILESYSTEM=adls azure_client_id=a azure_tenant_id=b azure_client_secret=c azure_data_lake_store_name=d ./buildall.sh -notests -codecoverage Change-Id: I7d2811cec99dd21d201faaae413b37e44f5f051e Reviewed-on: http://gerrit.cloudera.org:8080/24333 Reviewed-by: Jason Fehr <jfehr@cloudera.com> Tested-by: Impala Public Jenkins <impala-public-jenkins@cloudera.com>
1 parent ac1e178 commit 70aa5f5

6 files changed

Lines changed: 35 additions & 23 deletions

File tree

infra/python/README

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,6 @@
11
To install new packages:
22

3-
1) Add your package to deps/requirements.txt, or deps/compiled-requirements.txt if the
4-
the package needs a C/C++ compiler to build . You should specify the version number
3+
1) Add your package to deps/requirements.txt. You should specify the version number
54
using the "foo == x.y.z" notation so future upgrades can be done automatically.
65
2) Run deps/download_requirements, it will download the package to the deps dir.
76
3) Run the "impala-python3" command, this should detect that requirements.txt changed and

infra/python/deps/adls-requirements.txt

Lines changed: 17 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -19,8 +19,20 @@
1919
# is bootstrapped and all requirements in requirements.txt and compiled-requirements.txt
2020
# are installed into the virtualenv.
2121

22-
pycparser == 2.17
23-
cffi==1.10.0
24-
cryptography==1.8.1
25-
scandir == 1.5
26-
azure-datalake-store == 0.0.9
22+
pycparser == 2.23
23+
cffi==2.0.0
24+
cryptography==46.0.7
25+
maturin==1.13.3
26+
setuptools-rust==1.12.1
27+
semantic_version==2.10.0
28+
puccinialin==0.1.12
29+
filelock==3.29.0
30+
httpx==0.28.1
31+
anyio==4.13.0
32+
typing_extensions==4.15.0
33+
hatch-fancy-pypi-readme==25.1.0
34+
httpcore==1.0.9
35+
h11==0.16.0
36+
platformdirs==4.9.6
37+
tqdm==4.67.3
38+
azure-datalake-store == 1.0.1

infra/python/deps/extended-test-requirements.txt

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -21,8 +21,8 @@
2121
Fabric==1.14.0
2222
# The leopard framework, which runs a webui to view random query generator
2323
# reports, requires Flask.
24-
Flask==1.0.2
24+
Flask==3.1.3
2525
# Fabric depends on Paramiko. Additionally, the stress test uses
2626
# Paramiko directly to keep a persistent SSH connection open to each
2727
# Impalad host to run in-test monitoring.
28-
paramiko==2.4.2
28+
paramiko==5.0.0

infra/python/deps/gcovr-requirements.txt

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -18,12 +18,12 @@
1818
# Requirements for gcovr, which are only needed for coverage runs
1919

2020
gcovr == 7.2
21-
Jinja2 == 3.1.4
21+
Jinja2 == 3.1.6
2222
flit-core == 3.9.0
23-
lxml == 5.2.2
24-
Cython == 3.0.10
23+
lxml == 6.1.0
24+
Cython == 3.2.4
2525
colorlog == 6.8.2
26-
Pygments == 2.13.0
26+
Pygments == 2.20.0
2727
MarkupSafe == 2.1.5
2828
tomli == 2.0.1
2929
packaging == 24.1

infra/python/deps/requirements.txt

Lines changed: 8 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -55,7 +55,7 @@ pytest == 6.2.5
5555
pytest-timeout == 2.2.0
5656
pytest-xdist == 3.5.0
5757
execnet == 2.1.2
58-
hatchling == 1.28.0
58+
hatchling == 1.29.0
5959
pathspec == 1.0.4
6060
trove-classifiers == 2026.1.14.14
6161
calver == 2025.10.20
@@ -64,18 +64,19 @@ pytest == 6.2.5
6464
python-magic == 0.4.27
6565
pywebhdfs == 0.3.2
6666
pbr == 7.0.3
67-
requests == 2.32.5
68-
charset_normalizer == 3.4.4
69-
idna == 3.11
70-
urllib3 == 2.6.3
71-
certifi == 2026.1.4
67+
requests == 2.34.2
68+
charset_normalizer == 3.4.7
69+
idna == 3.15
70+
urllib3 == 2.7.0
71+
certifi == 2026.5.20
7272
sasl == 0.4a1
7373
six == 1.17.0
74+
# Can't upgrade until https://github.com/andialbrecht/sqlparse/issues/814 is fixed.
7475
sqlparse == 0.3.1
7576
avro==1.12.1
7677
thrift==0.16.0
7778
distro==1.9.0
7879

7980
# Required for Kudu:
8081
Cython == 0.29.37
81-
pytz == 2025.2
82+
pytz == 2026.2

infra/python/deps/setuptools-requirements.txt

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -15,9 +15,9 @@
1515
# specific language governing permissions and limitations
1616
# under the License.
1717

18-
# Newer versions of setuptools don't support Python 2.7
18+
# Newer versions of setuptools don't provide pkg_resources for Kudu/Impyla.
1919
setuptools == 80.10.2
20-
wheel == 0.46.3
20+
wheel == 0.47.0
2121
flit-core == 3.12.0
22-
packaging == 26.0
22+
packaging == 26.2
2323
setuptools-scm == 9.2.2

0 commit comments

Comments
 (0)