Editable installation doesn't work with setuptools 80.9.0: No module named azure.cli.__main__; 'azure.cli' is a package and cannot be directly executed

[jiasli]

LTS CI fails:

https://dev.azure.com/azclitools/public/_build/results?buildId=269081&view=logs&j=86666e57-faf2-5483-a4de-72294e0f6880&t=7303b7ff-a095-56e0-0151-d5464b43c6c5

# Verify installation and build command index
az --version
/mnt/vss/_work/1/s/env/bin/python: No module named azure.cli.__main__; 'azure.cli' is a package and cannot be directly executed

This can be reproduced locally on dev branch too:

> pip install setuptools -U

> azdev setup -c

> python -c "import azure.cli; print(azure.cli.__path__)"
_NamespacePath(['__editable__.azure_cli-2.77.0.finder.__path_hook__', '__editable__.azure_cli_core-2.77.0.finder.__path_hook__', '__editable__.azure_cli_telemetry-1.1.0.finder.__path_hook__', '__editable__.azure_cli_testsdk-0.3.0.finder.__path_hook__'])

> az -v
D:\cli\py313\Scripts\python.exe: No module named azure.cli.__main__; 'azure.cli' is a package and cannot be directly executed

[yonzhan]

Thank you for opening this issue, we will look into it.

[jiasli]

setuptools creates these files under <venv>\Lib\site-packages:

For example, azure-cli.egg-link contains:

D:\cli\azure-cli\src\azure-cli
.

setuptools==80.9.0 creates these files under <venv>\Lib\site-packages:

__editable__.azure_cli-2.77.0.pth contains

import __editable___azure_cli_2_77_0_finder; __editable___azure_cli_2_77_0_finder.install()

__editable___azure_cli_2_77_0_finder.py contains

from __future__ import annotations
import sys
from importlib.machinery import ModuleSpec, PathFinder
from importlib.machinery import all_suffixes as module_suffixes
from importlib.util import spec_from_file_location
from itertools import chain
from pathlib import Path

MAPPING: dict[str, str] = {'azure.cli.command_modules': 'D:\\cli\\azure-cli\\src\\azure-cli\\azure\\cli\\command_modules'}
NAMESPACES: dict[str, list[str]] = {'azure.cli': [], 'azure': []}
PATH_PLACEHOLDER = '__editable__.azure_cli-2.77.0.finder' + ".__path_hook__"
...

This issue seems to be related to pypa/setuptools#3548

[jiasli]

This error previously also happened on dev branch:

• [Service Connector] az webapp connection create mongodb-atlas #31308 (comment)
• [AKS] Add feature support for apiserver vnet integration #31318 (comment)

So azdev pins setuptools to 70.0.0 (Azure/azure-cli-dev-tools#524), but azdev==0.1.90 used by LTS doesn't pin setuptools:

azure-cli/.azure-pipelines/templates/azdev_setup.yml

Line 19 in ec3172d

pip install azdev==0.1.90

Fixing it requires us to release an LTS azdev 0.1.91 which pins setuptools to 70.0.0.