feat: remove evaluation infrastructure (moved to openadapt-evals) (#25)

* feat: remove evaluation infrastructure (moved to openadapt-evals)

All evaluation infrastructure (~13,000 lines) has been migrated to
openadapt-evals (PR #29). This PR removes the now-redundant code from
openadapt-ml, making it a pure ML package.

Deleted files:
- benchmarks/cli.py (8,503 lines - VM/pool CLI)
- benchmarks/azure_vm.py (AzureVMManager)
- benchmarks/pool.py (PoolManager)
- benchmarks/vm_monitor.py, azure_ops_tracker.py, resource_tracker.py
- benchmarks/azure.py, viewer.py, pool_viewer.py, trace_export.py
- benchmarks/waa_deploy/ (Docker agent deployment)
- tests/test_quota_auto_detection.py, test_demo_persistence.py
- tests/benchmarks/test_api_agent.py, test_waa.py

Updated:
- benchmarks/__init__.py: Only exports ML agents (PolicyAgent, etc.)
- pyproject.toml: Removed azure-ai-ml, azureml-core, azure-mgmt-*
- CLAUDE.md: Removed CLI/VM/pool docs, added migration guide

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* fix: update stale references to migrated benchmark modules

Update all remaining references to deleted benchmark modules
across source code, scripts, and tests:

- cloud/local.py: azure_ops_tracker, session_tracker, CLI subprocess calls
- scripts/: p0/p1 validation scripts, screenshot generators, quota checker
- training/benchmark_viewer.py: HTML template CLI references
- experiments/waa_demo/runner.py: docstring and print references
- deprecated/waa_deploy/__init__.py: import path

All now point to openadapt_evals equivalents.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

Author: abrichr

CLAUDE.md

@@ -5,6 +5,6 @@
 - Dockerfile: Custom waa-auto Docker image
 """
 
-from openadapt_ml.benchmarks.waa_deploy.api_agent import ApiAgent
+from openadapt_evals.waa_deploy.api_agent import ApiAgent
 
 __all__ = ["ApiAgent"]

deprecated/waa_deploy/__init__.py

@@ -1,30 +1,27 @@
-"""Benchmark integration for openadapt-ml.
+"""ML-specific agents for benchmark evaluation.
 
-This module provides:
+This module provides agents that wrap openadapt-ml ML components
+(VLM adapters, policies, baselines) for benchmark evaluation.
 
-1. ML-specific agents for benchmark evaluation (PolicyAgent, APIBenchmarkAgent, etc.)
-2. Azure VM management with clean Python API (AzureVMManager)
-3. Pool management for parallel WAA evaluation (PoolManager)
-
-For benchmark infrastructure (adapters, runners, viewers), use openadapt-evals:
+For evaluation infrastructure (VM management, pool orchestration, CLI,
+adapters, runners, viewers), use openadapt-evals:
     ```python
     from openadapt_evals import (
         WAAMockAdapter,
         WAALiveAdapter,
         evaluate_agent_on_benchmark,
     )
+    # VM/pool management CLI:
+    #   oa-vm pool-create --workers 4
+    #   oa-vm pool-run --tasks 10
     ```
 
-Library usage (programmatic, no CLI):
+ML agent usage:
     ```python
-    from openadapt_ml.benchmarks import PoolManager, AzureVMManager
+    from openadapt_ml.benchmarks import PolicyAgent, APIBenchmarkAgent
 
-    vm = AzureVMManager(resource_group="my-rg")
-    manager = PoolManager(vm_manager=vm)
-    pool = manager.create(workers=4)
-    manager.wait()
-    result = manager.run(tasks=10)
-    manager.cleanup(confirm=False)
+    agent = APIBenchmarkAgent(provider="anthropic")
+    agent = PolicyAgent(policy)
     ```
 """
 
@@ -33,14 +30,9 @@
     PolicyAgent,
     UnifiedBaselineAgent,
 )
-from openadapt_ml.benchmarks.azure_vm import AzureVMManager
-from openadapt_ml.benchmarks.pool import PoolManager, PoolRunResult
 
 __all__ = [
     "PolicyAgent",
     "APIBenchmarkAgent",
     "UnifiedBaselineAgent",
-    "AzureVMManager",
-    "PoolManager",
-    "PoolRunResult",
 ]