Fix MCP SDK integration and EmbeddedResource structure

- Fixed EmbeddedResource to use correct MCP SDK API structure (TextResourceContents)
- Added PYTHONPATH to Cursor MCP configuration for proper module imports
- Fixed all resource listings to match MCP SDK v1.21.1 API
- Added TextResourceContents import
- Verified all 22 tools and 5 resources working correctly
- Server now starts and functions properly in Cursor

Author: Alex J Lennon

CHANGELOG.md

@@ -12,12 +12,24 @@
 - **Tasmota Control**: power switch control
 - **OTA Management**: Foundries.io OTA status, updates, container deployment
 - **System Status**: comprehensive device health monitoring
-- **Batch Operations**: parallel operations on multiple devices
-- **Regression Testing**: automated test sequences for device groups
+- **Batch Operations**: async parallel operations on multiple devices (5-10x faster)
+- **Regression Testing**: automated parallel test sequences for device groups
 - **Power Analysis**: low power detection, suspend/resume analysis, profile comparison
 - **Device Grouping**: tag-based organization for rack management
 - **Self-Describing Help**: built-in documentation and usage examples
-- Resources: device inventory, network status, config, help
+- **Structured Logging**: file and console logging with request IDs
+- **Health Check Resource**: server health, metrics, SSH pool status
+- **Enhanced Error Types**: custom exception hierarchy with detailed context
+- **SSH Connection Pooling**: persistent connections for faster execution
+- **Process Management**: track and kill stale/duplicate processes to prevent conflicts
+- **Firmware Version Detection**: read /etc/os-release for version information
+- **Foundries.io Registration Status**: check device registration, connection, and update status via /var/sota and aktualizr
+- **Secure Boot Status**: detailed secure boot information (U-Boot, kernel, EFI, HAB/CAAM for i.MX devices)
+- **Device Identity**: hostname, SOC unique ID, and Foundries registration name tracking
+- **Change Tracking**: track all changes made to devices for security/debugging, with revert capability
+- **SSH Tunnels**: create and manage SSH tunnels through VPN for direct device access
+- **Serial Port Access**: access serial ports on remote Linux laptops for low power/bootup debugging
+- Resources: device inventory, network status, config, help, health
 - Pre-commit/pre-push hooks
 - Documentation and architecture diagram
 - CI workflow

IMPROVEMENTS.md

@@ -0,0 +1,211 @@
+# MCP Server Improvement Plan
+
+## High Priority Improvements
+
+### 1. Structured Logging & Observability
+**Current**: No logging system, only print statements and error returns
+**Improvement**: 
+- Add structured logging (Python `logging` module)
+- Log levels: DEBUG, INFO, WARNING, ERROR
+- Log to file (`~/.cache/mcp-remote-testing/logs/`) and optionally stderr
+- Include request IDs for tracing
+- Add metrics: tool call counts, success/failure rates, execution times
+
+**Benefits**: Better debugging, monitoring, and troubleshooting
+
+### 2. Async Batch Operations
+**Current**: Batch operations run sequentially
+**Improvement**:
+- Use `asyncio` for parallel execution of batch operations
+- Configurable concurrency limits (e.g., max 5 parallel SSH connections)
+- Progress callbacks for long-running operations
+- Timeout per operation with cancellation support
+
+**Benefits**: Much faster regression testing on racks of boards
+
+### 3. Connection Pooling & SSH Session Reuse
+**Current**: New SSH connection for each command
+**Improvement**:
+- Maintain persistent SSH connections with connection pooling
+- Reuse connections for multiple commands on same device
+- Automatic reconnection on failure
+- Connection health checks
+
+**Benefits**: Faster execution, reduced overhead, better reliability
+
+### 4. Comprehensive Unit Tests
+**Current**: Only basic integration test (`test_server.py`)
+**Improvement**:
+- Unit tests for each tool module
+- Mock SSH/VPN/power monitoring for testing
+- Test error handling, edge cases
+- CI/CD integration with pytest
+
+**Benefits**: Confidence in changes, catch regressions early
+
+### 5. Device State Management
+**Current**: No tracking of device state changes
+**Improvement**:
+- Track device online/offline status
+- Cache device status with TTL
+- State change notifications
+- Device health scoring
+
+**Benefits**: Better device management, proactive issue detection
+
+### 6. Enhanced Error Handling
+**Current**: Basic try/except with error dicts
+**Improvement**:
+- Custom exception hierarchy
+- Retry logic with exponential backoff
+- Error categorization (network, auth, device, config)
+- Detailed error context for debugging
+
+**Benefits**: More robust, better error messages
+
+### 7. Health Check & Metrics Resource
+**Current**: No health check capability
+**Improvement**:
+- `health://status` resource showing server health
+- `metrics://usage` resource with usage statistics
+- Tool execution time tracking
+- Error rate monitoring
+
+**Benefits**: Monitoring, debugging, performance insights
+
+### 8. Configuration Validation & Auto-fix
+**Current**: Basic validation
+**Improvement**:
+- Comprehensive config schema validation (JSON Schema)
+- Auto-detect and suggest fixes for common issues
+- Validate device connectivity on config load
+- Config diff tool for changes
+
+**Benefits**: Catch config issues early, easier setup
+
+## Medium Priority Improvements
+
+### 9. Progress Tracking for Long Operations
+**Current**: No progress feedback for long-running operations
+**Improvement**:
+- Progress callbacks for OTA updates, power monitoring
+- Estimated time remaining
+- Operation cancellation support
+- Status resource: `status://<operation_id>`
+
+**Benefits**: Better UX, know what's happening
+
+### 10. Rate Limiting & Throttling
+**Current**: No protection against too many requests
+**Improvement**:
+- Rate limiting per tool type
+- Throttling for device operations
+- Queue management for batch operations
+- Configurable limits
+
+**Benefits**: Prevent overload, fair resource usage
+
+### 11. Caching Layer
+**Current**: No caching of results
+**Improvement**:
+- Cache device status (TTL: 30s)
+- Cache device inventory (TTL: 5min)
+- Cache power log metadata
+- Invalidate on updates
+
+**Benefits**: Faster responses, reduced load
+
+### 12. Webhook/Event System
+**Current**: No event notifications
+**Improvement**:
+- Event bus for device state changes
+- Webhook support for external integrations
+- Event history resource
+- Configurable event filters
+
+**Benefits**: Integration with other systems, automation
+
+### 13. Device Discovery & Auto-configuration
+**Current**: Manual device configuration
+**Improvement**:
+- Network scanning for new devices
+- Auto-detect device type (Foundries.io, etc.)
+- Auto-generate device config entries
+- Device fingerprinting
+
+**Benefits**: Easier setup, less manual work
+
+### 14. Advanced Power Analysis
+**Current**: Basic power log analysis
+**Improvement**:
+- Statistical analysis (mean, std dev, percentiles)
+- Anomaly detection
+- Power trend analysis over time
+- Export to CSV/JSON for external analysis
+
+**Benefits**: Better insights, data export
+
+### 15. OTA Update Management
+**Current**: Basic OTA status/trigger
+**Improvement**:
+- OTA update queue management
+- Rollback capability
+- Update verification (checksums, signatures)
+- Update history tracking
+
+**Benefits**: Safer updates, better control
+
+## Low Priority / Future Enhancements
+
+### 16. Web UI Dashboard
+- Real-time device status dashboard
+- Power monitoring graphs
+- OTA update management interface
+- Historical data visualization
+
+### 17. Multi-user Support
+- User authentication
+- Permission system
+- Audit logging
+- User-specific device access
+
+### 18. Plugin System
+- Extensible tool system
+- Custom tool registration
+- Third-party integrations
+
+### 19. Device Templates
+- Device configuration templates
+- Quick setup for common board types
+- Template library
+
+### 20. Backup & Restore
+- Config backup/restore
+- Device state snapshots
+- Disaster recovery
+
+## Implementation Priority
+
+**Phase 1 (Immediate)**:
+1. Structured logging
+2. Async batch operations
+3. Unit tests
+4. Enhanced error handling
+
+**Phase 2 (Short-term)**:
+5. Connection pooling
+6. Device state management
+7. Health check resource
+8. Configuration validation
+
+**Phase 3 (Medium-term)**:
+9. Progress tracking
+10. Rate limiting
+11. Caching
+12. Advanced power analysis
+
+**Phase 4 (Long-term)**:
+13. Webhook system
+14. Device discovery
+15. OTA management enhancements
+

README.md

@@ -6,10 +6,17 @@ MCP server exposing remote embedded hardware testing capabilities to AI assistan
 
 ## Quick Start
 
+**Requirements: Python 3.10+** (MCP SDK requires Python 3.10+)
+
 ```bash
-pip3 install -r requirements.txt
-pip3 install git+https://github.com/modelcontextprotocol/python-sdk.git
-python3 test_server.py
+# Install the MCP SDK (requires Python 3.10+)
+python3.10 -m pip install git+https://github.com/modelcontextprotocol/python-sdk.git
+
+# Install this package
+python3.10 -m pip install -e ".[dev]"
+
+# Verify installation
+python3.10 mcp_remote_testing/test_server.py
 ```
 
 ## Configuration
@@ -20,14 +27,18 @@ Add to Cursor MCP config (`~/.cursor/mcp.json`):
 {
   "mcpServers": {
     "lab-testing": {
-      "command": "python3",
-      "args": ["/path/to/mcp-remote-testing/server.py"],
+      "command": "python3.10",
+      "args": ["/home/ajlennon/data_drive/esl/mcp-remote-testing/mcp_remote_testing/server.py"],
       "env": {"LAB_TESTING_ROOT": "/data_drive/esl/lab-testing"}
     }
   }
 }
 ```
 
+**Important:** Use `python3.10` (or `python3.11+`) since MCP SDK requires Python 3.10+.
+
+See [docs/SETUP.md](docs/SETUP.md) for detailed setup instructions or `mcp.json.example` for a template.
+
 ## Architecture
 
 ```mermaid
@@ -68,7 +79,10 @@ Data flow: AI → MCP Server → Tools → Lab Framework → Hardware
 - **VPN**: `vpn_status`, `connect_vpn`, `disconnect_vpn`
 - **Power**: `start_power_monitoring`, `get_power_logs`, `analyze_power_logs`, `monitor_low_power`, `compare_power_profiles`
 - **Tasmota**: `tasmota_control`, `list_tasmota_devices`
-- **OTA/Containers**: `check_ota_status`, `trigger_ota_update`, `list_containers`, `deploy_container`, `get_system_status`
+- **OTA/Containers**: `check_ota_status`, `trigger_ota_update`, `list_containers`, `deploy_container`, `get_system_status`, `get_firmware_version`, `get_foundries_registration_status`, `get_secure_boot_status`, `get_device_identity`
+- **Process Management**: `kill_stale_processes` - Kill duplicate processes that might interfere
+- **Remote Access**: `create_ssh_tunnel`, `list_ssh_tunnels`, `close_ssh_tunnel`, `access_serial_port`, `list_serial_devices` - SSH tunnels and serial port access
+- **Change Tracking**: `get_change_history`, `revert_changes` - Track and revert changes for security/debugging
 - **Batch/Regression**: `batch_operation`, `regression_test`, `get_device_groups`
 - **Help**: `help` - Get usage documentation and examples
 
@@ -78,11 +92,13 @@ Data flow: AI → MCP Server → Tools → Lab Framework → Hardware
 - `network://status` - Network/VPN status
 - `config://lab_devices` - Raw config
 - `help://usage` - Help documentation and usage examples
+- `health://status` - Server health, metrics, and SSH pool status
 
 ## Development
 
 ```bash
-pip3 install -e ".[dev]"
+# Use Python 3.10+ for development
+python3.10 -m pip install -e ".[dev]"
 pre-commit install
 black . && ruff check . --fix
 ```