feat: merging the changes from hotfix to main#253
Merged
Conversation
feat: added rate limit error pop up
feat: quota auto validation before deployment
* Added e2e test automation scripts and pipeline * Refactor test automation workflow: restore environment variable references and clean up commented paths * Refactor code for improved readability and maintainability: clean up imports, adjust formatting, and enhance comments across multiple files * Fix workflow trigger paths in test automation configuration
fix: Add execute permissions for validation scripts in preprovision hook
Roopan-Microsoft
approved these changes
Jun 5, 2025
Roopan-Microsoft
approved these changes
Jun 5, 2025
Contributor
There was a problem hiding this comment.
Pull Request Overview
Merges hotfix changes into main, introducing end-to-end test setup, quota validation tooling, and improved rate-limit error handling.
- Adds a pytest configuration and Playwright page objects for login and BIAB workflows
- Integrates Azure quota validation scripts (Bash/PowerShell) via preprovision hooks
- Enhances frontend/backend to catch and surface rate-limit errors
Reviewed Changes
Copilot reviewed 25 out of 25 changed files in this pull request and generated 6 comments.
Show a summary per file
| File | Description |
|---|---|
| tests/e2e-test/pytest.ini | Configures CLI and file logging for pytest |
| tests/e2e-test/pages/loginPage.py | Implements login flow with Playwright |
| tests/e2e-test/pages/BIAB.py | Adds BIAB page object for task creation and approval |
| tests/e2e-test/base/base.py | Defines base page utilities including API status check |
| tests/e2e-test/config/constants.py | Loads environment and sets test constants |
| src/frontend/wwwroot/home/home.js | Displays user-friendly messages on rate limits |
| src/backend/app_kernel.py | Includes exception details in HTTP 400 responses |
| src/backend/kernel_agents/planner_agent.py | Logs and rethrows rate-limit exceptions |
| infra/scripts/validate_model_quota.sh | Bash script to check Azure AI model quotas |
| infra/scripts/validate_model_quota.ps1 | PowerShell version of quota checker |
| infra/scripts/validate_model_deployment_* | Scripts to iterate model deployments and validate |
| infra/scripts/quota_check_params.sh | Updates default Azure regions list |
| .github/workflows/test-automation.yml | CI workflow for end-to-end test automation |
Comments suppressed due to low confidence (1)
tests/e2e-test/pages/loginPage.py:31
- The method name
enter_aditional_infohas a typo. Rename it toenter_additional_infoto match correct spelling.
def enter_aditional_info(self, text):
Avijit-Microsoft
approved these changes
Jun 5, 2025
|
🎉 This PR is included in version 1.7.0 🎉 The release is available on GitHub release Your semantic-release bot 📦🚀 |
blessing-msft
pushed a commit
that referenced
this pull request
Aug 1, 2025
feat: merging the changes from hotfix to main
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Purpose
This pull request introduces significant updates to the test automation workflow, quota validation scripts, and error handling mechanisms. The changes include a new GitHub Actions workflow for end-to-end testing, enhanced quota validation for AI model deployments, and improved error handling for rate limit issues in the backend and frontend.
Test Automation Enhancements:
.github/workflows/test-automation.ymlfor end-to-end testing, including retry mechanisms, test report uploads, and email notifications for success or failure.Quota Validation Improvements:
validate_model_deployment_quota.shandvalidate_model_quota.shscripts to validate Azure quota availability for AI model deployments, with detailed error messages and fallback region recommendations. [1] [2]validate_model_deployment_quotas.ps1) for Windows-based quota validation.infra/main.parameters.jsonto include parameters for AI model deployments, environment configurations, and resource existence checks.azure.yamlto include preprovision hooks for quota validation during deployment.Backend and Frontend Error Handling:
src/backend/app_kernel.pyandsrc/backend/kernel_agents/planner_agent.pyto log and handle rate limit issues gracefully. [1] [2]src/frontend/wwwroot/home/home.jsto display user-friendly error messages when rate limits are exceeded, preventing further actions until resolved.Region Configuration Updates:
infra/scripts/quota_check_params.shto include a refined list of Azure regions for quota checks.Does this introduce a breaking change?
How to Test
What to Check
Verify that the following are valid
Other Information