Skip to content

Manage support dev#253

Merged
Den1552 merged 200 commits into
mainfrom
manage_support_dev
May 19, 2025
Merged

Manage support dev#253
Den1552 merged 200 commits into
mainfrom
manage_support_dev

Conversation

@Den1552
Copy link
Copy Markdown
Contributor

@Den1552 Den1552 commented Apr 22, 2025

Overview

This PR adds the functionality and a suite of automated tests for Manage Support.

Tests & Functionality Included

  • Tree Structure: Test the correctness of the project tree structure.
  • Add Existing Environment: Add an existing environment to a project node.
  • Create Compiler from CFG File: Validate creating a compiler from a CFG configuration.
  • Delete Compiler: Test removing a compiler from the project.
  • Build/Execute Incremental: Validate incremental builds and executions.
  • Create Testsuite: Test creating a new testsuite.
  • Delete Testsuite: Verify testsuite deletion functionality.
  • Delete Project Environment: Ensure environments can be properly deleted from a project.
  • Build Single Project Environment: Test building a single environment separately.
  • Remove Environment from Testsuite: Validate unlinking an environment from a testsuite.
  • Create Environment from Source Files: Test creating an environment directly from source files.
  • Change Update Project Setting & Update project manually

Additional Notes:

  • Manage-only code is placed in the folder src/manage
  • tests/internal/e2e/test now include a manage folder, including files important for tests
  • Because PCT wanted to load a test script by saving the file and not by (only) pressing "Load Test Script into Environment", I had to change all tests that had a tab.save(). Because this would trigger the loading test script which led to errors.
  • For many tests I added additional log awaitings because otherwise CI was too quick.
  • Some async issues had to be resolved in the source code, as we ran into race condition problems on CI

John Paliotta and others added 30 commits October 29, 2024 08:05
There are still multiple things to do but this is stable
@github-actions
Copy link
Copy Markdown

E2e Test results - Vcast 2025sp0 - Group manage

15 tests   15 ✅  7m 3s ⏱️
 1 suites   0 💤
 1 files     0 ❌

Results for commit 39a4709.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 19, 2025

E2e Test results - Vcast 2025sp1 - Group func_basis_server

2 files  ±0  2 suites  ±0   1m 32s ⏱️ -1s
6 tests ±0  6 ✅ ±0  0 💤 ±0  0 ❌ ±0 
8 runs  ±0  8 ✅ ±0  0 💤 ±0  0 ❌ ±0 

Results for commit 39a4709. ± Comparison against base commit f14ee05.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 19, 2025

E2e Test results - Vcast 2025sp1 - Group import_coded_test_server

5 tests  ±0   5 ✅ ±0   33s ⏱️ +3s
1 suites ±0   0 💤 ±0 
1 files   ±0   0 ❌ ±0 

Results for commit 39a4709. ± Comparison against base commit f14ee05.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 19, 2025

E2e Test results - Vcast 2025sp1 - Group manage

15 tests   15 ✅  6m 24s ⏱️
 1 suites   0 💤
 1 files     0 ❌

Results for commit 39a4709.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 19, 2025

E2e Test results - Vcast 2025sp0 - Group basic_user_interactions

10 files  ±0  10 suites  ±0   15m 57s ⏱️ -6s
31 tests ±0  31 ✅ ±0  0 💤 ±0  0 ❌ ±0 
51 runs  ±0  51 ✅ ±0  0 💤 ±0  0 ❌ ±0 

Results for commit 39a4709. ± Comparison against base commit f14ee05.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 19, 2025

E2e Test results - Vcast 2025sp1 - Group manage_server

15 tests   15 ✅  6m 22s ⏱️
 1 suites   0 💤
 1 files     0 ❌

Results for commit 39a4709.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 19, 2025

E2e Test results - Vcast 2025sp1 - Group server_specifics

6 tests  ±0   6 ✅ ±0   1m 15s ⏱️ +4s
1 suites ±0   0 💤 ±0 
1 files   ±0   0 ❌ ±0 

Results for commit 39a4709. ± Comparison against base commit f14ee05.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 19, 2025

E2e Test results - Vcast 2025sp1 - Group env_atg_server

2 files  ±0  2 suites  ±0   5m 24s ⏱️ +13s
6 tests ±0  6 ✅ ±0  0 💤 ±0  0 ❌ ±0 
8 runs  ±0  8 ✅ ±0  0 💤 ±0  0 ❌ ±0 

Results for commit 39a4709. ± Comparison against base commit f14ee05.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 19, 2025

E2e Test results - Vcast 2025sp1 - Group func_atg

2 files  ±0  2 suites  ±0   1m 31s ⏱️ +14s
6 tests ±0  6 ✅ ±0  0 💤 ±0  0 ❌ ±0 
8 runs  ±0  8 ✅ ±0  0 💤 ±0  0 ❌ ±0 

Results for commit 39a4709. ± Comparison against base commit f14ee05.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 19, 2025

E2e Test results - Vcast 2025sp1 - Group env_basis_server

2 files  ±0  2 suites  ±0   5m 50s ⏱️ -34s
6 tests ±0  6 ✅ ±0  0 💤 ±0  0 ❌ ±0 
8 runs  ±0  8 ✅ ±0  0 💤 ±0  0 ❌ ±0 

Results for commit 39a4709. ± Comparison against base commit f14ee05.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 19, 2025

E2e Test results - Vcast 2025sp1 - Group flask_icon_server

8 tests  ±0   8 ✅ ±0   1m 8s ⏱️ +10s
1 suites ±0   0 💤 ±0 
1 files   ±0   0 ❌ ±0 

Results for commit 39a4709. ± Comparison against base commit f14ee05.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 19, 2025

E2e Test results - Vcast 2025sp1 - Group basic_user_interactions

10 files  ±0  10 suites  ±0   15m 50s ⏱️ -8s
31 tests ±0  31 ✅ ±0  0 💤 ±0  0 ❌ ±0 
51 runs  ±0  51 ✅ ±0  0 💤 ±0  0 ❌ ±0 

Results for commit 39a4709. ± Comparison against base commit f14ee05.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 19, 2025

E2e Test results - Vcast 2025sp1 - Group env_atg

2 files  ±0  2 suites  ±0   5m 31s ⏱️ +8s
6 tests ±0  6 ✅ ±0  0 💤 ±0  0 ❌ ±0 
8 runs  ±0  8 ✅ ±0  0 💤 ±0  0 ❌ ±0 

Results for commit 39a4709. ± Comparison against base commit f14ee05.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 19, 2025

E2e Test results - Vcast 2025sp1 - Group basic_user_interactions_server

 9 files  ±0   9 suites  ±0   10m 40s ⏱️ -21s
25 tests ±0  25 ✅ ±0  0 💤 ±0  0 ❌ ±0 
43 runs  ±0  43 ✅ ±0  0 💤 ±0  0 ❌ ±0 

Results for commit 39a4709. ± Comparison against base commit f14ee05.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 19, 2025

E2e Test results - Vcast 2025sp1 - Group env_basis

2 files  ±0  2 suites  ±0   6m 2s ⏱️ -35s
6 tests ±0  6 ✅ ±0  0 💤 ±0  0 ❌ ±0 
8 runs  ±0  8 ✅ ±0  0 💤 ±0  0 ❌ ±0 

Results for commit 39a4709. ± Comparison against base commit f14ee05.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 19, 2025

E2e Test results - Vcast 2025sp1 - Group func_atg_server

2 files  ±0  2 suites  ±0   1m 31s ⏱️ +8s
6 tests ±0  6 ✅ ±0  0 💤 ±0  0 ❌ ±0 
8 runs  ±0  8 ✅ ±0  0 💤 ±0  0 ❌ ±0 

Results for commit 39a4709. ± Comparison against base commit f14ee05.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 19, 2025

E2e Test results - Vcast 2025sp1 - Group func_basis

2 files  ±0  2 suites  ±0   1m 39s ⏱️ +10s
6 tests ±0  6 ✅ ±0  0 💤 ±0  0 ❌ ±0 
8 runs  ±0  8 ✅ ±0  0 💤 ±0  0 ❌ ±0 

Results for commit 39a4709. ± Comparison against base commit f14ee05.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 19, 2025

E2e Test results - Vcast 2025sp1 - Group coded_tests

 3 files  ±0   3 suites  ±0   7m 3s ⏱️ -11s
17 tests ±0  17 ✅ ±0  0 💤 ±0  0 ❌ ±0 
22 runs  ±0  22 ✅ ±0  0 💤 ±0  0 ❌ ±0 

Results for commit 39a4709. ± Comparison against base commit f14ee05.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 19, 2025

E2e Test results - Vcast 2025sp1 - Group coded_tests_server

 3 files  ±0   3 suites  ±0   6m 35s ⏱️ -39s
17 tests ±0  17 ✅ ±0  0 💤 ±0  0 ❌ ±0 
22 runs  ±0  22 ✅ ±0  0 💤 ±0  0 ❌ ±0 

Results for commit 39a4709. ± Comparison against base commit f14ee05.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 19, 2025

E2e Test results - Vcast 2025sp0 - Group coded_tests_server

 3 files  ±0   3 suites  ±0   8m 21s ⏱️ +59s
17 tests ±0  17 ✅ ±0  0 💤 ±0  0 ❌ ±0 
22 runs  ±0  22 ✅ ±0  0 💤 ±0  0 ❌ ±0 

Results for commit 39a4709. ± Comparison against base commit f14ee05.

♻️ This comment has been updated with latest results.

@github-actions
Copy link
Copy Markdown

E2e Test results - Vcast 2025sp1 - Group flask_icon

8 tests  ±0   8 ✅ ±0   1m 6s ⏱️ +9s
1 suites ±0   0 💤 ±0 
1 files   ±0   0 ❌ ±0 

Results for commit 39a4709. ± Comparison against base commit f14ee05.

@github-actions
Copy link
Copy Markdown

E2e Test results - Vcast 2025sp1 - Group unit_atg

2 files  ±0  2 suites  ±0   1m 56s ⏱️ +5s
6 tests ±0  6 ✅ ±0  0 💤 ±0  0 ❌ ±0 
8 runs  ±0  8 ✅ ±0  0 💤 ±0  0 ❌ ±0 

Results for commit 39a4709. ± Comparison against base commit f14ee05.

@github-actions
Copy link
Copy Markdown

E2e Test results - Vcast 2025sp1 - Group unit_basis

2 files  ±0  2 suites  ±0   2m 53s ⏱️ +27s
6 tests ±0  6 ✅ ±0  0 💤 ±0  0 ❌ ±0 
8 runs  ±0  8 ✅ ±0  0 💤 ±0  0 ❌ ±0 

Results for commit 39a4709. ± Comparison against base commit f14ee05.

@github-actions
Copy link
Copy Markdown

E2e Test results - Vcast 2025sp1 - Group unit_atg_server

2 files  ±0  2 suites  ±0   1m 45s ⏱️ -3s
6 tests ±0  6 ✅ ±0  0 💤 ±0  0 ❌ ±0 
8 runs  ±0  8 ✅ ±0  0 💤 ±0  0 ❌ ±0 

Results for commit 39a4709. ± Comparison against base commit f14ee05.

@github-actions
Copy link
Copy Markdown

E2e Test results - Vcast 2025sp1 - Group unit_basis_server

2 files  ±0  2 suites  ±0   2m 33s ⏱️ +16s
6 tests ±0  6 ✅ ±0  0 💤 ±0  0 ❌ ±0 
8 runs  ±0  8 ✅ ±0  0 💤 ±0  0 ❌ ±0 

Results for commit 39a4709. ± Comparison against base commit f14ee05.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 19, 2025

E2e Test results - Vcast 2025sp0 - Group manage_server

15 tests   15 ✅  6m 24s ⏱️
 1 suites   0 💤
 1 files     0 ❌

Results for commit 39a4709.

♻️ This comment has been updated with latest results.

Copy link
Copy Markdown
Collaborator

@Zbigor Zbigor left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All comments have been addressed and all tests are passing.

@Den1552 Den1552 merged commit c9c27f2 into main May 19, 2025
312 checks passed
@Den1552 Den1552 deleted the manage_support_dev branch May 20, 2025 13:20
SalvatoreZagaria added a commit that referenced this pull request Jul 1, 2025
Merged main including manage support into autoreq.

I had to do some changes regarding the env ID from the testing pane.
* Add libxcb dependencies to Ubuntu24 CI Dockerfile (#254)

* Add libxkb dependencies to Ubuntu24 CI Dockerfile (#256)

* Added fix for MCDC coverage & import_coded_tests for 2025+ (#255)

Fixes the MCDC & import_coded_tests issues we have on 2025sp1

* Manage support dev (#253)

## Overview

This PR adds the functionality and a suite of automated tests for
**Manage Support**.

## Tests & Functionality Included

- **Tree Structure**: Test the correctness of the project tree
structure.
- **Add Existing Environment**: Add an existing environment to a project
node.
- **Create Compiler from CFG File**: Validate creating a compiler from a
CFG configuration.
- **Delete Compiler**: Test removing a compiler from the project.
- **Build/Execute Incremental**: Validate incremental builds and
executions.
- **Create Testsuite**: Test creating a new testsuite.
- **Delete Testsuite**: Verify testsuite deletion functionality.
- **Delete Project Environment**: Ensure environments can be properly
deleted from a project.
- **Build Single Project Environment**: Test building a single
environment separately.
- **Remove Environment from Testsuite**: Validate unlinking an
environment from a testsuite.
- **Create Environment from Source Files**: Test creating an environment
directly from source files.
- **Change Update Project Setting & Update project manually**

## Additional Notes: 

- Manage-only code is placed in the folder `src/manage`
- `tests/internal/e2e/test` now include a `manage` folder, including
files important for tests
- Because PCT wanted to load a test script by saving the file and not by
(only) pressing "Load Test Script into Environment", I had to change all
tests that had a `tab.save()`. Because this would trigger the loading
test script which led to errors.
- For many tests I added additional log awaitings because otherwise CI
was too quick.
- Some async issues had to be resolved in the source code, as we ran
into race condition problems on CI

---------

Co-authored-by: John Paliotta <john.paliotta@vector.com>
Co-authored-by: SalvatoreZagaria <salvatore.zagaria@vector.com>

* Changed CHANGELOG date (#257)

* E2e import coded test (#258)

E2E for importing coded test files. 

Resolves issue #114

* Remove developer vars from environment in release mode (#260)

* Add debug flag to get debug info from cli outputs

* Autocompletion fix and unit test for uut_prototype_stubs  (#261)

* Merge adjustments for requirements

* Deleted unused var

* Reverted commented code for server state

* Fixed vscodeignore format

---------

Co-authored-by: SalvatoreZagaria <37420335+SalvatoreZagaria@users.noreply.github.com>
Co-authored-by: Denis Moslavac <44575706+Den1552@users.noreply.github.com>
Co-authored-by: John Paliotta <john.paliotta@vector.com>
Co-authored-by: SalvatoreZagaria <salvatore.zagaria@vector.com>
Co-authored-by: Patrick Bareiss <Patrick.Bareiss@vector.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants