Skip to content

Commit e60c00a

Browse files
depressiveRobottoothstonembuechse
authored
Add draft standard for end-to-end testing with Tempest (#1047)
Signed-off-by: Marvin Frommhold <depressiveRobot@users.noreply.github.com> Signed-off-by: Matthias Büchse <matthias.buechse@alasca.cloud> Co-authored-by: toothstone <f.zahn@mailbox.org> Co-authored-by: Matthias Büchse <matthias.buechse@alasca.cloud>
1 parent faee80f commit e60c00a

4 files changed

Lines changed: 318 additions & 2 deletions

File tree

Lines changed: 30 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,30 @@
1+
---
2+
title: SCS end-to-end testing
3+
type: Standard
4+
status: Draft
5+
track: IaaS
6+
description: |
7+
SCS-0128 describes standardized end-to-end testing. It was created to succeed
8+
the retired "OpenStack-powered Compute".
9+
---
10+
11+
## Introduction
12+
13+
From the beginning of the SCS project, it was always intended to reuse and include
14+
existing standards wherever appropriate, such as the Cloud-Native Computing Foundation's
15+
"Certified Kubernetes Conformance Program" or the OpenStack Interop working group's
16+
regulations regarding "OpenStack-powered Compute". Unfortunately, [the latter has been
17+
retired in September 2025](https://opendev.org/openinfra/interop).
18+
This standard is meant to carry on the torch.
19+
20+
## Motivation
21+
22+
SCS operators as well as SCS users want to be sure that the infrastructure services
23+
work as expected.
24+
25+
## Regulations
26+
27+
The end-to-end testing is performed using [Tempest](https://docs.openstack.org/tempest/latest/index.html).
28+
29+
The required tests are listed in
30+
[Tests/iaas/scs_0128_e2e_testing/tempest-tests-non-admin.lst](https://raw.githubusercontent.com/SovereignCloudStack/standards/refs/heads/main/Tests/iaas/scs_0128_e2e_testing/tempest-tests-non-admin.lst).
Lines changed: 26 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,26 @@
1+
---
2+
title: "SCS end-to-end testing: Notes"
3+
type: Supplement
4+
track: IaaS
5+
supplements:
6+
- scs-0128-v1-e2e-testing.md
7+
---
8+
9+
## Tempest introduction
10+
11+
Tempest is the OpenStack Integration Test Suite. It is a set of integration tests to be run against a live OpenStack cluster. Tempest has batteries of tests for OpenStack API validation, scenarios, and other specific tests useful in validating an OpenStack deployment.
12+
13+
See also:
14+
15+
- [Official documentation](https://docs.openstack.org/tempest/latest/)
16+
- [Current releases (with OpenStack/Python compatibility)](https://docs.openstack.org/tempest/latest/supported_version.html)
17+
18+
## Test cases
19+
20+
SCS conformance tests are expected to be executable without admin privileges (see §2 of
21+
[Regulations for achieving SCS-compatible certification](https://docs.scs.community/standards/scs-0004-v1-achieving-certification#regulations)).
22+
The list of test cases stated in the standard has been curated accordingly.
23+
24+
## How to run Tempest against your cluster
25+
26+
_TODO_ provide step-by-step walkthrough here

0 commit comments

Comments
 (0)