Skip to content

Commit bf7a877

Browse files
committed
Simplify scope yaml and report yaml
- prune old and unused content in scs-compatible-iaas.yaml - refer to scope standards (see branch feat/scope-standards) - use the respective URLs - drop now-redundant scope view - remove redundant stabilized_at - remodel modules as (potentially nested) testcase groups - simplify report yaml format - include creator (human or software with version!) - replace concept of invocations by a general log - improve rendering of reports Signed-off-by: Matthias Büchse <matthias.buechse@alasca.cloud>
1 parent 50e9e8d commit bf7a877

8 files changed

Lines changed: 249 additions & 372 deletions

File tree

Tests/scs-compatible-iaas.yaml

Lines changed: 54 additions & 130 deletions
Original file line numberDiff line numberDiff line change
@@ -1,10 +1,11 @@
11
# -- informal edit log --
22
# whenever old content is removed as per scs-0003-v1, add a line of the form
33
# - YYYY-MM-DD pruned old content; affected versions: vN, ...
4+
# - 2026-06-19 pruned old content; affected versions: v3, v4
45
# - 2025-05-22 pruned old content; affected versions: v1, v2, v3-orig, v5
56
name: SCS-compatible IaaS
67
uuid: 50393e6f-2ae1-4c5c-a62c-3b75f2abef3f
7-
url: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Tests/scs-compatible-iaas.yaml
8+
url: https://docs.scs.community/standards/scopes/scs-0501
89
variables:
910
- os_cloud
1011
scripts:
@@ -291,38 +292,35 @@ scripts:
291292
description: >-
292293
Manual check: Must fulfill all requirements of scs-0302-v1.
293294
url: https://docs.scs.community/standards/scs-0302-v1-domain-manager-role#conformance-tests
294-
modules:
295+
groups:
295296
- id: opc-v2022.11
296297
name: >-
297298
scs-0128-v1: SCS end-to-end testing (formerly OpenStack-powered Compute)
298299
url: https://docs.scs.community/standards/scs-0128-v1-e2e-testing
300+
include: []
299301
- id: scs-0100-v3.1
300302
name: Flavor naming v3.1
301303
url: https://docs.scs.community/standards/scs-0100-v3-flavor-naming
302-
targets:
303-
main:
304+
include:
304305
- scs-0100-syntax-check
305306
- scs-0100-semantics-check
306307
- id: scs-0101-v1
307308
name: Entropy v1
308309
url: https://docs.scs.community/standards/scs-0101-v1-entropy
309-
targets:
310-
main:
310+
include:
311311
- scs-0101-rngd
312312
- scs-0101-entropy-avail
313313
- scs-0101-fips-test
314314
- id: scs-0101-v1-rec
315315
name: Entropy v1
316316
url: https://docs.scs.community/standards/scs-0101-v1-entropy
317-
targets:
318-
recommended:
317+
include:
319318
- scs-0101-flavor-property
320319
- scs-0101-image-property
321320
- id: scs-0102-v1
322321
name: Image metadata v1
323322
url: https://docs.scs.community/standards/scs-0102-v1-image-metadata
324-
targets:
325-
main:
323+
include:
326324
- scs-0102-prop-architecture
327325
- scs-0102-prop-min_disk
328326
- scs-0102-prop-min_ram
@@ -340,8 +338,7 @@ modules:
340338
- id: scs-0102-v1-rec
341339
name: Image metadata v1
342340
url: https://docs.scs.community/standards/scs-0102-v1-image-metadata
343-
targets:
344-
recommended:
341+
include:
345342
- scs-0102-prop-hash_algo
346343
- scs-0102-prop-os_purpose
347344
- scs-0102-os_purpose-uniqueness
@@ -351,8 +348,7 @@ modules:
351348
- id: scs-0102-v2
352349
name: Image metadata v2
353350
url: https://docs.scs.community/standards/scs-0102-v2-image-metadata
354-
targets:
355-
main:
351+
include:
356352
- scs-0102-prop-architecture
357353
- scs-0102-prop-min_disk
358354
- scs-0102-prop-min_ram
@@ -372,17 +368,15 @@ modules:
372368
- id: scs-0102-v2-rec
373369
name: Image metadata v2
374370
url: https://docs.scs.community/standards/scs-0102-v2-image-metadata
375-
targets:
376-
recommended:
371+
include:
377372
- scs-0102-prop-hash_algo
378373
- scs-0102-prop-hypervisor_type
379374
- scs-0102-prop-hw_rng_model
380375
- scs-0102-prop-hotfix_hours
381376
- id: scs-0103-v1
382377
name: Standard flavors
383378
url: https://docs.scs.community/standards/scs-0103-v1-standard-flavors
384-
targets:
385-
main:
379+
include:
386380
- scs-0103-flavor-1v-4
387381
- scs-0103-flavor-2v-8
388382
- scs-0103-flavor-4v-16
@@ -401,8 +395,7 @@ modules:
401395
- id: scs-0103-v1-rec
402396
name: Standard flavors
403397
url: https://docs.scs.community/standards/scs-0103-v1-standard-flavors
404-
targets:
405-
recommended:
398+
include:
406399
- scs-0103-flavor-1v-4-10
407400
- scs-0103-flavor-2v-8-20
408401
- scs-0103-flavor-4v-16-50
@@ -419,34 +412,11 @@ modules:
419412
- scs-0103-flavor-16v-64
420413
- scs-0103-flavor-8v-64
421414
- scs-0103-flavor-16v-128
422-
- id: scs-0104-v1-1
423-
name: Standard images
424-
url: https://docs.scs.community/standards/scs-0104-v1-standard-images
425-
parameters:
426-
image_spec: address (URL) of an image-spec (YAML) file
427-
targets:
428-
main:
429-
- scs-0104-source-capi-1
430-
- scs-0104-source-ubuntu-2204
431-
- scs-0104-source-ubuntu-2004
432-
- scs-0104-source-debian-12
433-
- scs-0104-source-debian-11
434-
- scs-0104-image-ubuntu-2204
435-
- id: scs-0104-v1-1-rec
436-
name: Standard images
437-
url: https://docs.scs.community/standards/scs-0104-v1-standard-images
438-
parameters:
439-
image_spec: address (URL) of an image-spec (YAML) file
440-
targets:
441-
recommended:
442-
- scs-0104-image-capi-1
443415
- id: scs-0104-v1-2
444416
name: Standard images
445417
url: https://docs.scs.community/standards/scs-0104-v1-standard-images
446-
parameters:
447-
image_spec: address (URL) of an image-spec (YAML) file
448-
targets:
449-
main:
418+
# image_spec: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Tests/iaas/scs-0104-v1-images-v5.yaml
419+
include:
450420
- scs-0104-source-capi-1
451421
- scs-0104-source-capi-2
452422
- scs-0104-source-ubuntu-2404
@@ -459,70 +429,59 @@ modules:
459429
- id: scs-0104-v1-2-rec
460430
name: Standard images
461431
url: https://docs.scs.community/standards/scs-0104-v1-standard-images
462-
parameters:
463-
image_spec: address (URL) of an image-spec (YAML) file
464-
targets:
465-
recommended:
432+
# image_spec: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Tests/iaas/scs-0104-v1-images-v5.yaml
433+
include:
466434
- scs-0104-image-capi-2
467435
- scs-0104-image-debian-12
468436
- id: scs-0114-v1
469437
name: Volume Types
470438
url: https://docs.scs.community/standards/scs-0114-v1-volume-type-standard
471-
targets:
472-
main:
439+
include:
473440
- scs-0114-syntax-check
474441
- id: scs-0114-v1-rec
475442
name: Volume Types
476443
url: https://docs.scs.community/standards/scs-0114-v1-volume-type-standard
477-
targets:
478-
recommended:
444+
include:
479445
- scs-0114-encrypted-type
480446
- scs-0114-replicated-type
481447
- id: scs-0115-v1
482448
name: Default rules for security groups
483449
url: https://docs.scs.community/standards/scs-0115-v1-default-rules-for-security-groups
484-
targets:
485-
main:
450+
include:
486451
- scs-0115-default-rules
487452
- id: scs-0116-v1
488453
name: Key manager
489454
url: https://docs.scs.community/standards/scs-0116-v1-key-manager-standard
490-
targets:
491-
main:
455+
include:
492456
- scs-0116-permissions
493457
- id: scs-0116-v1-rec
494458
name: Key manager
495459
url: https://docs.scs.community/standards/scs-0116-v1-key-manager-standard
496-
targets:
497-
recommended:
460+
include:
498461
- scs-0116-presence
499462
- id: scs-0116-v1-manual
500463
name: Key manager
501464
url: https://docs.scs.community/standards/scs-0116-v1-key-manager-standard
502-
targets:
503-
preview:
465+
include:
504466
- key-manager-docs-check
505467
- id: scs-0117-v1
506468
name: Volume backup
507469
url: https://docs.scs.community/standards/scs-0117-v1-volume-backup-service
508-
targets:
509-
main:
470+
include:
510471
- scs-0117-test-backup
511472
- id: scs-0121-v1
512473
name: Availability Zones
513474
url: https://docs.scs.community/standards/scs-0121-v1-Availability-Zones-Standard
514-
targets: {}
475+
include: []
515476
- id: scs-0121-v1-manual
516477
name: Availability Zones
517478
url: https://docs.scs.community/standards/scs-0121-v1-Availability-Zones-Standard
518-
targets:
519-
preview:
479+
include:
520480
- availability-zones-check
521481
- id: scs-0123-v1
522482
name: Mandatory and Supported IaaS Services
523483
url: https://docs.scs.community/standards/scs-0123-v1-mandatory-and-supported-IaaS-services
524-
targets:
525-
main:
484+
include:
526485
- scs-0123-service-compute
527486
- scs-0123-service-identity
528487
- scs-0123-service-image
@@ -534,8 +493,7 @@ modules:
534493
- id: scs-0123-v2
535494
name: Mandatory and Supported IaaS Services
536495
url: https://docs.scs.community/standards/scs-0123-v2-services
537-
targets:
538-
main:
496+
include:
539497
- scs-0123-service-compute
540498
- scs-0123-service-identity
541499
- scs-0123-service-image
@@ -546,92 +504,58 @@ modules:
546504
- id: scs-0302-v1
547505
name: Domain Manager Role
548506
url: https://docs.scs.community/standards/scs-0302-v1-domain-manager-role
549-
targets: {}
507+
include: []
550508
- id: scs-0302-v1-manual
551509
name: Domain Manager Role
552510
url: https://docs.scs.community/standards/scs-0302-v1-domain-manager-role
553-
targets:
554-
preview:
511+
include:
555512
- domain-manager-check
556-
timeline:
557-
- date: 2026-06-11
558-
versions:
559-
next: draft
560-
v5.1: effective
561-
- date: 2025-09-09
562-
versions:
563-
next: draft
564-
v5.1: effective
565-
v4: deprecated
566-
v3: deprecated
567-
- date: 2025-07-01
568-
versions:
569-
v5.1: effective
570-
v4: deprecated
571-
v3: deprecated
572-
- date: 2025-02-01
573-
versions:
574-
v5.1: effective
575-
v4: warn
576-
v3: deprecated
577-
- date: 2024-12-19
578-
versions:
579-
v5.1: effective
580-
v4: effective
581-
v3: deprecated
582-
versions:
583-
- version: next
513+
- id: scs-compatible-iaas-next
514+
name: SCS-compatible IaaS next
515+
url: https://docs.scs.community/standards/scs-0501-v6-scs-compatible-iaas
584516
include:
585517
- opc-v2022.11
586518
- scs-0100-v3.1
587519
- scs-0101-v1
588520
- scs-0102-v2 # instead of scs-0102-v1
589521
- scs-0103-v1
590-
- ref: scs-0104-v1-2
591-
parameters:
592-
image_spec: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Tests/iaas/scs-0104-v1-images-v5.yaml
522+
- scs-0104-v1-2
593523
- scs-0114-v1
594524
- scs-0115-v1
595525
- scs-0116-v1
596526
- scs-0117-v1
597527
- scs-0121-v1
598-
- scs-0123-v2
528+
- scs-0123-v2 # instead of scs-0123-v1
599529
- scs-0302-v1
600-
- version: v5.1 # copy of v5, but with include "scs-0123-v1", which had simply been forgotten
601-
stabilized_at: 2024-12-19
530+
- id: scs-compatible-iaas-v5.1
531+
name: SCS-compatible IaaS v5.1
532+
url: https://docs.scs.community/standards/scs-0501-v5-scs-compatible-iaas
602533
include:
603534
- opc-v2022.11
604535
- scs-0100-v3.1
605536
- scs-0101-v1
606537
- scs-0102-v1
607538
- scs-0103-v1
608-
- ref: scs-0104-v1-2
609-
parameters:
610-
image_spec: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Tests/iaas/scs-0104-v1-images-v5.yaml
539+
- scs-0104-v1-2
611540
- scs-0114-v1
612541
- scs-0115-v1
613542
- scs-0116-v1
614543
- scs-0117-v1
615544
- scs-0121-v1
616545
- scs-0123-v1
617546
- scs-0302-v1
618-
- version: v4
619-
stabilized_at: 2024-02-28
620-
include:
621-
- opc-v2022.11
622-
- scs-0100-v3.1
623-
- scs-0101-v1
624-
- scs-0102-v1
625-
- scs-0103-v1
626-
- ref: scs-0104-v1-1
627-
parameters:
628-
image_spec: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Tests/iaas/scs-0104-v1-images.yaml
629-
- version: v3
630-
# comment: >
631-
# This is what our documentation wrongly stated as being v3 when we introduced v4.
632-
# What was originally v3 (and what we actually continued to test) can be found as v3-orig.
633-
stabilized_at: 2024-02-28
634-
include:
635-
- opc-v2022.11
636-
- scs-0100-v3.1
637-
- scs-0102-v1
547+
timeline:
548+
- date: 2026-06-11
549+
versions:
550+
next: draft
551+
v5.1: effective
552+
# pruned:
553+
# v4 has been deprecated since 2025-07-01
554+
# v4 has been 'warn' since 2025-02-01
555+
# v5 has been effective since 2024-12-19
556+
# v3 has been deprecated since 2024-12-19
557+
versions:
558+
- version: next
559+
test: scs-compatible-iaas-next
560+
- version: v5.1 # copy of v5, but with include "scs-0123-v1", which had simply been forgotten
561+
test: scs-compatible-iaas-v5.1

0 commit comments

Comments
 (0)