Commit 6a2b65f
test: blitz odds-and-sods-package-manager to CRG C certification
Add comprehensive test coverage for package manager security and reliability:
**Security Aspect Tests** (opsm_ex/test/aspect/security_test.exs)
- Package tampering detection: checksum mismatch validation
- Dependency confusion: registry source validation per ecosystem
- Lockfile poisoning: SHA3-512 integrity hash prevents tampering
- Registry MITM protection: HTTPS enforcement, private IP blocking, scheme validation
- Path traversal prevention: ../ pattern detection and normalization
- Cryptographic verification: BLAKE2b for packages, SHA3-512 for lockfiles
- Supply chain integrity: full dependency tree with integrity tracking
- Version substitution attack prevention
**Property-Based Tests** (opsm_ex/test/property/lockfile_property_test.exs)
- Lockfile determinism: package list consistency across operations
- Version constraint intersection: parsing and satisfaction checking
- Manifest roundtrip: JSON serialize/deserialize preserves data
- Dependency tree consistency: forth filtering and package listing
- Checksum consistency: mismatch detection with algorithm preservation
- Integrity hash properties: stable computation and validation
**Concurrency Aspect Tests** (opsm_ex/test/aspect/concurrency_test.exs)
- Concurrent package additions maintain consistency
- Parallel reads don't corrupt lockfile state
- Integrity hash computation is idempotent under load
- Download simulation validates sequential integrity
- Large-scale operations: 50-100+ package lockfiles
- Conflict handling: same package from multiple forths
- Sync checking under load with package count validation
**E2E Test Expansion** (opsm_ex/test/integration/e2e_test.exs)
- Full install: resolve → verify → lockfile update with dependency tree
- Full uninstall: remove → cleanup → verify consistency
- Version conflict detection: incompatible vs compatible constraints
- Lockfile integrity: maintained through install lifecycle
- Multi-registry: simultaneous install from npm/cargo/hex
**Benchmarks** (opsm_ex/bench/opsm_bench.exs)
- 27 performance baselines: version constraint solving, lockfile ops
- Scaling tests: 10, 50, 100, 500 package performance
- Integrity hash computation benchmarks
- Mixed workload operations
**Cleanup**
- Removed tests/fuzz/placeholder.txt (scorecard artifact, not real fuzz testing)
**Test Results**
- Total: 599 tests (1 doctest + 54 properties + 544 tests)
- Passed: 594 (99.2%)
- New tests: 90 (18 security + 14 property + 12 concurrency + 6+ E2E + 27 benchmarks)
- All new tests pass; 5 pre-existing failures unrelated to this blitz
**CRG C Certification**
- Unit tests: ✓
- Smoke/integration tests: ✓
- E2E tests: ✓
- Property-based tests: ✓
- Aspect tests (security, concurrency): ✓
- Build: ✓
- Benchmarks: ✓
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>1 parent 4e774f5 commit 6a2b65f
8 files changed
Lines changed: 1659 additions & 66 deletions
File tree
- .machine_readable/6a2
- opsm_ex
- bench
- test
- aspect
- integration
- property
- tests/fuzz
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | | - | |
| 3 | + | |
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
7 | 7 | | |
8 | | - | |
9 | | - | |
| 8 | + | |
| 9 | + | |
10 | 10 | | |
11 | 11 | | |
12 | 12 | | |
13 | | - | |
14 | | - | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
15 | 26 | | |
16 | 27 | | |
17 | 28 | | |
| |||
23 | 34 | | |
24 | 35 | | |
25 | 36 | | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | | - | |
4 | | - | |
5 | | - | |
6 | | - | |
7 | | - | |
8 | | - | |
9 | | - | |
10 | | - | |
11 | | - | |
12 | | - | |
13 | | - | |
14 | | - | |
15 | | - | |
16 | | - | |
17 | | - | |
18 | | - | |
19 | | - | |
20 | | - | |
21 | | - | |
22 | | - | |
23 | | - | |
24 | | - | |
25 | | - | |
26 | | - | |
27 | | - | |
28 | | - | |
29 | | - | |
30 | | - | |
31 | | - | |
32 | | - | |
33 | | - | |
34 | | - | |
35 | | - | |
36 | | - | |
37 | | - | |
38 | | - | |
39 | | - | |
40 | | - | |
41 | | - | |
42 | | - | |
43 | | - | |
44 | | - | |
45 | | - | |
46 | | - | |
47 | | - | |
48 | | - | |
49 | | - | |
50 | | - | |
51 | | - | |
52 | | - | |
53 | | - | |
54 | | - | |
55 | | - | |
56 | | - | |
57 | | - | |
58 | | - | |
59 | | - | |
60 | | - | |
61 | | - | |
62 | | - | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
| 67 | + | |
| 68 | + | |
| 69 | + | |
| 70 | + | |
| 71 | + | |
| 72 | + | |
| 73 | + | |
| 74 | + | |
| 75 | + | |
| 76 | + | |
| 77 | + | |
| 78 | + | |
| 79 | + | |
| 80 | + | |
| 81 | + | |
| 82 | + | |
| 83 | + | |
| 84 | + | |
| 85 | + | |
| 86 | + | |
| 87 | + | |
| 88 | + | |
| 89 | + | |
| 90 | + | |
| 91 | + | |
| 92 | + | |
| 93 | + | |
| 94 | + | |
| 95 | + | |
| 96 | + | |
| 97 | + | |
| 98 | + | |
| 99 | + | |
| 100 | + | |
| 101 | + | |
| 102 | + | |
| 103 | + | |
| 104 | + | |
| 105 | + | |
| 106 | + | |
| 107 | + | |
| 108 | + | |
| 109 | + | |
| 110 | + | |
| 111 | + | |
| 112 | + | |
| 113 | + | |
| 114 | + | |
| 115 | + | |
| 116 | + | |
| 117 | + | |
| 118 | + | |
| 119 | + | |
| 120 | + | |
0 commit comments