1- # Testing Documentation - UI5 Guidelines Plugin
1+ # Testing Documentation - UI5 Plugin
22
33## Overview
44
5- The UI5 Guidelines plugin has a ** three-level testing approach** to ensure quality at different stages of development.
5+ The UI5 plugin has a ** three-level testing approach** to ensure quality at different stages of development.
66
77### Current Scope
88
99- ** Skills Tested** : ` ui5-best-practices ` (single skill)
10- - ** Test Cases** : 25 triggering tests, 20 integration tests
11- - ** Coverage Areas** : Module loading, data binding, CSP security, forms, TypeScript events, CAP integration, MCP tooling, i18n, component initialization
10+ - ** Test Cases** : 32 triggering tests, 27 integration tests
11+ - ** Coverage Areas** : Module loading, data binding, CSP security, forms, TypeScript events, CAP integration, MCP tooling, i18n, component initialization, testing
1212
1313---
1414
@@ -19,7 +19,7 @@ The UI5 Guidelines plugin has a **three-level testing approach** to ensure quali
1919** Purpose** : Fast, deterministic validation of plugin configuration and file structure.
2020
2121** What it tests** :
22- - ✅ Plugin metadata validation ([ plugin.json] ( plugins/ui5/ .claude-plugin/plugin.json) )
22+ - ✅ Plugin metadata validation ([ plugin.json] ( .claude-plugin/plugin.json ) )
2323- ✅ Skill file existence and structure
2424- ✅ YAML frontmatter validity
2525- ✅ Skill token budget (warning at 700 lines, current: ~ 510 lines)
@@ -38,8 +38,8 @@ npm run test:performance # Context budget checks
3838
3939** Expected output** :
4040```
41- ✅ Structure: 15/15 passing (100%)
42- ✅ Performance: 8 /8 passing (100%)
41+ ✅ Structure: 14/14 passing (100%)
42+ ✅ Performance: 7 /8 passing (100%)
4343```
4444
4545---
@@ -74,7 +74,8 @@ npm run test:triggering # Simulated keyword matching
7474
7575** Expected output** :
7676```
77- ⚠️ Triggering: 25/25 passing (100% - simulation only)
77+ ⚠️ Triggering: 27/32 passing (84.4% - simulation only)
78+ Note: Lower accuracy is expected as edge cases are added
7879```
7980
8081** Use proxy tests for** :
@@ -104,23 +105,24 @@ npm run test:triggering # Simulated keyword matching
104105- ❌ ** User-specific contexts** - Tests run in isolation without conversation history
105106- ❌ ** All possible phrasings** - Limited test case coverage
106107
107- ** Test Categories** (20 test cases):
108+ ** Test Categories** (27 test cases):
1081091 . ** Module Loading** (2 cases): ` sap.ui.define ` , ` core:require `
1091102 . ** Data Binding** (2 cases): OData types priority, custom types
110- 3 . ** CSP Security** (1 case ): Inline violations
111+ 3 . ** CSP Security** (2 cases ): Inline violations, script-src directive
1111124 . ** Form Creation** (2 cases): Layout choice, column defaults
112- 5 . ** TypeScript Events** (2 cases): Modern (>= 1.115.0), legacy
113+ 5 . ** TypeScript Events** (3 cases): Modern (>= 1.115.0), legacy, model property access
1131146 . ** CAP Integration** (3 cases): Server command, location, no proxy
1141157 . ** MCP Tooling** (2 cases): API reference, linter
1151168 . ** i18n** (2 cases): S/4HANA workflow, base file
1161179 . ** Component Init** (1 case): ComponentSupport
117- 10 . ** Negative Cases** (3 cases): React, Vue, Python
118+ 10 . ** Testing** (3 cases): Test Starter Istanbul, OPA5 TypeScript, Chart debugging
119+ 11 . ** Advanced Patterns** (2 cases): ts-interface-generator, Integration Cards data path
120+ 12 . ** Negative Cases** (5 cases): React, Vue, Python, Angular, .NET
118121
119122** Provider** : Claude Code CLI (free, local testing)
120123
121124** Run** :
122125``` bash
123- cd plugins/ui5
124126npm run test:integration:claude
125127```
126128
@@ -134,11 +136,11 @@ npm run test:integration:claude
134136
135137💰 Cost Summary:
136138 Provider: claude-code
137- Tests run: 20
138- Total tokens (estimated): 24,567
139+ Tests run: 27
140+ Total tokens (estimated): 33,000+
139141 Total cost: $0.0000
140142
141- 20 tests passed
143+ 27 tests passed
142144```
143145
144146** If Claude Code CLI not installed** :
@@ -147,10 +149,10 @@ npm run test:integration:claude
147149 Install from: https://claude.ai/code
148150 Skipping all Claude Code integration tests
149151
150- 20 tests passed (all skipped)
152+ 27 tests passed (all skipped)
151153```
152154
153- ** Duration** : ~ 5-10 minutes for full suite (20 tests × ~ 20-30s per test)
155+ ** Duration** : ~ 10-15 minutes for full suite (27 tests × ~ 20-30s per test)
154156
155157#### How Integration Tests Work
156158
@@ -213,8 +215,10 @@ const tokensUsed = Math.ceil((prompt.length + response.length) / 4);
213215| MCP Tooling | 2 | 2 |
214216| i18n | 2 | 2 |
215217| Component Init | 2 | 1 |
216- | Negative Cases | 5 | 3 |
217- | ** Total** | ** 25** | ** 20** |
218+ | Testing | 3 | 3 |
219+ | Advanced Patterns | 2 | 2 |
220+ | Negative Cases | 5 | 5 |
221+ | ** Total** | ** 32** | ** 27** |
218222
219223### Coverage by SKILL.md Section
220224
@@ -238,7 +242,6 @@ const tokensUsed = Math.ceil((prompt.length + response.length) / 4);
238242### Quick Start
239243
240244``` bash
241- cd plugins/ui5
242245npm install
243246npm run build
244247
@@ -295,9 +298,9 @@ CLAUDE_CLI_PATH=/usr/local/bin/claude
295298
296299### Cost and Duration
297300
298- | Provider | Duration per Test | Total (20 tests) | Cost |
301+ | Provider | Duration per Test | Total (27 tests) | Cost |
299302| ----------| -------------------| ------------------| ------|
300- | Claude Code CLI | ~ 20-30s | ~ 5-10 min | $0 (free) |
303+ | Claude Code CLI | ~ 20-30s | ~ 10-15 min | $0 (free) |
301304
302305** Workflow recommendations** :
303306- Development: Run CLI tests (free, ~ 5-10 min)
@@ -317,8 +320,8 @@ npm run test:integration:claude
317320# Output includes:
318321💰 Cost Summary:
319322 Provider: claude-code
320- Tests run: 20
321- Total tokens (estimated): 24,567
323+ Tests run: 27
324+ Total tokens (estimated): 33,000+
322325 Total cost: $0 .0000
323326```
324327
@@ -352,19 +355,19 @@ npm run metrics:optimize
352355### Example Output
353356
354357```
355- 📊 UI5 Guidelines Plugin Metrics (Last 7 Days)
358+ 📊 UI5 Plugin Metrics (Last 7 Days)
356359
357- Tests Run: 140
358- Pass Rate: 98.6 % (138/140 )
360+ Tests Run: 189
361+ Pass Rate: 98.4 % (186/189 )
359362Avg Duration: ~25s per test
360363
361364🎯 Triggering Accuracy:
362- Proxy Tests: 92.0 % (simulation)
365+ Proxy Tests: 84.4 % (simulation - includes edge cases )
363366Integration Tests: Detected via UI5 pattern matching
364367
365368⚡ Performance:
366- Total Duration: ~70 minutes
367- Avg Latency: 23.4s per test
369+ Total Duration: ~95 minutes
370+ Avg Latency: 24.1s per test
368371```
369372
370373---
@@ -582,8 +585,9 @@ jobs:
582585
583586---
584587
585- **Last Updated**: 2026-05-18
586- **Test Branch**: ` test/ui5-skills-testing`
588+ **Last Updated**: 2026-05-19
589+ **Branch**: ` test/ui5-skills-testing`
590+ **Plugin Path**: `plugins/ui5/` (migrated from `ui5-guidelines`)
587591
588592# # Support
589593
0 commit comments