Skip to content

Commit 0a2db45

Browse files
committed
Added local benchmark
Signed-off-by: cafalchio <mcafalchio@gmail.com>
1 parent 718b9ac commit 0a2db45

2 files changed

Lines changed: 31 additions & 1 deletion

File tree

CHANGELOG.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -129,7 +129,7 @@ Release 1.0.6 consolidates **89 PRs** focused on **UI modernization**, **securit
129129
- **Update python call in fix file headers pre-commit to use uv run** ([#5669](https://github.com/IBM/mcp-context-forge/pull/5669))
130130
- **Version bump SecretsDetection and update field filter config** ([#5635](https://github.com/IBM/mcp-context-forge/pull/5635))
131131
- **Update secrets and reset some of content from .secrets.baseline file** ([#5622](https://github.com/IBM/mcp-context-forge/pull/5622))
132-
- **UI rewrite/tool form adjustments ** ([#5612](https://github.com/IBM/mcp-context-forge/pull/5612))
132+
- **UI rewrite/tool form adjustments** ([#5612](https://github.com/IBM/mcp-context-forge/pull/5612))
133133
- **Release/v1.0.5** ([#5509](https://github.com/IBM/mcp-context-forge/pull/5509))
134134
- **Package all js libs** ([#5481](https://github.com/IBM/mcp-context-forge/pull/5481))
135135
- **Move Rust and Go MCP servers to contextforge-examples repository** ([#5425](https://github.com/IBM/mcp-context-forge/pull/5425))

tests/performance/benchmark.md

Lines changed: 30 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,30 @@
1+
# Benchmark Results
2+
3+
This file tracks benchmark results by release for local performance runs for developers reference only.
4+
5+
## Release 1.0.6
6+
7+
### Environment
8+
9+
- Run type: local machine
10+
- Local load test command: `make load-test LOADTEST_USERS=200 LOADTEST_SPAWN_RATE=20 LOADTEST_RUN_TIME=10m`
11+
- MCP tools benchmark commands: `make testing-up && make benchmark-mcp-tools`
12+
13+
### Results
14+
15+
| Metric | Local Load Test | MCP Benchmark: `benchmark-mcp-tools` |
16+
|---|---:|---:|
17+
| Command | `make load-test LOADTEST_USERS=200 LOADTEST_SPAWN_RATE=20 LOADTEST_RUN_TIME=10m` | `make testing-up && make benchmark-mcp-tools` |
18+
| Concurrent users | 200 | - |
19+
| Ramp up | 20 | - |
20+
| Duration | 10 minutes | 60s |
21+
| Total Requests | 6,128 | 5,460 |
22+
| Total Failures | 480 (7.83%) | 1,723 (31.56%) |
23+
| Requests/sec (RPS) | 20.45 | 91.21 |
24+
| Average Response Time (ms) | 6306.41 | 1066.94 |
25+
| Min Response Time (ms) | 3.68 | 13.11 |
26+
| Max Response Time (ms) | 85570.12 | 30005.24 |
27+
| Median / p50 (ms) | 1100.00 | 230.00 |
28+
| p90 (ms) | 21000.00 | 3500.00 |
29+
| p95 (ms) | 30000.00 | 5800.00 |
30+
| p99 (ms) | 30000.00 | 13000.00 |

0 commit comments

Comments
 (0)