Skip to content

test: check if qa test passes #114

test: check if qa test passes

test: check if qa test passes #114

Triggered via push April 13, 2026 16:17
Status Failure
Total duration 9m 25s
Artifacts

qa-tests.yml

on: push
Fit to window
Zoom out
Zoom in

Annotations

9 errors and 1 warning
qa-tests
run_test.py exited with code 1
qa-tests
2026-04-13 16:25:29,917 - ERROR - Error in test test_allow_traffic_by_countries: 2 assertion(s) failed<br>`[line 71 → line 28] Text 'not allowed' is not part of response body: "Your IP address is blocked. Reason: not in allowlist (Your IP: 1.2.3.4)". Message: Response body should indicate IP is not allowed`<br>`[line 71 → line 61] Text 'not allowed' is not part of response body: "Your IP address is blocked. Reason: not in allowlist (Your IP: 1.2.3.4)". Message: Response body should indicate IP is not allowed again`
qa-tests
2026-04-13 16:25:19,730 - ERROR - Error running test: 2 assertion(s) failed<br>`[line 71 → line 28] Text 'not allowed' is not part of response body: "Your IP address is blocked. Reason: not in allowlist (Your IP: 1.2.3.4)". Message: Response body should indicate IP is not allowed`<br>`[line 71 → line 61] Text 'not allowed' is not part of response body: "Your IP address is blocked. Reason: not in allowlist (Your IP: 1.2.3.4)". Message: Response body should indicate IP is not allowed again`
qa-tests
2026-04-13 16:23:40,504 - ERROR - Error in test test_stored_ssrf: 1 assertion(s) failed<br>`[line 175 → line 126 → line 95] Expected status 200, got 500 - [Internal Server Error: dev.aikido.agent_api.vulnerabilities.ssrf.StoredSSRFException: Aikido Zen has blocked a stored server-side request forgery] Bypassed IP 93.184.216.34 should not be blocked`
qa-tests
2026-04-13 16:23:30,101 - ERROR - Error running test: 1 assertion(s) failed<br>`[line 175 → line 126 → line 95] Expected status 200, got 500 - [Internal Server Error: dev.aikido.agent_api.vulnerabilities.ssrf.StoredSSRFException: Aikido Zen has blocked a stored server-side request forgery] Bypassed IP 93.184.216.34 should not be blocked`
qa-tests
2026-04-13 16:23:02,746 - ERROR - Error in test test_outbound_domain_blocking: 12 assertion(s) failed<br>`[line 245 → line 217 → line 59] Text 'blocked an outbound connection' is not part of response body: Internal Server Error: dev.aikido.agent_api.vulnerabilities.outbound_blocking.BlockedOutboundException: Aikido Zen has blocked an outbound request`<br>`[line 245 → line 217 → line 65] Status code should not be 500, got 500 - Internal Server Error: dev.aikido.agent_api.vulnerabilities.outbound_blocking.BlockedOutboundException: Aikido Zen has blocked an outbound request - bypassed IP address should be allowed for evil.example.com`<br>`[line 245 → line 217 → line 70] Status code should not be 500, got 500 - Internal Server Error: dev.aikido.agent_api.vulnerabilities.outbound_blocking.BlockedOutboundException: Aikido Zen has blocked an outbound request - bypassed IP address should be allowed for new domains`<br>`[line 245 → line 217 → line 78] Text 'blocked an outbound connection' is not part of response body: Error: Aikido Zen has blocked an outbound request`<br>`[line 245 → line 217 → line 90] Text 'blocked an outbound connection' is not part of response body: Internal Server Error: dev.aikido.agent_api.vulnerabilities.outbound_blocking.BlockedOutboundException: Aikido Zen has blocked an outbound request`<br>`[line 245 → line 217 → line 98] Text 'blocked an outbound connection' is not part of response body: Internal Server Error: dev.aikido.agent_api.vulnerabilities.outbound_blocking.BlockedOutboundException: Aikido Zen has blocked an outbound request`<br>`[line 245 → line 217 → line 105] Text 'blocked an outbound connection' is not part of response body: Internal Server Error: dev.aikido.agent_api.vulnerabilities.outbound_blocking.BlockedOutboundException: Aikido Zen has blocked an outbound request`<br>`[line 245 → line 217 → line 115] Text 'blocked an outbound connection' is not part of response body: Internal Server Error: dev.aikido.agent_api.vulnerabilities.outbound_blocking.BlockedOutboundException: Aikido Zen has blocked an outbound request`<br>`[line 245 → line 217 → line 125] Text 'blocked an outbound connection' is not part of response body: Error: münchen.example.com`<br>`[line 245 → line 217 → line 134] Expected status 200, got 500 - Error: münchen-allowed.example.com - allowed Unicode domain münchen-allowed.example.com should be accessible`<br>`[line 245 → line 217 → line 140] Expected status 200, got 500 - Internal Server Error: dev.aikido.agent_api.vulnerabilities.outbound_blocking.BlockedOutboundException: Aikido Zen has blocked an outbound request - allowed Punycode domain xn--mnchen-allowed-gsb.example.com should be accessible`<br>`[line 245 → line 217 → line 181] domain1.example.com should not be in hostnames, Bypassed IPs should not report domains`
qa-tests
2026-04-13 16:22:52,562 - ERROR - Error running test: 12 assertion(s) failed<br>`[line 245 → line 217 → line 59] Text 'blocked an outbound connection' is not part of response body: Internal Server Error: dev.aikido.agent_api.vulnerabilities.outbound_blocking.BlockedOutboundException: Aikido Zen has blocked an outbound request`<br>`[line 245 → line 217 → line 65] Status code should not be 500, got 500 - Internal Server Error: dev.aikido.agent_api.vulnerabilities.outbound_blocking.BlockedOutboundException: Aikido Zen has blocked an outbound request - bypassed IP address should be allowed for evil.example.com`<br>`[line 245 → line 217 → line 70] Status code should not be 500, got 500 - Internal Server Error: dev.aikido.agent_api.vulnerabilities.outbound_blocking.BlockedOutboundException: Aikido Zen has blocked an outbound request - bypassed IP address should be allowed for new domains`<br>`[line 245 → line 217 → line 78] Text 'blocked an outbound connection' is not part of response body: Error: Aikido Zen has blocked an outbound request`<br>`[line 245 → line 217 → line 90] Text 'blocked an outbound connection' is not part of response body: Internal Server Error: dev.aikido.agent_api.vulnerabilities.outbound_blocking.BlockedOutboundException: Aikido Zen has blocked an outbound request`<br>`[line 245 → line 217 → line 98] Text 'blocked an outbound connection' is not part of response body: Internal Server Error: dev.aikido.agent_api.vulnerabilities.outbound_blocking.BlockedOutboundException: Aikido Zen has blocked an outbound request`<br>`[line 245 → line 217 → line 105] Text 'blocked an outbound connection' is not part of response body: Internal Server Error: dev.aikido.agent_api.vulnerabilities.outbound_blocking.BlockedOutboundException: Aikido Zen has blocked an outbound request`<br>`[line 245 → line 217 → line 115] Text 'blocked an outbound connection' is not part of response body: Internal Server Error: dev.aikido.agent_api.vulnerabilities.outbound_blocking.BlockedOutboundException: Aikido Zen has blocked an outbound request`<br>`[line 245 → line 217 → line 125] Text 'blocked an outbound connection' is not part of response body: Error: münchen.example.com`<br>`[line 245 → line 217 → line 134] Expected status 200, got 500 - Error: münchen-allowed.example.com - allowed Unicode domain münchen-allowed.example.com should be accessible`<br>`[line 245 → line 217 → line 140] Expected status 200, got 500 - Internal Server Error: dev.aikido.agent_api.vulnerabilities.outbound_blocking.BlockedOutboundException: Aikido Zen has blocked an outbound request - allowed Punycode domain xn--mnchen-allowed-gsb.example.com should be accessible`<br>`[line 245 → line 217 → line 181] domain1.example.com should not be in hostnames, Bypassed IPs should not report domains`
qa-tests
2026-04-13 16:21:02,766 - ERROR - Error in test test_bypassed_ip: 14 assertion(s) failed<br>`[line 156 → line 59] Expected status 200, got 429 - Request from bypass IP ::ffff:23.45.67.89 (IPv4-mapped IPv6 address (in 23.45.67.89/24 range)) should not be blocked You are rate limited by Zen. (Your IP: ::ffff:23.45.67.89)`<br>`[line 156 → line 59] Expected status 200, got 429 - Request from bypass IP ::ffff:23.45.67.89 (IPv4-mapped IPv6 address (in 23.45.67.89/24 range)) should not be blocked You are rate limited by Zen. (Your IP: ::ffff:23.45.67.89)`<br>`[line 156 → line 67] Expected status 200, got 500 - Request should not be blocked: Internal Server Error: Aikido Zen has blocked Path Traversal`<br>`[line 156 → line 72] Expected status 200, got 429 - Request should not be blocked: You are rate limited by Zen. (Your IP: ::ffff:23.45.67.89)`<br>`[line 156 → line 77] Expected status 200, got 500 - Request should not be blocked: Internal Server Error: Aikido Zen has blocked Shell Injection`<br>`[line 156 → line 84] Expected status 200, got 403 - Request with blocked user agent should not be blocked from bypass IP ::ffff:23.45.67.89 (IPv4-mapped IPv6 address (in 23.45.67.89/24 range)): You are not allowed to access this resource because you have been identified as a bot.`<br>`[line 156 → line 98] Expected status 200, got 403 - Request from bypass IP ::ffff:23.45.67.89 (IPv4-mapped IPv6 address (in 23.45.67.89/24 range)) should bypass route-level Admin IP restrictions: Your IP address is not allowed to access this resource. (Your IP: ::ffff:23.45.67.89)`<br>`[line 156 → line 105] Expected status 200, got 403 - Request from bypass IP ::ffff:23.45.67.89 (IPv4-mapped IPv6 address (in 23.45.67.89/24 range)) should bypass blocked user IDs: You are blocked by Zen.`<br>`[line 156 → line 126] Heartbeat event should not contain route POST /api/create: {'method': 'POST', 'path': '/api/create', 'hits': 1, 'apispec': {'body': {'schema': {'type': 'object', 'properties': {'name': {'type': 'string', 'optional': False}, 'age': {'type': 'number', 'optional': False}}, 'optional': False}, 'type': 'json'}, 'query': {'type': 'object', 'properties': {'name': {'type': 'array', 'items': {'type': 'string', 'optional': False}, 'optional': False}, 'url_age': {'type': 'array', 'items': {'type': 'string', 'optional': False}, 'optional': False}}, 'optional': False}}}, bypassed IPs should not generate stats or API spec data`<br>`[line 156 → line 130] Requests total should be 1, found 11`<br>`[line 156 → line 134] Attacks detected should be 0, found 2`<br>`[line 156 → line 138] Rate limited should be 0, found 3`<br>`[line 156 → line 144] Attacks detected should be 0: {'kind': 'exec_op', 'attacksDetected': {'total': 1, 'blocked': 1}, 'total': 11}, found 1`<br>`[line 156 → line 144] Attacks detected should be 0: {'kind': 'fs_op', 'attacksDetected': {'total': 1, 'blocked': 1}, 'total': 4}, found 1`
qa-tests
2026-04-13 16:20:52,548 - ERROR - Error running test: 14 assertion(s) failed<br>`[line 156 → line 59] Expected status 200, got 429 - Request from bypass IP ::ffff:23.45.67.89 (IPv4-mapped IPv6 address (in 23.45.67.89/24 range)) should not be blocked You are rate limited by Zen. (Your IP: ::ffff:23.45.67.89)`<br>`[line 156 → line 59] Expected status 200, got 429 - Request from bypass IP ::ffff:23.45.67.89 (IPv4-mapped IPv6 address (in 23.45.67.89/24 range)) should not be blocked You are rate limited by Zen. (Your IP: ::ffff:23.45.67.89)`<br>`[line 156 → line 67] Expected status 200, got 500 - Request should not be blocked: Internal Server Error: Aikido Zen has blocked Path Traversal`<br>`[line 156 → line 72] Expected status 200, got 429 - Request should not be blocked: You are rate limited by Zen. (Your IP: ::ffff:23.45.67.89)`<br>`[line 156 → line 77] Expected status 200, got 500 - Request should not be blocked: Internal Server Error: Aikido Zen has blocked Shell Injection`<br>`[line 156 → line 84] Expected status 200, got 403 - Request with blocked user agent should not be blocked from bypass IP ::ffff:23.45.67.89 (IPv4-mapped IPv6 address (in 23.45.67.89/24 range)): You are not allowed to access this resource because you have been identified as a bot.`<br>`[line 156 → line 98] Expected status 200, got 403 - Request from bypass IP ::ffff:23.45.67.89 (IPv4-mapped IPv6 address (in 23.45.67.89/24 range)) should bypass route-level Admin IP restrictions: Your IP address is not allowed to access this resource. (Your IP: ::ffff:23.45.67.89)`<br>`[line 156 → line 105] Expected status 200, got 403 - Request from bypass IP ::ffff:23.45.67.89 (IPv4-mapped IPv6 address (in 23.45.67.89/24 range)) should bypass blocked user IDs: You are blocked by Zen.`<br>`[line 156 → line 126] Heartbeat event should not contain route POST /api/create: {'method': 'POST', 'path': '/api/create', 'hits': 1, 'apispec': {'body': {'schema': {'type': 'object', 'properties': {'name': {'type': 'string', 'optional': False}, 'age': {'type': 'number', 'optional': False}}, 'optional': False}, 'type': 'json'}, 'query': {'type': 'object', 'properties': {'name': {'type': 'array', 'items': {'type': 'string', 'optional': False}, 'optional': False}, 'url_age': {'type': 'array', 'items': {'type': 'string', 'optional': False}, 'optional': False}}, 'optional': False}}}, bypassed IPs should not generate stats or API spec data`<br>`[line 156 → line 130] Requests total should be 1, found 11`<br>`[line 156 → line 134] Attacks detected should be 0, found 2`<br>`[line 156 → line 138] Rate limited should be 0, found 3`<br>`[line 156 → line 144] Attacks detected should be 0: {'kind': 'exec_op', 'attacksDetected': {'total': 1, 'blocked': 1}, 'total': 11}, found 1`<br>`[line 156 → line 144] Attacks detected should be 0: {'kind': 'fs_op', 'attacksDetected': {'total': 1, 'blocked': 1}, 'total': 4}, found 1`
qa-tests
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/setup-java@v4, AikidoSec/firewall-tester-action@v1.0.12. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/