Skip to content

Commit d2fcbb6

Browse files
aliyuldashevaliyuldashev
authored
Merge pull request #113 from RedTeamSubnet/challenge/hfp
New historical_fingerprinter challenge and improve changelog automation
2 parents a3d9553 + 7f34a22 commit d2fcbb6

32 files changed

Lines changed: 1974 additions & 110 deletions

‎.github/ISSUE_TEMPLATE/bug_report.yml‎

Lines changed: 159 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,159 @@
1+
name: Bug Report
2+
description: Report a bug or unexpected behavior in RedTeam Core
3+
title: "[Bug]: "
4+
labels: ["bug", "triage"]
5+
assignees:
6+
- aliyuldashev
7+
body:
8+
- type: markdown
9+
attributes:
10+
value: |
11+
Thanks for taking the time to report this bug! This helps us improve RedTeam Core.
12+
13+
Please search [existing issues](../../issues) to avoid duplicates.
14+
15+
- type: input
16+
id: contact
17+
attributes:
18+
label: Contact Details
19+
description: How can we get in touch with you if we need more info?
20+
placeholder: ex. email@example.com or Discord username
21+
validations:
22+
required: false
23+
24+
- type: textarea
25+
id: bug-description
26+
attributes:
27+
label: Bug Description
28+
description: |
29+
Describe what happened and what you expected to happen.
30+
Be specific about the behavior you observed.
31+
placeholder: |
32+
Example:
33+
- Expected: Challenge should validate and return score
34+
- Actual: Challenge throws validation error and crashes
35+
validations:
36+
required: true
37+
38+
- type: textarea
39+
id: reproduction-steps
40+
attributes:
41+
label: Steps to Reproduce
42+
description: Please provide detailed steps to reproduce the issue
43+
placeholder: |
44+
1. Start RedTeam miner with `python neurons/miner.py --netuid ...`
45+
2. Connect to challenge endpoint
46+
3. Submit solution payload
47+
4. Observe error in logs
48+
render: markdown
49+
validations:
50+
required: true
51+
52+
- type: dropdown
53+
id: version
54+
attributes:
55+
label: RedTeam Version
56+
description: What version of RedTeam Core are you running?
57+
options:
58+
- v4.3.1 (Latest)
59+
- v4.3.0
60+
- v4.2.2
61+
- v4.2.1
62+
- v4.2.0
63+
- Other (specify in description)
64+
default: 0
65+
validations:
66+
required: true
67+
68+
- type: dropdown
69+
id: component
70+
attributes:
71+
label: Component
72+
description: Which component is affected?
73+
multiple: true
74+
options:
75+
- Miner (neurons/miner.py)
76+
- Validator (neurons/validator.py)
77+
- Challenge System
78+
- API Endpoints
79+
- Ada Detection Challenge
80+
- Dev Fingerprinter Challenge
81+
- Historical Fingerprinter Challenge
82+
- Core Library
83+
- Docker/Compose Setup
84+
- Documentation
85+
86+
- type: dropdown
87+
id: environment
88+
attributes:
89+
label: Environment
90+
description: Where are you running RedTeam?
91+
options:
92+
- Local Development
93+
- Docker Compose
94+
- Production Server
95+
- Cloud Instance (AWS/GCP/Azure)
96+
- Other (specify in description)
97+
validations:
98+
required: true
99+
100+
- type: textarea
101+
id: system-info
102+
attributes:
103+
label: System Information
104+
description: |
105+
Please provide your system details (run `python --version && pip list | grep -E "(redteam|bittensor)"`)
106+
placeholder: |
107+
- OS: Ubuntu 22.04 / macOS 13 / Windows 11
108+
- Python: 3.10.12
109+
- redteam_core: 4.3.1
110+
- bittensor: 8.4.0
111+
- Docker: 24.0.0 (if applicable)
112+
render: text
113+
validations:
114+
required: true
115+
116+
- type: textarea
117+
id: logs
118+
attributes:
119+
label: Error Logs
120+
description: |
121+
Please include relevant log output, stack traces, or error messages.
122+
Remove any sensitive information (private keys, personal data).
123+
placeholder: Paste your logs here...
124+
render: shell
125+
validations:
126+
required: false
127+
128+
- type: input
129+
id: config
130+
attributes:
131+
label: Configuration
132+
description: Any relevant configuration details (netuid, wallet name, etc.)
133+
placeholder: "netuid: 37, wallet: my-wallet, axon.port: 8091"
134+
validations:
135+
required: false
136+
137+
- type: checkboxes
138+
id: checklist
139+
attributes:
140+
label: Pre-submission Checklist
141+
description: Please verify you've completed these steps
142+
options:
143+
- label: I searched existing issues to avoid duplicates
144+
required: true
145+
- label: I'm using a supported Python version (3.10+)
146+
required: true
147+
- label: I've included relevant logs and error messages
148+
required: false
149+
- label: I can reproduce this issue consistently
150+
required: false
151+
152+
- type: textarea
153+
id: additional-context
154+
attributes:
155+
label: Additional Context
156+
description: Any other information that might be helpful (screenshots, related issues, etc.)
157+
placeholder: Add any other context about the problem here.
158+
validations:
159+
required: false

‎.github/ISSUE_TEMPLATE/challenge_issue.yml‎

Lines changed: 172 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,172 @@
1+
name: Challenge Issue
2+
description: Report problems or improvements for specific challenges (Ada Detection, Dev Fingerprinter, etc.)
3+
title: "[Challenge]: "
4+
labels: ["challenge", "triage"]
5+
assignees:
6+
- aliyuldashev
7+
body:
8+
- type: markdown
9+
attributes:
10+
value: |
11+
Report issues specific to RedTeam challenges or suggest improvements.
12+
13+
For general bugs, please use the [Bug Report](./bug_report.yml) template instead.
14+
15+
- type: dropdown
16+
id: challenge-type
17+
attributes:
18+
label: Challenge Type
19+
description: Which challenge is this issue about?
20+
options:
21+
- Ada Detection Challenge
22+
- Dev Fingerprinter Challenge
23+
- Historical Fingerprinter Challenge
24+
- Challenge System (General)
25+
- New Challenge Proposal
26+
- Other (specify in description)
27+
default: 0
28+
validations:
29+
required: true
30+
31+
- type: dropdown
32+
id: issue-type
33+
attributes:
34+
label: Issue Type
35+
description: What kind of issue is this?
36+
options:
37+
- Bug/Error in Challenge
38+
- Performance Issue
39+
- Scoring Problem
40+
- False Positive/Negative
41+
- Documentation Issue
42+
- Challenge Improvement
43+
- New Test Case
44+
- Configuration Problem
45+
validations:
46+
required: true
47+
48+
- type: textarea
49+
id: issue-description
50+
attributes:
51+
label: Issue Description
52+
description: |
53+
Describe the issue in detail. Include:
54+
- What you were trying to do
55+
- What happened vs what you expected
56+
- How this affects challenge participants
57+
placeholder: |
58+
The Ada Detection challenge incorrectly flags legitimate browser automation
59+
as bot behavior when using specific timing patterns, leading to false positives
60+
for valid solutions.
61+
validations:
62+
required: true
63+
64+
- type: textarea
65+
id: reproduction-data
66+
attributes:
67+
label: Reproduction Data
68+
description: |
69+
Provide test data, inputs, or steps that reproduce this issue.
70+
**Remove any sensitive information** (tokens, private keys, personal data).
71+
placeholder: |
72+
Test payload:
73+
```json
74+
{
75+
"browser": "chrome",
76+
"actions": [...],
77+
"timing": [100, 200, 150]
78+
}
79+
```
80+
81+
Expected score: 0.85
82+
Actual score: 0.12
83+
render: markdown
84+
validations:
85+
required: false
86+
87+
- type: input
88+
id: challenge-version
89+
attributes:
90+
label: Challenge Version/Commit
91+
description: What version of the challenge are you testing against?
92+
placeholder: "v2.0.3 or commit hash: abc123def"
93+
validations:
94+
required: false
95+
96+
- type: textarea
97+
id: environment-details
98+
attributes:
99+
label: Environment Details
100+
description: |
101+
Provide details about your testing environment
102+
placeholder: |
103+
- RedTeam Core: v4.3.1
104+
- Challenge running in: Docker/Local/Cloud
105+
- Browser (if applicable): Chrome 120.0
106+
- Test framework: pytest/custom
107+
- Network latency: 50ms
108+
render: text
109+
validations:
110+
required: false
111+
112+
- type: textarea
113+
id: logs-output
114+
attributes:
115+
label: Logs and Output
116+
description: |
117+
Include relevant logs, error messages, or challenge output.
118+
Remove sensitive information.
119+
placeholder: Paste logs here...
120+
render: shell
121+
validations:
122+
required: false
123+
124+
- type: dropdown
125+
id: impact-level
126+
attributes:
127+
label: Impact Level
128+
description: How severely does this affect challenge participants?
129+
options:
130+
- Critical (challenge unusable)
131+
- High (significant scoring issues)
132+
- Medium (affects some scenarios)
133+
- Low (minor issue)
134+
validations:
135+
required: true
136+
137+
- type: textarea
138+
id: proposed-solution
139+
attributes:
140+
label: Proposed Solution
141+
description: |
142+
If you have ideas for fixing this issue, please describe them.
143+
Include any relevant code snippets or algorithm changes.
144+
placeholder: |
145+
Suggested fix:
146+
1. Adjust timing threshold from 100ms to 50ms
147+
2. Add whitelist for legitimate automation patterns
148+
3. Improve scoring algorithm to weight behavior patterns differently
149+
validations:
150+
required: false
151+
152+
- type: checkboxes
153+
id: testing-checklist
154+
attributes:
155+
label: Testing Checklist
156+
description: Have you verified these aspects?
157+
options:
158+
- label: I followed documentation and setup instructions in docs.theredteam.io
159+
- label: I tested with multiple browsers/environments
160+
- label: I verified this isn't a configuration issue
161+
- label: I checked the challenge documentation
162+
- label: I can reproduce this consistently
163+
164+
- type: textarea
165+
id: additional-info
166+
attributes:
167+
label: Additional Information
168+
description: |
169+
Any other context, related issues, or helpful information?
170+
Screenshots, performance metrics, or research links are welcome.
171+
validations:
172+
required: false

‎.github/ISSUE_TEMPLATE/config.yml‎

Lines changed: 17 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,17 @@
1+
blank_issues_enabled: false
2+
contact_links:
3+
- name: 𝕭 RedTeam Community in Bittensor
4+
url: https://discord.com/channels/799672011265015819/1319313447435108413
5+
about: Join the RedTeam community channel in Bittensor for discussions and support
6+
- name: 💬 Our Discord Community
7+
url: https://discord.gg/kNFhgStX
8+
about: Join our Discord server for real-time chat and community support
9+
- name: 📖 Documentation
10+
url: https://docs.theredteam.io
11+
about: Check our comprehensive documentation for setup guides and API references
12+
- name: 🚀 Discussions
13+
url: https://github.com/RedTeamSubnet/RedTeam/discussions
14+
about: General discussions, ideas, and community Q&A (use if discussions are enabled)
15+
- name: 🔒 Security Issues
16+
url: https://github.com/RedTeamSubnet/RedTeam/security
17+
about: Report security vulnerabilities privately via GitHub Security

0 commit comments

Comments
 (0)