Skip to content

Commit c17eefc

Browse files
committed
Add research-method skill
1 parent 89b1782 commit c17eefc

1 file changed

Lines changed: 36 additions & 0 deletions

File tree

skills/research-method/SKILL.md

Lines changed: 36 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,36 @@
1+
---
2+
name: research-method
3+
description: Researches about a new method (scalarizer or aggregator) from the scientific literature and how to integrate it to TorchJD. Use when a contributor is interested into adding a new aggregator, scalarizer, or a new method that could be either, that is not already listed in the tracking issues.
4+
---
5+
6+
# Research new method
7+
8+
This skill researched about a new method by reading the paper and the existing implementations, proposing a plan for a TorchJD implementation.
9+
10+
**For agents:** invoke as `/implement-method method-name (paper-name)` (e.g. `/implement-method upgradi (Jacobian Descent for Multi-objective Optimization)`).
11+
If no method name is provided, ask the user for the name of the method and the title of the paper.
12+
13+
**For humans:** follow the numbered steps below to guide you in your development.
14+
15+
---
16+
17+
## Instructions
18+
19+
### Step 1: Generate a tracking summary
20+
21+
On GitHub, we have a tracking issue for scalarizers (https://github.com/SimplexLab/TorchJD/issues/667) and one for aggregators (https://github.com/SimplexLab/TorchJD/issues/665).
22+
The first goal is to generate a new row for the table in the appropriate tracking issue.
23+
You will also have to find the official implementation (if any), that could be linked in the paper, and the most known non-official implementations (search in particular in LibMTL, libmoon and pymoo, and search for more repos online). You will have to find the exact file(s) and lines in which the method is implemented.
24+
You can also write special remarks if anything deserves further attention / if you're not sure about something.
25+
Do not bother trying to find citation count or the exact venue in which the paper was published, unless you directly see this information from your initial search.
26+
27+
### Step 2: Analyze the method
28+
29+
Based on the paper and the existing implementations, find the things in the interface of the new method that are non-standard compared to existing methods. For example, is the method stateful (and in which way), random, does it require some warm-up period, other stats than those provided through the forward method (like losses for aggregators), and so on. Report all of those non-standard things.
30+
31+
### Step 3: Produce summary row
32+
33+
Produce and output a row that can be directly copy-pasted to this table, but do not modify the issue yourself. Propose to post a comment on the issue with the row.
34+
35+
36+
---

0 commit comments

Comments
 (0)