Skip to content

Commit d1b1b7a

Browse files
committed
Update challenge website
1 parent 70d3bd4 commit d1b1b7a

1 file changed

Lines changed: 31 additions & 15 deletions

File tree

docs/tdl-challenge-2026/index.rst

Lines changed: 31 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ and hosted at the second `Topology, Algebra, and Geometry in Data Science (TAG-D
88
*Organizers:* Guillermo Bernárdez, Lev Telyatnikov, Mathilde Papillon, Marco Montagna, Louisa Cornelis, Louis Van Langendonck, Olga Fink, Nina Miolane.
99

1010
.. seealso::
11-
Link to the challenge repository: `<https://github.com/geometric-intelligence/TopoBench>`__.
11+
Link to the challenge repository: `geometric-intelligence/TopoBench <https://github.com/geometric-intelligence/TopoBench>`__.
1212

1313

1414
Motivation
@@ -110,8 +110,11 @@ PMLR through Topology, Algebra, and Geometry in Machine Learning/Data Science
110110
🏆 **Cash prizes**: Two winning teams (one per track) will be announced at
111111
TAG-DS 2026 during the Awards Ceremony.
112112

113-
- 💰 **Track 1 (GNNs) winner:** $1,000 USD (sponsored by `Arlequin AI <https://www.arlq.ai/>`__ and `New Theory <https://www.newtheory.ai/>`__).
114-
- 💰 **Track 2 (TNNs) winner:** $1,000 USD (sponsored by `Arlequin AI <https://www.arlq.ai/>`__ and `New Theory <https://www.newtheory.ai/>`__).
113+
- 💰 **Track 1 (GNNs):** 1st place $1,000 USD, 2nd place $400 USD (sponsored by `New Theory <https://www.newtheory.ai/>`__).
114+
- 💰 **Track 2 (TNNs):** 1st place $1,000 USD, 2nd place $400 USD (sponsored by `Arlequin AI <https://www.arlq.ai/>`__).
115+
- 💰 **Honorable mentions:** $700 USD split across other outstanding submissions (additional evaluation notebook
116+
with further benchmarking, particularly challenging implementations, participants who submit multiple
117+
high-quality submissions, etc).
115118

116119
🌴 **Research internship — Geometric Intelligence Lab, UCSB (USA):**
117120
A team, pending evaluation results and interest, will be invited for a visit
@@ -228,10 +231,8 @@ title must follow this format:
228231

229232
``Track: [Track1|Track2]; Team name: <team name>; Model: <Model Name>``
230233

231-
Submissions may implement models already proposed in the literature or
232-
**novel architectures**. For novel models, neither the challenge nor its
233-
related publications will prevent you from publishing your own work — you
234-
retain full credit for your contribution.
234+
Submissions must implement models already proposed in the literature and must cite the associated
235+
publication or pre-print in the PR description.
235236

236237
Core Requirements (Both Tracks)
237238
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
@@ -261,6 +262,17 @@ Core Requirements (Both Tracks)
261262
(e.g., ``configs/model/graph/gcn.yaml`` for Track 1,
262263
``configs/model/simplicial/sccnn.yaml`` for Track 2) as a template.
263264

265+
3. **Results as Produced by Provided Notebook — Required**
266+
267+
For the first time this year, we are providing a lightweight benchmarking task to compare all
268+
submitted models. Run the provided Jupyter Notebook on your model at:
269+
270+
``TopoBench/2026_tdl_challenge/run_evaluation.ipynb``
271+
272+
This will automatically produce a ``results.json`` file containing your model's results and
273+
computational complexity on the provided tasks. Your PR must include this results file. If you do
274+
not have access to any GPU resource, please reach out to the challenge organizers for help.
275+
264276
Optional Components
265277
~~~~~~~~~~~~~~~~~~~
266278

@@ -367,14 +379,14 @@ Evaluation
367379
Award Categories
368380
~~~~~~~~~~~~~~~~
369381

370-
One winning submission will be crowned per track:
382+
The top two submissions per track will be awarded cash prizes:
371383

372-
- **Track 1:** Best **GNN model** implementation
373-
- **Track 2:** Best **TNN model** implementation
384+
- **Track 1:** Best and second best **GNN model** implementations
385+
- **Track 2:** Best and second best **TNN model** implementations
374386

375387
Additionally, **two teams** will be selected for **invited visits** across
376388
both tracks based on overall quality, level of difficulty, and impact of
377-
contribution. **Honorable mentions** may also be awarded.
389+
contribution. **Honorable mentions** will also be awarded and, for the first time this year, be given cash prizes.
378390

379391
Evaluation Procedure
380392
~~~~~~~~~~~~~~~~~~~~
@@ -384,11 +396,15 @@ A panel of TopoBench maintainers and collaborators will vote using the
384396

385397
Evaluation criteria include:
386398

387-
- **Correctness:** Does the submission implement the model correctly? Is it
388-
reasonable and well-defined?
399+
- **Correctness:** Does the submission correctly implement the SOTA model as it is described in the
400+
literature? Modifications to respect TopoBench computational requirements are allowed.
389401
- **Code quality:** How readable and clean is the implementation? How well
390-
does the submission respect the requirements?
391-
- **Documentation & tests:** Are docstrings clear? Are unit tests robust?
402+
does the submission respect the requirements (unit tests, memory usage, and so on)?
403+
- **Benchmark on GraphUniverse datasets:** Is the model correctly benchmarked on the GraphUniverse
404+
datasets as provided? Does the model produce reasonable results?
405+
- **Documentation & tests:** Do the docstrings clearly describe the code? Do the docstrings make
406+
explicit references to the original equations in the paper/preprint associated to the model, and/or
407+
the original model implementation? Are unit tests robust?
392408

393409
.. important::
394410
These criteria do **not** reward final model performance on the dataset.

0 commit comments

Comments
 (0)