|
13 | 13 |
|
14 | 14 | </div> |
15 | 15 |
|
| 16 | +<div align="center"> |
| 17 | + |
| 18 | +**Published at NeurIPS 2025 Datasets and Benchmarks Track (Spotlight)** |
| 19 | + |
| 20 | +</div> |
| 21 | + |
16 | 22 | We introduce **THUNDER**, a comprehensive benchmark designed to rigorously compare foundation models across various downstream tasks in computational pathology. THUNDER enables the evaluation and analysis of feature representations, robustness, and uncertainty quantification of these models across different datasets. Our benchmark encompasses a diverse collection of well-established datasets, covering multiple cancer types, image magnifications, and varying image and sample sizes. We propose an extensive set of tasks aimed at thoroughly assessing the capabilities and limitations of foundation models in digital pathology. |
17 | 23 |
|
18 | 24 | ⚡ **Paper**: [THUNDER: Tile-level Histopathology image UNDERstanding benchmark](https://arxiv.org/abs/2507.07860)\ |
19 | 25 | ⚡ **Homepage/Documentation**: [THUNDER docs](https://mics-lab.github.io/thunder/)\ |
20 | | -⚡ **Leaderboard**: [THUNDER leaderboard](https://mics-lab.github.io/thunder/leaderboard/) |
| 26 | +⚡ **Leaderboards**: [THUNDER leaderboards](https://mics-lab.github.io/thunder/leaderboards/) |
| 27 | + |
| 28 | +## News |
| 29 | + |
| 30 | +* **2025-09-30**: Patch-level SPIDER datasets have been integrated into THUNDER. See the dedicated SPIDER leaderboard [here](https://mics-lab.github.io/thunder/leaderboards/). |
| 31 | +* **2025-09-18**: THUNDER was accepted to **NeurIPS 2025 Datasets & Benchmarks Track** as a **Spotlight** presentation! |
| 32 | + |
21 | 33 |
|
22 | 34 | ## Overview |
23 | 35 |
|
@@ -130,4 +142,18 @@ If you want to use the CONCH and MUSK models, you should install them as follows |
130 | 142 | ```console |
131 | 143 | pip install git+https://github.com/Mahmoodlab/CONCH.git # CONCH |
132 | 144 | pip install git+https://github.com/lilab-stanford/MUSK.git # MUSK |
133 | | -``` |
| 145 | +``` |
| 146 | + |
| 147 | +## Citation |
| 148 | +``` |
| 149 | +@article{marza2025thunder, |
| 150 | + title={THUNDER: Tile-level Histopathology image UNDERstanding benchmark}, |
| 151 | + author={Marza, Pierre and Fillioux, Leo and Boutaj, Sofi{\`e}ne and Mahatha, Kunal and Desrosiers, Christian and Piantanida, Pablo and Dolz, Jose and Christodoulidis, Stergios and Vakalopoulou, Maria}, |
| 152 | + journal={Neural Information Processing Systems (NeurIPS) D&B Track}, |
| 153 | + year={2025} |
| 154 | +} |
| 155 | +``` |
| 156 | + |
| 157 | +## Acknowledgments |
| 158 | +This work has been partially supported by *ANR-23-IAHU-0002*, *ANR-21-CE45-0007*, *ANR-23-CE45-0029*, and the *Health Data Hub (HDH)* as part of the second edition of the *France-Québec* call for projects *Intelligence Artificielle en santé*. It was performed using computational resources from the *Mésocentre* computing center of *Université Paris-Saclay*, *CentraleSupélec* and *École Normale Supérieure Paris-Saclay* supported by *CNRS* and *Région Île-de-France*, and from *GENCI-IDRIS* |
| 159 | +(Grant *2025-AD011016068*). |
0 commit comments