Skip to content

Commit fa7fe7e

Browse files
Add Evaluation Attentive Probes section with comprehensive dataset table
Co-authored-by: FeilongTangmonash <152372878+FeilongTangmonash@users.noreply.github.com>
1 parent cac22a7 commit fa7fe7e

1 file changed

Lines changed: 76 additions & 0 deletions

File tree

README.md

Lines changed: 76 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -138,7 +138,83 @@ We compare the performance of different vision encoders using the Attentive Prob
138138
</picture>
139139
</p>
140140

141+
<h4>Evaluation Attentive Probes</h4>
141142

143+
<p>
144+
We release the attentive probing artifacts for our codec-based model across multiple video understanding benchmarks.
145+
For each dataset, we provide the codec-derived patch indices, training logs, model checkpoints, and final evaluation results.
146+
</p>
147+
148+
<table>
149+
<thead>
150+
<tr>
151+
<th rowspan="2">Model</th>
152+
<th colspan="4">SSv2</th>
153+
<th colspan="4">Diving48</th>
154+
<th colspan="4">Perception Test</th>
155+
<th colspan="4">CharadesEgo</th>
156+
<th colspan="4">Epic-Verb</th>
157+
<th colspan="4">Epic-Noun</th>
158+
<th colspan="4">Kinetics-400</th>
159+
<th colspan="4">HMDB51</th>
160+
</tr>
161+
<tr>
162+
<th>Codec Index</th><th>Logs</th><th>Checkpoint</th><th>Result</th>
163+
<th>Codec Index</th><th>Logs</th><th>Checkpoint</th><th>Result</th>
164+
<th>Codec Index</th><th>Logs</th><th>Checkpoint</th><th>Result</th>
165+
<th>Codec Index</th><th>Logs</th><th>Checkpoint</th><th>Result</th>
166+
<th>Codec Index</th><th>Logs</th><th>Checkpoint</th><th>Result</th>
167+
<th>Codec Index</th><th>Logs</th><th>Checkpoint</th><th>Result</th>
168+
<th>Codec Index</th><th>Logs</th><th>Checkpoint</th><th>Result</th>
169+
<th>Codec Index</th><th>Logs</th><th>Checkpoint</th><th>Result</th>
170+
</tr>
171+
</thead>
172+
<tbody>
173+
<tr>
174+
<td><b>OV-Encoder (Codec)</b></td>
175+
176+
<td><a href="codec_index/ssv2.json">index</a></td>
177+
<td><a href="logs/ssv2.log">log</a></td>
178+
<td><a href="checkpoints/ssv2.pt">ckpt</a></td>
179+
<td>58.4%</td>
180+
181+
<td><a href="codec_index/diving48.json">index</a></td>
182+
<td><a href="logs/diving48.log">log</a></td>
183+
<td><a href="checkpoints/diving48.pt">ckpt</a></td>
184+
<td>66.0%</td>
185+
186+
<td><a href="codec_index/perception_test.json">index</a></td>
187+
<td><a href="logs/perception_test.log">log</a></td>
188+
<td><a href="checkpoints/perception_test.pt">ckpt</a></td>
189+
<td>59.7%</td>
190+
191+
<td><a href="codec_index/charadesego.json">index</a></td>
192+
<td><a href="logs/charadesego.log">log</a></td>
193+
<td><a href="checkpoints/charadesego.pt">ckpt</a></td>
194+
<td>12.1%</td>
195+
196+
<td><a href="codec_index/epic_verb.json">index</a></td>
197+
<td><a href="logs/epic_verb.log">log</a></td>
198+
<td><a href="checkpoints/epic_verb.pt">ckpt</a></td>
199+
<td>62.2%</td>
200+
201+
<td><a href="codec_index/epic_noun.json">index</a></td>
202+
<td><a href="logs/epic_noun.log">log</a></td>
203+
<td><a href="checkpoints/epic_noun.pt">ckpt</a></td>
204+
<td>53.9%</td>
205+
206+
<td><a href="codec_index/k400.json">index</a></td>
207+
<td><a href="logs/k400.log">log</a></td>
208+
<td><a href="checkpoints/k400.pt">ckpt</a></td>
209+
<td>84.3%</td>
210+
211+
<td><a href="codec_index/hmdb51.json">index</a></td>
212+
<td><a href="logs/hmdb51.log">log</a></td>
213+
<td><a href="checkpoints/hmdb51.pt">ckpt</a></td>
214+
<td>83.5%</td>
215+
</tr>
216+
</tbody>
217+
</table>
142218

143219
## ⚡ Quick Start
144220

0 commit comments

Comments
 (0)