Skip to content

Commit ac8909b

Browse files
committed
add some extra notes from my meeting w tanya
1 parent 0118e17 commit ac8909b

1 file changed

Lines changed: 58 additions & 5 deletions

File tree

contrib/trait_discovery/logbook.md

Lines changed: 58 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -75,7 +75,10 @@ cub_root = "/fs/ess/PAS2136/cub2011/CUB_200_2011_ImageFolder"
7575
test_y_true_NT = cub200.data.load_attrs(cub_root, is_train=False).numpy()
7676
n_test, n_traits = test_y_true_NT.shape
7777

78-
const_ap_T = np.array([sklearn.metrics.average_precision_score(test_y_true_NT[:,i], np.zeros(n_test)) for i in range(n_traits)])
78+
const_ap_T = np.array([
79+
sklearn.metrics.average_precision_score(test_y_true_NT[:, i], np.zeros(n_test))
80+
for i in range(n_traits)
81+
])
7982
print(const_ap_T.mean()) # -> 0.83
8083
```
8184

@@ -223,8 +226,8 @@ $$$\text{Coherence} = \max_{i\ne j}\left|\left\langle\hat w_i,\hat w_j\right\ran
223226
\hat w_i = \frac{w_i}{\lVert w_i\rVert_2}$$
224227
225228
```python
226-
W = decoder.weight # (D, K)
227-
W_norm = W / W.norm(dim=0, keepdim=True) # column-normalise
229+
W = decoder.weight # (D, K)
230+
W_norm = W / W.norm(dim=0, keepdim=True) # column-normalise
228231
coherence = (W_norm.T @ W_norm).abs().triu(1).max()
229232
```
230233
@@ -1156,8 +1159,12 @@ import importlib
11561159
import sys
11571160
11581161
1159-
importlib.import_module(act_ds.md.__class__.__module__) # <module 'saev.data.shards' from '/users/PAS1576/samuelstevens/projects/saev/src/saev/data/shards.py'>
1160-
class_obj = getattr(sys.modules[act_ds.md.__class__.__module__], act_ds.md.__class__.__name__)
1162+
importlib.import_module(
1163+
act_ds.md.__class__.__module__
1164+
) # <module 'saev.data.shards' from '/users/PAS1576/samuelstevens/projects/saev/src/saev/data/shards.py'>
1165+
class_obj = getattr(
1166+
sys.modules[act_ds.md.__class__.__module__], act_ds.md.__class__.__name__
1167+
)
11611168
class_obj # <class 'saev.data.shards.Metadata'>
11621169
```
11631170
@@ -2224,3 +2231,49 @@ Very OOD
22242231
28123_CAM011406_d
22252232
28124_CAM011406_d
22262233
28143_CAM011411_d
2234+
2235+
# 03/06/2025
2236+
2237+
okay, so I got some feedback from my advisor today on this document.
2238+
2239+
For the ticks, I need to make a doc with my recommended next steps. For each of these steps:
2240+
- A description of this step
2241+
- A timeline for each step, so sort of like a cost of how much it would cost in terms of man-hours
2242+
- Why I would do that step, like why I think it's important or more important than the other steps
2243+
- The expected gain or benefit
2244+
2245+
I've added some comments as well to the main.typ doc.
2246+
2247+
Then a full transcription of my notes for SAEs:
2248+
2249+
Add future vision as well to all tasks/projects -> SAEs for butterflies are also useful for the rodent task (all closely related visual species) -> what is the general version of the task?
2250+
2251+
fridays @ 11am -> pitch SAEs to the broader ABC community
2252+
2253+
Applied to butterflies. Have a list of specific traits to bring owen in -> written for MEE or Nature MI
2254+
2255+
- Get 1+ masters' student to do a dichotomous key for fish with zach -> set up a meeting with me, zach, students and net + matt -> "How to do dichotomous keys with SAEs"
2256+
2257+
Jake -> He gets it all
2258+
2259+
Follow up with julia: I have a lot of problems (tasks/projects0 do you want to talk with Sara about this?
2260+
2261+
"SAEs can be used for dichotomous keys" -> NEed an example as a METHOD
2262+
2263+
Full Documentation
2264+
2265+
Methods paper -> Explain to biologists the computationl process/method
2266+
- Intro to SAEs why it's a tool, example applications
2267+
2268+
2269+
MEE Papers:
2270+
Title: "Generating Dichotomous Keys with SAES"
2271+
Title: "Finding Discriminative Traits in Mimic Pairs with SAEs"
2272+
2273+
Divil is in the dtails -> the Discussion section
2274+
- Examples of "bad" features (reward hacking)
2275+
2276+
Beetles: enough momentum
2277+
2278+
Concrete butterfly trait
2279+

0 commit comments

Comments
 (0)