You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
- Learning new **tasks, labels, or segmentations** from very few labeled examples
79
-
*(N-way, K-shot)*
80
+
- Learning new **tasks, labels, or segmentations** from very few labeled examples
81
+
*(N-way, K-shot)*
82
+
80
83
-**Motivation**:
81
84
- Data scarcity
82
85
- Expensive and time-consuming annotation
@@ -88,23 +91,18 @@ format:
88
91
89
92
---
90
93
91
-
### Prototypical Networks (ProtNets)
92
-
- Learn a shared **embedding space**
94
+
## Prototypical Networks (ProtNets)
95
+
96
+
- Learn a shared **embedding space** via a backbone model
93
97
- Pixels belonging to the same class are **close in feature space**
94
98
- Class representations are formed as **prototypes**
95
99
- Training follows an **episodic framework**
96
100
- Each episode consists of:
97
-
-**Support set**:
98
-
- Few images with **pixel-level masks**
99
-
- Defines the target classes
100
-
-**Query image**:
101
-
- Image where the model must segment the target classes
102
-
103
-
104
-
105
-
106
-
107
-
101
+
-**Support set**:
102
+
Few images with **pixel-level masks**
103
+
Defines the target classes
104
+
-**Query image**:
105
+
Image where the model must segment the target classes
108
106
109
107
## Prototypical Network Overview
110
108
@@ -136,13 +134,21 @@ $$
136
134
137
135
---
138
136
139
-
## (Preliminary) Results
137
+
## (Preliminary) Results
140
138
141
-
- Show performance for 1-shot / 5-shot / full-data comparison
139
+
**Meta training loss:**
140
+
The “avg episode loss” at each epoch is the average cross-entropy error over all support–query tasks in that epoch. The encoder is successfully learning a feature space where prototype-based segmentation works increasingly well.
142
141
143
-
- Show predicted masks
142
+
::: {#fig-meta-training fig-align="center"}
143
+
{width=50%}
144
+
:::
145
+
---
144
146
147
+
## (Preliminary) Results
148
+
**Show predicted masks:**
149
+
With 5-shot learning, the predicted masks have a mean IoU over 102 test samples of 0.485. Here an example:
0 commit comments