Skip to content

Commit c1b78ff

Browse files
committed
upload
1 parent 07f161c commit c1b78ff

5 files changed

Lines changed: 52 additions & 43 deletions

File tree

4.4 MB
Loading
26.2 KB
Loading
1.28 MB
Loading

presentation/tutorial-new-tutorial-group-1.html

Lines changed: 26 additions & 23 deletions
Large diffs are not rendered by default.

presentation/tutorial-new-tutorial-group-1.qmd

Lines changed: 26 additions & 20 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
---
22
title: "Few-Shot Learning for Rooftop Detection in Satellite Imagery"
33
subtitle: "Deep Learning Tutorial"
4-
author: "Giorgio Coppala, Nadine Daum, Elena Dreyer, Nico Reichardt"
4+
author: "Giorgio Coppola, Nadine Daum, Elena Dreyer, Nico Reichardt"
55
bibliography: refs.bib
66

77

@@ -68,15 +68,18 @@ format:
6868
:::
6969

7070
::: column
71-
![](figures/grids_animation.gif){width=80% style="margin-left: 30%;"}
71+
![](figures/grids_animation.gif){width=60% style="margin-left: 30%;"}
72+
![](figures/Geneva_grid_map.png){width=82% style="margin-left: 30%;"}
73+
7274
:::
7375
:::
7476

7577
## Few Shot Learning in General
7678

7779
### Few-Shot Learning (FSL)
78-
- Learning new **tasks, labels, or segmentations** from very few labeled examples
79-
*(N-way, K-shot)*
80+
- Learning new **tasks, labels, or segmentations** from very few labeled examples
81+
*(N-way, K-shot)*
82+
8083
- **Motivation**:
8184
- Data scarcity
8285
- Expensive and time-consuming annotation
@@ -88,23 +91,18 @@ format:
8891

8992
---
9093

91-
### Prototypical Networks (ProtNets)
92-
- Learn a shared **embedding space**
94+
## Prototypical Networks (ProtNets)
95+
96+
- Learn a shared **embedding space** via a backbone model
9397
- Pixels belonging to the same class are **close in feature space**
9498
- Class representations are formed as **prototypes**
9599
- Training follows an **episodic framework**
96100
- Each episode consists of:
97-
- **Support set**:
98-
- Few images with **pixel-level masks**
99-
- Defines the target classes
100-
- **Query image**:
101-
- Image where the model must segment the target classes
102-
103-
104-
105-
106-
107-
101+
- **Support set**:
102+
Few images with **pixel-level masks**
103+
Defines the target classes
104+
- **Query image**:
105+
Image where the model must segment the target classes
108106

109107
## Prototypical Network Overview
110108

@@ -136,13 +134,21 @@ $$
136134

137135
---
138136

139-
## (Preliminary) Results
137+
## (Preliminary) Results
140138

141-
- Show performance for 1-shot / 5-shot / full-data comparison
139+
**Meta training loss:**
140+
The “avg episode loss” at each epoch is the average cross-entropy error over all support–query tasks in that epoch. The encoder is successfully learning a feature space where prototype-based segmentation works increasingly well.
142141

143-
- Show predicted masks
142+
::: {#fig-meta-training fig-align="center"}
143+
![](figures/meta_training_loss.png){width=50%}
144+
:::
145+
---
144146

147+
## (Preliminary) Results
148+
**Show predicted masks:**
149+
With 5-shot learning, the predicted masks have a mean IoU over 102 test samples of 0.485. Here an example:
145150

151+
![](figures/predicted_mask.png){width=60% fig-align="center"}
146152

147153
## Wrap-Up/ Discussion
148154

0 commit comments

Comments
 (0)