Skip to content

About Reproduction in Forgetting Differnet Concepts #31

@TonyZhang-sjtu

Description

@TonyZhang-sjtu

Hi, when reproducing the results of Salun on forgetting different concepts in UnlearnCanvas, we find some difficulties and I want to ask you about the implementation details and hyper-parameters. From page 20 of UnlearnCanvas(https://arxiv.org/abs/2402.11846), we got the instruction that both mask generation step and train-erase step are trained under 10 epochs.

Image

Therefore, at about Line 43 in generate_mask.py, I changed the range from 1 to 10 and for train-erase.py, we use commane --epoch 10 to set the iterations. The forgetting dataset and remaining dataset are from the data file from generate_dataset.py by default. Our modifications and commands are shown as below:

Image Image Image

We applied Salun method on concept Monet and Jellyfish, but it turns out that for Jellyfish, the results for almost all the concepts are about Architectures, but for Monet, the results are relatively reasonable. So, are there any mistakes on the setting of hyperparameters, training epochs, forgetting dataset ot remaining dataset? Would you please give us some hints on that? Thanks very much!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions