Bagel Finetuning Issue

[eslambakr]

Dears,

Thanks for your great efforts, and thank you so much for sharing such great work!

I tried to finetune BAGEL, but unfortunately, when I tested it, I got pure noise images.
Therefore, I am wondering if you have tested the finetuning code for Bagel, and if it works fine with you?

Thanks in advance!
Best regards.

[kcz358]

Hi, we do test and trained some of the bagel checkpoints and tested in lmms-eval. I think the overall training pipeline should be fine. We do fixed a few issues in inference for Bagel in PR. Can try if you can use the bagel lmms-engine model in lmms-eval to perform evaluation.

[kcz358]

Also, a few notice for finetuning bagel. Previous code only works for und and gen, in a recent PR #126 , we fixed the bug for edit. The vae model for bagel also has to be freeze.