attention loss?

[YES123AS]

I encountered an issue where there was no class explicitly defined as CrossAttention in the code, which resulted in the self-attention mechanism not being called. As a result, the attention-related loss remained at 0. How should this problem be solved?

[1dadwithdignity]

I also meet this problem lol

[parham1998]

Hi, the attention mechanism is implemented through attention_control.pay.
The set_attention_control() function sets up both self and cross attention, following the Prompt-to-Prompt approach.
Have you confirmed that you installed diffusers==0.9.0?

[rudyhsu]

Hello, I encountered this problem too, the self_attention_loss remains 0. Is there any way to solve it ? Thanks !

by the way, when I switch diffusers version to 0.9.0, this error happens

[Rehmer-0131]

@rudyhsu I'm facing the same issue. When I downgrade diffusers to version 0.9.0, I get the exact same error. Before the change, self_attention_loss was also 0. I was wondering if you have solved this problem.