Skip to content

Xformers incompatible with auto-installed torch and python versions #8

Description

@steveernst117

I seem to have solved part of the problem by replacing everything in the 'xformers' folder with the contents of the folder of the same name after downloading the zip file of this version here: https://github.com/facebookresearch/xformers/releases/tag/v0.0.24

Doing so enabled me to do inpainting tasks without problems. However, when trying img2img I get this error:

  • It was not possible to generate your image!

  • Error: No operator found for memory_efficient_attention_forward with inputs:
    query : shape=(1, 2, 1, 40) (torch.float32)
    key : shape=(1, 2, 1, 40) (torch.float32)
    value : shape=(1, 2, 1, 40) (torch.float32)
    attn_bias : <class 'NoneType'>
    p : 0.0
    decoderF is not supported because:
    xFormers wasn't build with CUDA support
    attn_bias type is <class 'NoneType'>
    operator wasn't built - see python -m xformers.info for more info
    flshattF@0.0.0 is not supported because:
    xFormers wasn't build with CUDA support
    dtype=torch.float32 (supported: {torch.float16, torch.bfloat16})
    operator wasn't built - see python -m xformers.info for more info
    tritonflashattF is not supported because:
    xFormers wasn't build with CUDA support
    dtype=torch.float32 (supported: {torch.float16, torch.bfloat16})
    operator wasn't built - see python -m xformers.info for more info
    triton is not available
    cutlassF is not supported because:
    xFormers wasn't build with CUDA support
    operator wasn't built - see python -m xformers.info for more info
    smallkF is not supported because:
    max(query.shape[-1] != value.shape[-1]) > 32
    xFormers wasn't build with CUDA support
    operator wasn't built - see python -m xformers.info for more info
    unsupported embed per head: 40.

I think it may be related to this other error that comes up first:
WARNING[XFORMERS]: Need to compile C++ extensions to use all xFormers features.
Please install xformers properly (see https://github.com/facebookresearch/xformers#installing-xformers)
Memory-efficient attention, SwiGLU, sparse and more won't be available.
Set XFORMERS_MORE_DETAILS=1 for more details

txt2img works fine.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions