Skip to content

Incorporate safetensors support to TorchAO #13713

@sayakpaul

Description

@sayakpaul

transformers supports safetensors when dealing with TorchAO quantization. We should do the same for diffusers. This will also enable group offloading with disk support for TorchAO.

If anyone's interested in working on this, that would be huge!

Metadata

Metadata

Assignees

No one assigned

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions