Skip to content

How to optimize GPU usage? #15

Open
Open
How to optimize GPU usage?#15
@deepak-newzera

Description

@deepak-newzera
deepak-newzera
opened on Jan 10, 2023

I am running the model on a batch of 500 articles and it takes around 10 to 15 GB of GPU memory.
Is there a way to optimize the GPU usage?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions