Skip to content

What is the minimum storage space required for the 731 use cases publicly disclosed by swe-bench pro on huggingface? #99

Description

@twilighgt

I understand that swe-bench requires at least 120GB; details are shown in the image below.
https://github.com/SWE-bench/SWE-bench#:~:text=the%20evaluation_results%20directory.-,Warning,-SWE%2Dbench%20evaluation
Image
but,What is the minimum storage space required for the 731 use cases publicly disclosed by swe-bench pro on huggingface?
https://huggingface.co/datasets/ScaleAI/SWE-bench_Pro/viewer
Image
Furthermore, there are currently 1002 images hosted on the hub,
Image
which does not match the number publicly disclosed on huggingface. Does this include other sub-items?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions