Skip to content

Download script issue #46

Description

@Holloworker

Unable to download the file after n=30
For example:

python download.py --download_folder=MVimages_full --data_name=MVImgNet_origin --skip_first_n=30

terminal output:
LAYER 0: Fetching initial URL: https://cuhko365.sharepoint.com/:f:/s/GAP_Lab_MVImgNet/Eqr0CanUxwhMqCuEqgZ7ZlgBq96EGddlT_WrgLIlZWhyWA?e=p31m4o
LAYER 0: Redirect URL: https://cuhko365.sharepoint.com/sites/GAP_Lab_MVImgNet/Shared%20Documents/Forms/AllItems.aspx?id=%2Fsites%2FGAP_Lab_MVImgNet%2FShared%20Documents%2FMVImgNet_Release%2FMVImgNet_origin&p=true&ga=1
LAYER 0: Query parameters: {'id': '/sites/GAP_Lab_MVImgNet/Shared Documents/MVImgNet_Release/MVImgNet_origin', 'p': 'true', 'ga': '1'}
LAYER 0: Extracted siteAbsoluteUrl: https://cuhko365.sharepoint.com/sites/GAP_Lab_MVImgNet
LAYER 0: Extracted listUrl: /sites/GAP_Lab_MVImgNet/Shared Documents
LAYER 0: Extracted formDigestValue: Present
LAYER 0: Using list_server_relative_url_for_gql: /sites/GAP_Lab_MVImgNet/Shared Documents
LAYER 0: Using current_folder_server_relative_url: /sites/GAP_Lab_MVImgNet/Shared Documents/MVImgNet_Release/MVImgNet_origin
LAYER 0: GraphQL API Endpoint: https://cuhko365.sharepoint.com/sites/GAP_Lab_MVImgNet/_api/v2.1/graphql
LAYER 0: Pagination request URL (first 150): https://cuhko365.sharepoint.com/sites/GAP_Lab_MVImgNet/_api/web/GetListUsingPath(DecodedUrl='/sites/GAP_Lab_MVImgNet/Shared Documents')/RenderListData
LAYER 0: Error in pagination response: {"code": "-1, Microsoft.SharePoint.WebPartPages.DataFormWebPartException", "message": {"lang": "zh-CN", "value": "XmlDefinition \u5c5e\u6027\u5305\u542b\u65e0\u6548 XML\u3002"}}

And then script ends without downloading.
Maybe there are problems with GraphQL page limit?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions