Skip to content

A retry policy question. #943

@matecsaj

Description

@matecsaj

When a URL request fails, is the retry count for it always decremented?

I can think of a few cases where the URL is not the problem:

  • A bad proxy.
  • Target server overload.
  • Transient resource exhaustion on the local machine.

Could you clarify how Crawlee handles these situations?

Metadata

Metadata

Assignees

No one assigned

    Labels

    t-toolingIssues with this label are in the ownership of the tooling team.

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions