5. Writing processors

Registering the processor

Before you write the processor script, add the processor script in pipeline-specs.yaml. The processor can take an optional parameter argument. For example:

    - run: processors.parse_currency_fields
      parameters:
        fields:
          - Project Cost
        characters:
          decimal: "."
          grouping: ","
          currency: "€"

to the pipeline specs template

A scraper script, like any pipeline processor, must return a generator of generators that iterates over resources and resources. Us