Skip to content

Latest commit

 

History

History

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 
 
 

README.md

core.collectors

Collector orchestration shared by every run_* management command.

Modules

Module Role
base_collector.py AbstractCollector (validate_config, collect() -> TrackerResult), CollectorRunnable protocol, lifecycle mixin (load_incremental_state, sync_pinecone, handle_error).
command_base.py BaseCollectorCommand — Django template: get_collectorrun (logs TrackerResult) → sync_pinecone.
../tracker_result.py GenericTrackerResult — default frozen TrackerResult DTO.
../incremental_state.py GenericIncrementalState — default frozen IncrementalState DTO.

Usage

New collectors should subclass AbstractCollector and wire a management command through BaseCollectorCommand. See Tutorial: building a collector (walkthrough), How to add a collector (checklist), and the parent core README.

Tests

../tests/test_collectors_base.py