File tree Expand file tree Collapse file tree
Expand file tree Collapse file tree Original file line number Diff line number Diff line change 1+
2+ # The "daily" item is for data from populate_daily.
3+ # This could be augmented by specialty items such as Mokelumne
4+
5+
6+ data :
7+ - name : daily
8+ collect :
9+ file_pattern : " {source}_{station_id}_{agency_id}_{param}_{syear}_{eyear}.csv"
10+ location : " d:/temp/test_nwis_daily/raw"
11+ recursive_search : false
12+ reader : read_ts
13+ selector : value
14+
15+ metadata :
16+ station_id : infer_from_filename
17+ source : infer_from_filename
18+ agency_id : infer_from_filename
19+ agency : registry_lookup
20+ param : infer_from_filename
21+ subloc : default
22+ unit : ft^3/s
23+ freq : D
24+ time_zone : Etc/GMT+8
25+ latitude : registry_lookup
26+ longitude : registry_lookup
27+ projection_x_coordinate : registry_lookup
28+ projection_y_coordinate : registry_lookup
29+
30+ output :
31+ repo_name : daily_formatted
32+ staging :
33+ dir : staging
34+ float_format : " %0.3f"
35+ chunk_years : False
36+ reconcile :
37+ # repo_data_dir: ./fake_repo
38+ prefer : staged
39+ allow_new_series : true
40+ inspection :
41+ recent_years : 3
42+ p3 : 0.15
43+ p10 : 0.05
Original file line number Diff line number Diff line change 2121 unit : ft^3/s
2222 sublocation : default
2323
24- - name : ccfb
25- skip : False
26- dest : *formatted
27- collect :
28- file_pattern : " CC_Gate_Positions*.csv"
29- location : " {dropbox_home}/hydraulic_structures/incoming" # This could be understood as a default
30- recursive_search : False
31- reader : read_ts # Names, pointers to code etc. To be fleshed out
32- selector : null # Usually a column name. When read_last_resort_csv is used, use null.
33- metadata :
34- station_id : ccfb_station
35- source : ccfb_source
36- agency : ccfb_agency
37- freq : None # None for irregular, "infer" for infer.
38- param : gate
39- unit : m
40- sublocation : default
4124
4225 - name : USGS Aquarius flows
4326 skip : True
You can’t perform that action at this time.
0 commit comments