Skip to content

Commit 165f018

Browse files
EliEli
authored andcommitted
Add dropbox_daily recipe to repo and cleaned out unused ccf case
1 parent 4c1e4db commit 165f018

2 files changed

Lines changed: 43 additions & 17 deletions

File tree

Lines changed: 43 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,43 @@
1+
2+
# The "daily" item is for data from populate_daily.
3+
# This could be augmented by specialty items such as Mokelumne
4+
5+
6+
data:
7+
- name: daily
8+
collect:
9+
file_pattern: "{source}_{station_id}_{agency_id}_{param}_{syear}_{eyear}.csv"
10+
location: "d:/temp/test_nwis_daily/raw"
11+
recursive_search: false
12+
reader: read_ts
13+
selector: value
14+
15+
metadata:
16+
station_id: infer_from_filename
17+
source: infer_from_filename
18+
agency_id: infer_from_filename
19+
agency: registry_lookup
20+
param: infer_from_filename
21+
subloc: default
22+
unit: ft^3/s
23+
freq: D
24+
time_zone: Etc/GMT+8
25+
latitude: registry_lookup
26+
longitude: registry_lookup
27+
projection_x_coordinate: registry_lookup
28+
projection_y_coordinate: registry_lookup
29+
30+
output:
31+
repo_name: daily_formatted
32+
staging:
33+
dir: staging
34+
float_format: "%0.3f"
35+
chunk_years: False
36+
reconcile:
37+
#repo_data_dir: ./fake_repo
38+
prefer: staged
39+
allow_new_series: true
40+
inspection:
41+
recent_years: 3
42+
p3: 0.15
43+
p10: 0.05

examples/dropbox/dropbox_spec.yaml

Lines changed: 0 additions & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -21,23 +21,6 @@ data:
2121
unit: ft^3/s
2222
sublocation: default
2323

24-
- name: ccfb
25-
skip: False
26-
dest: *formatted
27-
collect:
28-
file_pattern: "CC_Gate_Positions*.csv"
29-
location: "{dropbox_home}/hydraulic_structures/incoming" # This could be understood as a default
30-
recursive_search: False
31-
reader: read_ts # Names, pointers to code etc. To be fleshed out
32-
selector: null # Usually a column name. When read_last_resort_csv is used, use null.
33-
metadata:
34-
station_id: ccfb_station
35-
source: ccfb_source
36-
agency: ccfb_agency
37-
freq: None # None for irregular, "infer" for infer.
38-
param: gate
39-
unit: m
40-
sublocation: default
4124

4225
- name: USGS Aquarius flows
4326
skip: True

0 commit comments

Comments
 (0)