-
Notifications
You must be signed in to change notification settings - Fork 0
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Data quality flags - planning #55
Comments
I have played with RSQLite and it seems straightforward. Much better than writing our own code! |
How do flags get removed from the database? Does L2 remove them? Do they ever get removed? |
Basically: is the flags database persistent between
|
|
Ameriflux https://ameriflux.lbl.gov/data/flux-data-products/data-qaqc/physical-range-module/ Pastorello, G., et al. (2020), The FLUXNET2015 dataset and the ONEFlux processing pipeline for eddy covariance data, Scientific Data, 7(1), 225, DOI:10.1038/s41597-020-0534-3 Chu, H., Christianson, D. S., Cheah, Y.-W., Pastorello, G., O’Brien, F., Geden, J., Ngo, S.-T., Hollowgrass, R., Leibowitz, K., Beekwilder, N. F., Sandesh, M., Dengel, S., Chan, S. W., Santos, A., Delwiche, K., Yi, K., Buechner, C., Baldocchi, D., Papale, D., Keenan, T. F., Biraud, S. C., Agarwal, D. A., and Torn, M. S.: AmeriFlux BASE data pipeline to support network growth and data sharing, Sci Data, 10, 614, 2023. |
UGA LTER https://gce-lter.marsci.uga.edu/gce_toolbox/wiki/QAQC.htm
|
> What about "hierarchical flags"? Discuss this with @roylrich @selinalcheng @stephpenn1 |
We want a flag database
General
Add a flag API is something like:
Timestamp
? Not necessary given ID but useful for quick separation by e.g. year/monthObservation ID
NecessarySeverity
Drop/Warning/NoteFlag type
Out_of_bounds/Timestep_outlier/Expert_opinion/...Author
Author (human or algorithmic)Remark
RemarkOther things we will want
Implementation
Data frames saved to disk (RData? something quick), probably in year/month folders for efficiencyFlags come from
Flags get written out as CSVs with
What about "hierarchical flags"? Discuss this with @roylrich @selinalcheng @stephpenn1
The text was updated successfully, but these errors were encountered: