Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Occurrence processing for Europe (CUBE EU) #2

Open
peterdesmet opened this issue Feb 13, 2019 · 1 comment
Open

Occurrence processing for Europe (CUBE EU) #2

peterdesmet opened this issue Feb 13, 2019 · 1 comment

Comments

@peterdesmet
Copy link
Member

peterdesmet commented Feb 13, 2019 •
edited
Loading

Preprocessing

  1. Download occurrences (1?? million)
    • Rough bounding box (bigger than EEA ref grid)
    • Some quality filters
    • taxonKey (50)
  2. Load 1km EEA ref grid for Europe
  3. Randomly assign each occurrence to grid cell, within its coordinateUncertainty circle.

Regarding 2: at EEA website, only 10km and 100km are available. If we want to stitch country 1km together, we should do this in a separate repository, so that functionality can be used by others.

Regarding 3: since we take a rough bounding box, some occurrences (e.g. at sea) won't be assigned a grid cell and not included in the aggregated data.

Aggregate

  1. Aggregate by:

    • species
    • kingdom
    • year
    • grid cell

  2. Summarize by:

    • occupied: TRUE
    • min_uncertainty: min(coordinateUncertaintyInMeters)
@damianooldoni
Copy link
Contributor

Done. Documentation about structure and workflow added in README.md of the repo. Issue can be closed or left for informative reasons.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@peterdesmet @damianooldoni