-
Notifications
You must be signed in to change notification settings - Fork 4
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
No data of specific projects #238
Comments
Thanks @PieterjanVerhelst, I checked as well and I can reproduce what you said: > data_anguilla <- get_acoustic_detections(scientific_name = "Anguilla anguilla",
+ animal_project_code = "EMMN",
+ limit = FALSE)
> nrow(data_anguilla)
[1] 0
> data <- get_acoustic_detections(animal_project_code = "EMMN", limit = FALSE)
> nrow(data)
[1] 0
> animals <- get_animals(animal_project_code = "EMMN")
> animals %>% list_values(column = scientific_name)
1 unique scientific_name values
[1] "Anguilla anguilla" Based on the data retrieved with |
So the detections are missing? Or how should I interpret this? Before the adjustments of the |
@PieterjanVerhelst, @aubrivliz and I updated/corrected some aspects of the views this morning. Can you install the latest version of the package ( |
@peterdesmet the issue persists; still no data coming out from the function-call. |
Indeed, I can confirm it. |
Thanks. There are detections. You can find them by looking on emmn_animals <- get_animals(scientific_name = "Anguilla anguilla", animal_project_code = c("EMMN"))
emmn_acoustic_tag_id <- emmn_animals %>% list_values(acoustic_tag_id)
# 26 unique acoustic_tag_id values
get_acoustic_detections(acoustic_tag_id = emmn_acoustic_tag_id, limit = TRUE)
# A tibble: 100 × 20
# detection_id date_time tag_serial_number acoustic_tag_id animal_project_code animal_id
# <int> <dttm> <chr> <chr> <chr> <int>
# 1 118566863 2007-10-03 20:20:40 1078152 S256-234 NA NA
# 2 118566867 2007-10-03 20:22:58 1078152 S256-234 NA NA
# 3 118566879 2007-10-03 20:43:21 1078152 S256-234 NA NA
# 4 118566172 2007-10-03 22:56:37 1078152 S256-234 NA NA
# 5 118566173 2007-10-03 22:57:38 1078152 S256-234 NA NA
# 6 118566174 2007-10-03 23:03:32 1078152 S256-234 NA NA
# 7 118566177 2007-10-03 23:12:09 1078152 S256-234 NA NA
# 8 118566178 2007-10-03 23:12:37 1078152 S256-234 NA NA
# 9 118566179 2007-10-03 23:13:23 1078152 S256-234 NA NA
# 10 118566181 2007-10-03 23:14:42 1078152 S256-234 NA NA
# … with 90 more rows, and 14 more variables: scientific_name <chr>, acoustic_project_code <chr>,
# receiver_id <chr>, station_name <chr>, deploy_latitude <dbl>, deploy_longitude <dbl>,
# sensor_value <dbl>, sensor_unit <chr>, sensor2_value <dbl>, sensor2_unit <chr>,
# signal_to_noise_ratio <int>, source_file <chr>, qc_flag <chr>, deployment_id <int> |
Ok, I see what the issue is, there are two tags:
@PieterjanVerhelst, the one you want is the second one. However, every detection is initially associated with both (duplicating the detection) and then filtered based on a number of fields. The @aubrivliz, this is exactly what you discussed earlier this morning. I would update the AND (detection.datetime <= tag_device.battery_estimated_end_date + interval '2 year' OR tag_device.battery_estimated_end_date IS NULL) |
So if those 2 years of wiggle room are added, that means upon download I will get the duplicates as well? No problem as I can remove them afterwards, just to know, because I am downloading a huge dataset (already bouncing in memory error on the Rstudio server). |
It depends. If you are searching detections on a specific animal project code, then it will only return tags associated with animals from that project (and not other detections), thus not creating duplicates. You can always test if |
aah ok, I am indeed downloading data based on |
@PieterjanVerhelst the wiggle room has been implemented and you can test again. |
Still no data, but when reinstalling |
That is correct, only changes in the database. So, no data for: data <- get_acoustic_detections(con, scientific_name = "Anguilla anguilla",
animal_project_code = "2011_Loire",
limit = FALSE) I get 25850 detections. |
Correct! However, I still get no data for the project |
I'm confused by your "however" 😄. Are you getting data for 2011_Loire or not? These are the Anguilla anguilla detections I get for:
|
Yes, I indeed get data for |
Indeed, same for me (no records for life4fish), so we can rule out an access rights issue. Try to see if you get records by searching on |
That also doesn't return data, for example:
Note that when I apply the function |
To truly test on acoustic_tag_id, you have to drop the filter on scientific_name. But it doesn't make any difference here:
... returns no data. Is it possible this project did not generate detections for Anguilla anguilla? |
aah, but the only data that is included, is on Anguilla anguilla. So yes, it should contain data. I'll have a check if this data is in the ETN database itself. |
Update: In ETN it says there is no data available. @jreubens @aubrivliz could you check why the data from |
@peterdesmet @PieterjanVerhelst @jreubens |
@aubrivliz any news on the Lotek data? I tried to download the |
@PieterjanVerhelst all the detection data has been updated. But there is still no data avalaible for some reason. |
@PieterjanVerhelst I've made some changes in the detections_limited view, I am getting now detection data for animal_project_code = 'life4fish'. Can you verify? |
Yes! Now I can download the data and according to some quick checks I should have the data for all 146 eels in the project |
I want to download data for several
animal_projects
to which I normally have access. However, for the followinganimal_project_codes
no data is generated after running the code underneath:EMMN
2011_Loire
2004_Gudena
life4fish
The text was updated successfully, but these errors were encountered: