You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Ckan harvester converts the above configuration to a formatted url to gather the datasets's metadata, but it seems the syntax of the resulting url is not working properly, here is the generated url: https://dati.comune.roma.it/catalog/api/3/action/package_search?rows=100&start=0&sort=id+asc&fq=organization%3Aatac-s-p-a-azienda-per-la-mobilita+OR+organization%3Aroma-servizi-per-la-mobilita
Sending this request will return all the datasets in the remote data catalog ~340, while it should only return ~11 datasets.
I'm not sure if this is a ckan querying compatibility issue, this issue is reproducible on ckan 2.9.
The correct url format should be: https://dati.comune.roma.it/catalog/api/3/action/package_search?rows=100&start=0&sort=id+asc&fq=organization%3A(atac-s-p-a-azienda-per-la-mobilita OR roma-servizi-per-la-mobilita)
Here is a quick fix I'm using on my ckan instance:
org_filter_include = self.config.get('organizations_filter_include', [])
org_filter_exclude = self.config.get('organizations_filter_exclude', [])
iforg_filter_include:
fq_terms.append('organization:(')
fq_terms.append(' OR '.join(org_namefororg_nameinorg_filter_include))
fq_terms.append(')')
eliforg_filter_exclude:
fq_terms.append('-organization:(')
fq_terms.append(' OR '.join(org_namefororg_nameinorg_filter_exclude))
fq_terms.append(')')
Same thing applies for groups and tags.
The text was updated successfully, but these errors were encountered:
I'm trying to harvest a ckan data source https://dati.comune.roma.it/catalog using bellow filter configuration:
Ckan harvester converts the above configuration to a formatted url to gather the datasets's metadata, but it seems the syntax of the resulting url is not working properly, here is the generated url:
https://dati.comune.roma.it/catalog/api/3/action/package_search?rows=100&start=0&sort=id+asc&fq=organization%3Aatac-s-p-a-azienda-per-la-mobilita+OR+organization%3Aroma-servizi-per-la-mobilita
Sending this request will return all the datasets in the remote data catalog ~340, while it should only return ~11 datasets.
I'm not sure if this is a ckan querying compatibility issue, this issue is reproducible on ckan 2.9.
The correct url format should be:
https://dati.comune.roma.it/catalog/api/3/action/package_search?rows=100&start=0&sort=id+asc&fq=organization%3A(atac-s-p-a-azienda-per-la-mobilita OR roma-servizi-per-la-mobilita)
Here is a quick fix I'm using on my ckan instance:
Same thing applies for groups and tags.
The text was updated successfully, but these errors were encountered: