Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[ENG-4380][ENG-4382] iri-based ingest and search #806

Merged
merged 160 commits into from
Aug 22, 2023
Merged

[ENG-4380][ENG-4382] iri-based ingest and search #806

merged 160 commits into from
Aug 22, 2023

Conversation

aaxelb
Copy link
Contributor

@aaxelb aaxelb commented Jul 25, 2023 •
edited
Loading

todo:

  • ingest rdf/osfmap data via api
  • ingest sharev2 data to new data model
  • support sharev2 search api /api/v2/search/creativeworks/_search
  • serialize data to "osfmap-json"
  • /trove/index-card-search
  • /trove/index-value-search
  • /trove/index-property-search
  • indexcard for each osfmap metadata property
  • remove trailing slash for sufficiently_unique_iri
  • handle queryless query
  • paginated search results
  • sort param
  • fill out this pr description better
  • many some tests

@aaxelb
de-index items without title/name/label
ddffd6f
@aaxelb
fix: sharev2_elastic withdrawn should be bool
6de5275
@aaxelb
fix: fill sharev2_elastic type for rdf-ingested cards
2b3e1ce
@aaxelb
skip storing all child tasks -- can be a long list
8476291
@aaxelb
tidier message logging
01f1cba
@aaxelb
sharev2_elastic: |-delimited subject lineage
79fee8e
@aaxelb
fix: include redundant references in jsonld
1b27ba1
@aaxelb
lil nicities
5182ad5
@aaxelb
remove hasVersion from suggested properties
7d15991
@aaxelb
prevent duplicates between v2_push and rdf tracts
25519c8
@aaxelb
indexcard-based oaipmh
6944852
@aaxelb
fix: allow empty operator (cardSearchFilter[foo][])
7c45b06
@aaxelb
fix: separate old (sharev2-push) and new (trove-rdf)
52cd229
@aaxelb
admin: display raw datum in <pre>
221889c
@aaxelb
fix: accept fileName as sufficient for indexing
4f7839c
@aaxelb
fix: actually update datestamp when a RawDatum is seen again
feb3914
@aaxelb aaxelb force-pushed the feature/trove-ingest-and-search branch from 62d75ec to feb3914 Compare August 18, 2023 19:51
@coveralls
Copy link

coveralls commented Aug 22, 2023 •
edited
Loading

Coverage Status

coverage: 90.169% (-0.3%) from 90.46% when pulling c8b704f on feature/trove-ingest-and-search into 880fa02 on develop.

@aaxelb aaxelb marked this pull request as ready for review August 22, 2023 14:49
@aaxelb aaxelb changed the title [wip] iri-based ingest and search [ENG-4380][ENG-4382] iri-based ingest and search Aug 22, 2023
@aaxelb aaxelb merged commit 39f4e9b into develop Aug 22, 2023
4 of 8 checks passed
@aaxelb aaxelb deleted the feature/trove-ingest-and-search branch August 22, 2023 18:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@aaxelb @coveralls