Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DOI extraction #1126

Open
lfoppiano opened this issue Jun 10, 2024 · 2 comments
Open

DOI extraction #1126

lfoppiano opened this issue Jun 10, 2024 · 2 comments

Comments

@lfoppiano
Copy link
Collaborator

I've noticed that there are some cases where the DOI is correctly extracted from the article header, however, they are incorrectly mangled in the output.

Example: origin9833693929434438741.pdf

In this article the DOI is correctly extracted up to here:

List<String> dois = doc.getDOIMatches();

There are several articles (e.g. Plos) where the DOI in the header is split by a breakline, in such cases the DOI is wrongly substituted.
I'm not sure, maybe we could substitute it only when the found DOI is the same or larger than the one already extracted by the header parser.

Another thing is that we could extract the DOI exploiting the clickable URL to correct the suffix.

@lfoppiano
Copy link
Collaborator Author

lfoppiano commented Jun 10, 2024

I'm adding more examples (CC-BY):

@lfoppiano
Copy link
Collaborator Author

lfoppiano commented Jun 10, 2024

Related to the period I found a (I'm assuming) wrongly annotated training data. Adding a PR for it for version 0.8.2

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant