Skip to content

Releases: adsabs/SciXIngestParserPipeline

ArXiv DublinCore Parsing

05 Nov 16:49
f873d0a
Compare
Choose a tag to compare
Pre-release

What's Changed

Full Changelog: v0.0.1...v0.0.2

Initial Release: ArXiv Parsing+Reparsing

13 Jul 15:56
94c1a60
Compare
Choose a tag to compare

Initial parser with functionality to:

  • parse output from harvester pipeline
  • reparse harvested records by pulling from S3
    • Allows for reparsing of individual or bulk records
  • resend previously parsed data to Kafka
  • view current parsed data for a given record
  • Monitor current status of parsing for a given record