Skip to content

CI Pipeline used for vocabulary creation in project StahlDigital (2021-2024)

Notifications You must be signed in to change notification settings

AKSW/StahlDigital-Pipeline

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Ontology-Pipeline

A continuous integration pipeline for ontology development in project StahlDigital (2021-2024). Uses spreadsheets as input, converts and validates the input and publishes the resulting ontology.

Workflow is defined using Nextflow (version 22.04.5) and depends on a docker container runtime.

Main Steps executed are

  • translating spreadsheets to RDF via xlsx2owl for several spreadsheets and mappings
  • transformations using e.g. RPT and jena/riot
  • validate RDF via shacl rules and PySHACL
  • generate documentation via JOD and Jekyll RDF
  • upload documentation to DSMS and git repos

Please see CHANGELOG.md for the list of changes.

Execution:

  • add file secrets with credentials (e.g. CI_STAHL_REGISTRY_TOKEN, CI_STORE_TOKEN, XLSX_MOCK_COMMIT_TOKEN, GITLAB_TEST_TOKEN, ARTIFACT_REPOSITORY_TOKEN, DSMS_USER, DSMS_PASSWORD)
  • $ nextflow run main.nf
  • to override parameter defaults add them to commandline, e.g. to use local spreadsheets: $ nextflow run main.nf --xlsxUrl="$PWD/xlsx2owl-StahlDigital.xlsx" --xlsxTestsUrl="$PWD/xlsx2owl-StahlDigital-tests.xlsx"

Authors

About

CI Pipeline used for vocabulary creation in project StahlDigital (2021-2024)

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published