Demonstration application to show use of MDX as validator source
Metadata Sentinel consumes rules exposed by MDX at endpoint:
/api/modelCatalogue/core/validationRule/rules
This applications allows the user to import Data as CSV format
If you import a CSV file of two columns
NHSNumber,NHSNumberStatus
"1234567890","01"
"1234567890","01"
You need to create a mapping string for each of the elements. To create a mapping, once the record collection has been imported go to the mapping screen and select matching catalogue elements.
If one of your csv header values does not match any MDX element leave the value in the mapping blank.
The project contains a class metadata.Validation to ease drl validation rule creation.
Next is an example of DRL rule
package metadata;
global java.util.List output;
global java.lang.String diagnosticTestDate;
global java.lang.String dateOfBirth;
rule "Difference between diagnosticTestDate and dateOfBirth is larger than 18"
when
eval(Validation.yearsBetween(diagnosticTestDate, dateOfBirth, 'yyyy-MM-dd') < 18)
then
output.add("Difference between diagnosticTestDate and dateOfBirth is larger than 18");
end
You need to include DROOLS Global name output of type java.util.List. When you find a violation you should add a string describing the rule violation to that list.
The previous example uses two variables diagnosticTestDate and dateOfBirth. You need to define in
the MDX Business Rule which elements those variables correspond to.
See screenshot:
This project is a Grails 3 application.
You can configure the MDX server URL using configuration parameter metadata.url
Add to grails-app/conf/application.yml
metadata:
url: http://localhost:8080
The app GORM for Hibernate implementation as an data access toolkit. It uses MySQL. You will
need to configure your driver, dialect, database url, user, password at grails-app/conf/application.yml.
Currently the application contains the MySQL Driver and the H2 driver as a testRuntime dependency.
To run the app
./gradlew -DJDBC_DRIVER=com.mysql.jdbc.Driver -DJDBC_DIALECT=org.hibernate.dialect.MySQL5InnoDBDialect -DJDBC_CONNECTION_STRING=jdbc:mysql://127.0.0.1:8889/metadatasentinel_dev -DJDBC_USERNAME=root -DJDBC_PASSWORD=root bootRun
To run the unit tests:
./gradlew test
To run the integration tests:
./gradlew -DJDBC_DRIVER=com.mysql.jdbc.Driver -DJDBC_DIALECT=org.hibernate.dialect.MySQL5InnoDBDialect -DJDBC_CONNECTION_STRING=jdbc:mysql://127.0.0.1:8889/metadatasentinel_dev -DJDBC_USERNAME=root -DJDBC_PASSWORD=root -Dgeb.env=chromeHeadless -Ddownload.folder=/Users/sdelamo/Downloads iT
To work comfortably in development you can create a runTest.sh script as illustrated with the values matching your system:
#!/bin/bash
set -e
export EXIT_STATUS=0
./gradlew -Dgrails.env=test test || EXIT_STATUS=$?
if [[ $EXIT_STATUS -ne 0 ]]; then
echo "Unit Tests Failed"
exit $EXIT_STATUS
fi
./gradlew -Dgrails.env=test -DJDBC_DIALECT=org.hibernate.dialect.MySQL5InnoDBDialect -DJDBC_USERNAME=root -DJDBC_DRIVER=com.mysql.jdbc.Driver -DJDBC_PASSWORD=root -DJDBC_CONNECTION_STRING=jdbc:mysql://127.0.0.1:8889/metadatasentinel_test -Dgeb.env=chromeHeadless -Ddownload.folder=/Users/sdelamo/Downloads iT || EXIT_STATUS=$?
exit $EXIT_STATUS
Grails AWS SDK S3 Plugin is used to upload files to AWS S3.
You must provide either:
Environment Variables - AWS_ACCESS_KEY_ID and AWS_SECRET_KEY
Java System Properties - aws.accessKeyId and aws.secretKey
Also you must provide values for:
Environment Variables - S3_BUCKET and S3_REGION
An example of a value for S3_REGION could be eu-west-1 for Ireland buckets.