Magda broken-link Minion

A Magda minion is a service that listens for new records or changes to existing records, performs some kind of operation and then writes the result back to the registry. For instance, we have a broken link minion that listens for changes to distributions, retrieves the URLs described, records whether they were able to be accessed successfully and then writes that back to the registry in its own aspect.

Other aspects exist that are written to by many minions - for instance, we have a "quality" aspect that contains a number of different quality ratings from different sources, which are averaged out and used by search.

This magda minion will test if a distribution is still available and record the link status accordingly.

Release Registry

Since v2.0.0, we use Github Container Registry as our official Helm Chart & Docker Image release registry.

It's recommended to deploy minions with as dependencies of a Magda helm deployment.

dependencies:
  - name: magda-minion-broken-link
    version: "2.0.0"
    repository: "oci://ghcr.io/magda-io/charts"

Requirements

Kubernetes: >= 1.21.0

Repository	Name	Version
oci://ghcr.io/magda-io/charts	magda-common	2.1.1

Values

Key	Type	Default	Description
cronJobImage.name	string	"alpine"
cronJobImage.pullPolicy	string	"IfNotPresent"
cronJobImage.pullSecrets	bool	false
cronJobImage.repository	string	"docker.io"
cronJobImage.tag	string	"latest"
datasetBucketName	string	""	The name of the storage bucket where all dataset files are stored. Should match storage API config. By default, it will use the value of global.defaultDatasetBucket (defined in magda-core chart) unless you specify a different value here.
defaultAdminUserId	string	"00000000-0000-4000-8000-000000000000"
defaultImage.imagePullSecret	bool	false
defaultImage.pullPolicy	string	"IfNotPresent"
defaultImage.repository	string	"ghcr.io/magda-io"
global.image	object	{}
global.minions.image	object	{}
global.rollingUpdate	object	{}
image.name	string	"magda-minion-broken-link"
resources.limits.cpu	string	"200m"
resources.requests.cpu	string	"50m"
resources.requests.memory	string	"40Mi"
schedule	string	"0 0 14,28 * *"
storageApiBaseUrl	string	"http://storage-api/v0"	The base URL of the storage API to use when generating access URLs for MAGDA internal stored resources.