Skip to content
natlibfi-arlehiko edited this page May 28, 2018 · 7 revisions

System for importing record batches to Melinda.

Micro services

The system is implemented as micro services. Each service also depends on shared code implemented as a Javascript module.

API

API provides methods for uploading blobs, altering blob states and profile management.

Controller

Controller dispatches Transformer- and Importer-containers for scalability.

Transformer

Transformer transforms blobs to records and publishes them in to the import queue.

Importer

Importer fetches records from the import queue and imports them to Melinda.

Import queue

AMQP queue for transformed records.

Overview of the flow

Overview of the flow"

Clone this wiki locally