Data ingestion service for ONAP.
Data provider is a project to provide a tool to automate common ONAP resource creation. For many of tasks in ONAP some resources are needed and could be created once, like cloud region, complex or customer in A&AI. With that tool it can be automated to create them for every ONAP instance. It can be also used to create requested resource on already running instance on demand.
This project is intended to be included in automation chain, e.g. triggered from the pipeline. You can also run it locally using Python interpreter or Docker image.
To run onap-data-provider Python >= 3.8 version is required. Install it using
python setup.py install
command. You can call then
onap-data-provider
command.
When installed onap-data-provider is ready to work. We need some data to be created. Let's use samples/vendor.yaml and create SDC's Vendor resource. Call
onap-data-provider -f samples/vendor.yaml
and in your ONAP instance Vendor resource should be created. If that resource already exists no new data will be created. Check samples directory to get more examples of files which describes resources to create.
You can use multiple files as an input:
onap-data-provider -f samples/vendor.yaml -f samples/vsp.yaml
Directories could be used as well:
onap-data-provider -f samples/
Configuration is needed if your environment setup is different that usuall so ONAP components listen on different hosts/ports than default, so are available on other URLs than:
AAI_URL = "https://aai.api.sparky.simpledemo.onap.org:30233"
CDS_URL = "http://portal.api.simpledemo.onap.org:30449"
MSB_URL = "https://msb.api.simpledemo.onap.org:30283"
SDC_BE_URL = "https://sdc.api.be.simpledemo.onap.org:30204"
SDC_FE_URL = "https://sdc.api.fe.simpledemo.onap.org:30207"
SDNC_URL = "https://sdnc.api.simpledemo.onap.org:30267"
SO_URL = "http://so.api.simpledemo.onap.org:30277"
VID_URL = "https://vid.api.simpledemo.onap.org:30200"
CLAMP_URL = "https://clamp.api.simpledemo.onap.org:30258"
VES_URL = "http://ves.api.simpledemo.onap.org:30417"
DMAAP_URL = "http://dmaap.api.simpledemo.onap.org:3904"
If you want to use another URLs you need to override default onap-data-provider settings by create Python file with values you want to use. Example: I want to test onap-data-provider data creation on my "test" ONAP instance which is available on "172.17.0.1" IP address, so I need to create my_test_onap_instance_settings.py Python file which looks:
AAI_URL = "https://172.17.0.1:30233"
CDS_URL = "http://172.17.0.1:30449"
MSB_URL = "https://172.17.0.1:30283"
SDC_BE_URL = "https://172.17.0.1:30204"
SDC_FE_URL = "https://172.17.0.1:30207"
SDNC_URL = "https://172.17.0.1:30267"
SO_URL = "http://172.17.0.1:30277"
VID_URL = "https://172.17.0.1:30200"
CLAMP_URL = "https://172.17.0.1:30258"
VES_URL = "http://172.17.0.1:30417"
DMAAP_URL = "http://172.17.0.1:3904"
and then if I call
ONAP_PYTHON_SDK_SETTINGS=my_test_onap_instance_settings onap-data-provider ...
all data are going to be created on my local instance.
ONAP data provider can be run with proxy configured. You need to pass urls you want to use for proxy connection as --proxy arguments. Call onap-data-provider -f <infra-file> --proxy http://localhost:8080 https://localhost:8080 to setup proxy for http and https on localhost:8080 address.
You can verify the data provided is correct, before you would try to actually push it
to the ONAP instance. To do so, use the flag --validate-only:
onap-data-provider -f samples/vendor.yml --validate-only
For reference, please see example data files under samples/ directory.
The following utilities are used within the project:
- Black
- mypy
- pydocstyle
To run all the tests (unit tests, linter and mypy checks), install tox and then run it:
pip install tox
tox .
The software that data-provider is built on uses the following licenses.
- Apache 2 License: onapsdk
- MIT license: PyYAML, jsonschema