Bulk create sources on Webapp from Emily's list

[bishwaspraveen]

Description

Emily wants a bunch of sources to be bulk created on the Webapp from the following spreadsheet. All the sources that are marked as To Be Indexed are to be created via the backend.

Here is the link to the document : https://docs.google.com/spreadsheets/d/1GW9g8-DNJY_1HoWj4ftdXudI7LwMlirjTFY1-TtJuJI/edit#gid=0

Based on Emily's list, there were 35 sources that needed object creation on the Webapp. Other backend modifications/checks were necessary. They are as follows :

• Check if the source already existed in our database (by comparing source names and urls)
• Properly map the divisions since there were conflicts in how they were used in the spreadsheet v/s backend code.
• Bring in all the notes from the spreadsheet correctly into the backend.
• Create a python script for future use.

Deliverable

Out of 35 sources, 17 sources were successfully created and the other sources had conflicts either in terms on source names or the base URLs. Below are the logs :

Collection 'Goddard Heliophysics Science Division' created successfully.
Collection 'NASA HEAT' created successfully.
Collection 'The Sun at NASA Science' created successfully.
Collection 'UCAR Heliophysics' created successfully.
Collection with name 'Virtual Wave Observatory' already exists. Skipping.
Collection 'SuperMAG' created successfully.
Collection 'SwRI Virtual Sun/Earth Observatory' created successfully.
Collection with name 'PDS Cartography and Imaging Sciences Node Annex' already exists. Skipping.
Collection with name 'Ring-Moon Systems Node On-line Tools' already exists. Skipping.
Collection with name 'Ring-Moon Systems Node Open-Source Software' already exists. Skipping.
Collection 'U.S. Global Change Research Program' created successfully.
Collection 'CEOS Instruments ' created successfully.
Collection with link 'https://mims.nasa-impact.net/docs ' already exists. Skipping.
Collection 'CODE NASA ' created successfully.
Collection 'Earth Science Suborbital Campaigns ' created successfully.
Collection with link 'https://admg.nasa-impact.net/api/docs/ ' already exists. Skipping.
Collection with link 'https://admg.nasa-impact.net/api/docs/ ' already exists. Skipping.
Collection with link 'https://admg.nasa-impact.net/api/docs/ ' already exists. Skipping.
Collection with link 'https://impact.earthdata.nasa.gov/casei/ ' already exists. Skipping.
Failed to create collection 'Fire Information for Resource Management System (FIRMS)' : fire_information_for_resource_management_system_firms config folder already exists.
Collection 'GCIS Articles ' created successfully.
Collection 'GCIS Books ' created successfully.
Collection 'GCIS Journals ' created successfully.
Collection 'GCIS Reports ' created successfully.
Failed to create collection 'GISS Datasets and Derived Materials' : giss_datasets_and_derived_materials config folder already exists.
Failed to create collection 'GISS Publication List ' : giss_publication_list config folder already exists.
Failed to create collection 'GISS Software Tools ': giss_software_tools config folder already exists.
Collection 'Goddard Institute for Space Studies (GISS) ' created successfully.
Collection 'NTRS Publication Database ' created successfully.
Collection 'VEDA STAC Catalog ' created successfully.
Collection with name 'Life Sciences Data Archive (LSDA)' already exists. Skipping.
Collection with name 'NASA GeneLab' already exists. Skipping.
Collection with name 'Exoplanet Follow-up Observing Program' already exists. Skipping.
Collection with link 'https://irsa.ipac.caltech.edu/frontpage/' already exists. Skipping.
Collection with link 'https://heasarc.gsfc.nasa.gov/' already exists. Skipping.

Total new collections created: 17

Snapshot from Webapp Django shell :