All notable changes to this project will be documented in this file.
The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.
- Added config for EWSG2-NAVO-L2P-v01
- Added COWVR_STPH8_L1_TSDR_V10.0
- Added COWVR_STPH8_L2_EDR_V10.0
- Updated SMAP_RSS_L2_SSS_V5 and SMAP_RSS_L2_SSS_V6
- Updated PRIM_SMAP_L2_V1
- Reformatted all configs with "pretty" function to make more readable
- Removed "variables" field from all configs. No longer used by HiTIDE (uses CMR to get variable list instead)
- Add new deploy workflow to deploy to all env when merge to main
- Add COWVR_STPH8_L2_EDR_V9.0 and COWVR_STPH8_L1_TSDR_V9.0 collections
- Config files for MERGED_TP_J1_OSTM_OST_CYCLES_V52
- Add hitide palette for all colormaps available in matplotlib
- Config files for ASCATA_ESDR_ANCILLARY_L2_V1.1 and ASCATB_ESDR_ANCILLARY_L2_V1.1
- Added image variable and image entries for SCATSAT1_ESDR_L2_WIND_STRESS_V1.1 config.
- Updated config for VIIRS_N21-NAVO-L2P-v3.0 (new min/max's)
- Updated config for VIIRS_N20-NAVO-L2P-v3.0 (new min/max's)
- Added config for VIIRS_N21-NAVO-L2P-v3.0
- Added config for VIIRS_N20-NAVO-L2P-v3.0
- Added configs for CYGNSS_L2_V3.2 and SMAP_RSS_L2_SSS_V6
- Add new deploy workflow to deploy to all env when merge to main
- Added a global_grid variable to allow tig to use an entire grid region -90 90 -180 180 to generate images to fix swot 2.0 alignment
- Updated Ascat 25km collection to have fill in missing pixels
- Remove high resolution settings for ssha karin 2 in swot expert collections
- Added config for ASCATA_ESDR_L2_WIND_STRESS_V1.1
- Added config for ASCATB_ESDR_L2_WIND_STRESS_V1.1
- Added configs for SWOT_L2_NALT_GDR_2.0, SWOT_L2_NALT_GDR_GDR_2.0, SWOT_L2_NALT_GDR_SGDR_2.0, SWOT_L2_NALT_GDR_SSHA_2.0, SWOT_L2_NALT_IGDR_SGDR_2.0.cfg, SWOT_L2_NALT_IGDR_GDR_2.0.cfg, SWOT_L2_NALT_OGDR_GDR_2.0.cfg
- Added configs for SWOT_L2_RAD_GDR_2.0, SWOT_L2_RAD_IGDR_2.0, SWOT_L2_RAD_OGDR_2.0
- Added configs for SWOT_L2_HR_Raster_100m_1.0/1.1/2.0 and SWOT_L2_HR_Raster_250m_1.0/1.1/2.0, SWOT_L2_NALT_IGDR_1.0, SWOT_L2_NALT_IGDR_2.0, SWOT_L2_NALT_OGDR_1.0, SWOT_L2_NALT_OGDR_2.0
- Removed configs SWOT_L2_NALT_IGDR_1.0, SWOT_L2_NALT_IGDR_GDR_1.0, SWOT_L2_NALT_IGDR_GDR_2.0, SWOT_L2_NALT_IGDR_SGDR_1.0, SWOT_L2_NALT_IGDR_SGDR_2.0, SWOT_L2_NALT_OGDR_1.0, SWOT_L2_NALT_OGDR_GDR_1.0, SWOT_L2_NALT_OGDR_GDR_2.0, SWOT_L2_LR_SSH_UNSMOOTHED_1.0, SWOT_L2_LR_SSH_UNSMOOTHED_2.0
- Removed footprints from SWOT_L2_SSH_BASIC_1.0/1.1/2.0, SWOT_L2_SSH_EXPERT_1.0/1.1/2.0, SWOT_L2_SSH_WINDWAVE_1.0/1.1/2.0
- Added configs SWOT_L2_LR_SSH_BASIC_2.0, SWOT_L2_LR_SSH_EXPERT_2.0, SWOT_L2_LR_SSH_UNSMOOTHED_2.0, SWOT_L2_LR_SSH_WINDWAVE_2.0
- Added configs SWOT_L2_NALT_IGDR_GDR_2.0, SWOT_L2_NALT_IGDR_SGDR_2.0, SWOT_L2_NALT_IGDR_SSHA_2.0
- Added configs SWOT_L2_NALT_OGDR_GDR_2.0, SWOT_L2_NALT_OGDR_SSHA_2.0
- Added configs SWOT_L2_NALT_GDR_SSHA_2.0
- Added config ASCATB_ESDR_L2_WIND_STRESS_V1.1
- Added configs SWOT_L2_NALT_IGDR_GDR_1.0, SWOT_L2_NALT_IGDR_SGDR_1.0, and SWOT_L2_NALT_OGDR_GDR_1.0
- Added ssha_karin_2 to SWOT_L2_LR_SSH_EXPERT_1.0 and 1.1
- Add configs SWOT_L2_LR_SSH_BASIC_1.1, SWOT_L2_LR_SSH_EXPERT_1.1, SWOT_L2_LR_SSH_WINDWAVE_1.1
- Add configs SWOT_L2_LR_SSH_BASIC_1.1, SWOT_L2_LR_SSH_EXPERT_1.1, SWOT_L2_LR_SSH_WINDWAVE_1.1
- Add configs SWOT_L2_NALT_OGDR_1.0 and SWOT_L2_NALT_IGDR_1.0
- Changed stratgy to swot_linstring for SWOT_L2_NALT_GDR_SSHA_1.0 SWOT_L2_NALT_IGDR_SSHA_1.0 SWOT_L2_NALT_OGDR_SSHA_1.0
- Removed swh_sea_state_bias from SWOT_L2_LR_SSH_EXPERT_1.0
- PODAAC-5542
- Removed sample variable 'image' from CYGNSS_L2_V2.1
- PODAAC-5547
- Changed AVHRR19_G-NAVO-L2P-v1.0 footprint strategy from polarsides to polar
- PODAAC-5547
- Changed AVHRR19_G-NAVO-L2P-v1.0 footprint strategy from periodic to polarsides
- ** PODAAC-5132 **
- Add conf for SWOT_L2_LR_SSH_UNSMOOTHED_1.0
- ** PODAAC-5132 **
- Add configs for SWOT L2 v1.0 (6 datasets)
- SWOT_L2_NALT_GDR_SSHA_1.0, SWOT_L2_NALT_IGDR_SSHA_1.0, SWOT_L2_NALT_OGDR_SSHA_1.0
- SWOT_L2_LR_SSH_BASIC_1.0, SWOT_L2_LR_SSH_EXPERT_1.0, SWOT_L2_LR_SSH_WINDWAVE_1.0
- ** PODAAC-5223 **
- Add conf for AMSR2-REMSS-L2P-v8.2 and AMSR2-REMSS-L2P_RT-v8.2
- ** PODAAC-4880 **
- Add conf for Sentinal 6 datasets
- ** PODAAC-5016 **
- Added conf for SMAP_RSS_L2_SSS_V5
- ** PODAAC-4201 **
- Added conf for AQUARIUS_L2_SSS_CAP_V5
- ** PODAAC-4421 **
- Added conf for CYGNSS_L2_SURFACE_FLUX_V2.0
- ** PODAAC-4194 **
- Added conf for SWOT_SIMULATED_L2_NADIR_SSH_ECCO_LLC4320_CALVAL_V1
- ** PODAAC-4195 **
- Added conf for SWOT_SIMULATED_L2_NADIR_SSH_ECCO_LLC4320_SCIENCE_V1
- ** PODAAC-4785 **
- Added conf for SWOT_SIMULATED_L2_NADIR_SSH_GLORYS_SCIENCE_V1
- ** PODAAC-4786 **
- Added conf for SWOT_SIMULATED_L2_NADIR_SSH_GLORYS_CALVAL_V1
- ** PODAAC-4787 **
- Added conf for SWOT_SIMULATED_L2_KARIN_SSH_GLORYS_CALVAL_V1
- ** PODAAC-4788 **
- Added conf for SWOT_SIMULATED_L2_KARIN_SSH_GLORYS_SCIENCE_V1
- ** PODAAC-4192 **
- Updated image variables and resolution for SWOT_SIMULATED_L2_KARIN_SSH_ECCO_LLC4320_SCIENCE_V1
- ** PODAAC-4193 **
- Updated image variables and resolution for SWOT_SIMULATED_L2_KARIN_SSH_ECCO_LLC4320_CALVAL_V1
- ** PODAAC-3668 **
- Removed fixed-footprint config for CYGNSS L2 datasets
- PODAAC-4192
- Added conf SWOT_SIMULATED_L2_KARIN_SSH_ECCO_LLC4320_SCIENCE_V1
- PODAAC-4419
- Added conf for CYGNSS_NOAA_L2_SWSP_25KM_V1.2
- PODAAC-4201
- Added conf for AQUARIUS_L2_SSS_CAP_V5
- PODAAC-4418
- Added conf for CYGNSS_L1_V2.1
- Added conf for CYGNSS_L1_CDR_V1.1
- PODAAC-4193
- Added conf SWOT_SIMULATED_L2_KARIN_SSH_ECCO_LLC4320_CALVAL_V1
- PODAAC-4182
- Removed
mean_square_slope
andwind_speed_uncertainty
from CYGNSS_L2_CDR_V1.1 image variables
- Removed
- PODAAC-4184
- Added conf for CYGNSS_L2_SURFACE_FLUX_CDR_V1.1
- PODAAC-4185
- Added conf for CYGNSS_L2_V3.0
- PODAAC-4175
- Added conf for SMAP_JPL_L2B_NRT_SSS_CAP_V5
- PODAAC-4182
- Added conf for CYGNSS_L2_CDR_V1.1
- PODAAC-4176
- Added conf for SMAP_JPL_L2B_SSS_CAP_V5
- PODAAC-4172
- Added conf for JASON_3_L2_OST_OGDR_GPS
- PODAAC-4024
- Added conf for JASON-1_L2_OST_GPN_E
- Added conf for JASON-1_L2_OST_GPR_E
- Added conf for JASON-1_L2_OST_GPS_E
- Added conf for MERGED_TP_J1_OSTM_OST_CYCLES_V42
- PODAAC-4189
- Added conf for AVHRRF_MA-STAR-L2P-v2.80
- PODAAC-4190
- Added conf for AVHRRF_MB-STAR-L2P-v2.80
- PODAAC-4191
- Added conf for AVHRRF_MC-STAR-L2P-v2.80
- PODAAC-4170
- Added palettes and sync to s3 bucket.
- PODAAC-4171
- Added conf for AVHRRMTA_G-NAVO-L2P-v1.0
- PODAAC-4173
- Added conf for AVHRRMTB_G-NAVO-L2P-v1.0
- PODAAC-3603
- Added jenkins pipeline to deploy dataset config into hitide s3 bucket.
- Added config for CYGNSS_L2_SURFACE_FLUX_V3.2
-
PODAAC-3276
- Generated collection_name.cfg file through persistent-id.cfg
- program ran against dataset-config-overrides project's production folder against L2SS TEST DB. There are 14 files not able to find cross reference, Hence, not able to translate to their relative collection_name.cfg. rename_cfg python code output as follow:
- refer to the unprocessed-files for the list of files which are not processed (probably need to be done manually)
..... INFO:main:/Users/eyen/development/L2SS-ingest/dataset-config-overrides/production/PODAAC-CYGNS-C2H10.cfg --- Copying to ---> /tmp/cfgs/CYGNSS_L2_SURFACE_FLUX_CDR_V1.0.cfg INFO:main:/Users/eyen/development/L2SS-ingest/dataset-config-overrides/production/PODAAC-CYGNS-L2X30.cfg does not exist as a file INFO:main:/Users/eyen/development/L2SS-ingest/dataset-config-overrides/production/PODAAC-QSX12-L2B41.cfg --- Copying to ---> /tmp/cfgs/QSCAT_LEVEL_2B_OWV_COMP_12_KUSST_LCRES_4.1.cfg INFO:main:/Users/eyen/development/L2SS-ingest/dataset-config-overrides/production/PODAAC-GHMDA-2PJ19.cfg --- Copying to ---> /tmp/cfgs/MODIS_A-JPL-L2P-v2019.0.cfg INFO:main:There are 14 of files unprocessed: ERROR:main:Unprocessed: PODAAC-GHMDT-2PJ01.cfg ERROR:main:Unprocessed: PODAAC-GHG16-2PO27.cfg ERROR:main:Unprocessed: PODAAC-GHAMS-2PR01.cfg ERROR:main:Unprocessed: PODAAC-SMP30-2SOCS.cfg ERROR:main:Unprocessed: PODAAC-SMP3A-2SOCS.cfg ERROR:main:Unprocessed: PODAAC-GHVRS-2PN16.cfg ERROR:main:Unprocessed: PODAAC-GHMDA-2PJ01.cfg ERROR:main:Unprocessed: AVHRR_SST_METOP_B-OSISAF-L2P-v1.0.cfg ERROR:main:Unprocessed: PODAAC-OSCAR-03D01.cfg ERROR:main:Unprocessed: PODAAC-GHGMR-4FJ04.cfg ERROR:main:Unprocessed: PODAAC-J1SHA-NETGC.cfg ERROR:main:Unprocessed: PODAAC-J1SHA-NETCC.cfg ERROR:main:Unprocessed: PODAAC-AQR40-3S1CS.cfg ERROR:main:Unprocessed: PODAAC-GHATS-2PU01.cfg INFO:main:Successfully ran the program and close DB connection
Copyright 2023, by the California Institute of Technology. ALL RIGHTS RESERVED. United States Government Sponsorship acknowledged. Any commercial use must be negotiated with the Office of Technology Transfer at the California Institute of Technology.
This software may be subject to U.S. export control laws. By accepting this software, the user agrees to comply with all applicable U.S. export laws and regulations. User has the responsibility to obtain export licenses, or other export authority as may be required before exporting such information to foreign countries or providing access to foreign persons.