Releases: ACCESS-Cloud-Based-InSAR/DockerizedTopsApp
Releases · ACCESS-Cloud-Based-InSAR/DockerizedTopsApp
DockerizedTopsApp v0.3.7
- Updates dem-stitcher to 2.5.8 to ensure new (ARIA-managed) url for reading the Geoid EGM 2008. See this issue.
- Ensure version/docker build use python 3 as done here: https://github.com/dbekaert/RAiDER/blob/32697d2e4e6908b8feb3b81a1df30cb5f4e49a24/.github/workflows/build.yml#L16-L17
DockerizedTopsApp v0.3.6
- Updates dem-stitcher to 2.5.6 to which updated to a new url for reading the Geoid EGM 2008.
DockerizedTopsApp v0.3.5
Added
- Include
dask
in environment.yml as it appears to not be correctly handled in pandera: unionai-oss/pandera#1525
DockerizedTopsApp v0.3.4
Changed
- ISCE2 shenanigans (PYTHON_PATH, PATH, and logging changes) are now handled in the
isce2_topsapp.__init__
ensuring we only have to do it once, no matter where we are in the package. - Update dataset version from
3.0.0
->3.0.1
to track products over areas processed during development of v3 product. In other words, large scale processing was done during v3 development but not all v3 products will be delivered to DAAC - we have standardized numerous attributes and layers. Utlimately, 3.0.0 and 3.0.1 at the DAAC will represent the v3 products created by this repository.
Fixed
- The root logger is no longer set to DEBUG by ISCE2 preventing excessive logging from all packages in the environment
DockerizedTopsApp v0.3.3
Fixed
- Orbit downloading cleanup - ensures no circular references seen in partial function
DockerizedTopsApp v0.3.2
Changed
- We ensured that ASF is checked for orbits before ESA to improve reliability. Aims to resolve orbit download issues seen here seen in large processing campaigns and possible errors associated with ESA downloading.
- We include natural earth data in the plugin to exclude hitting the natural earth server and aims to resolve such issues identified here in large processing campaigns.
DockerizedTopsApp v0.3.1
Added
- Provides CLI options for:
- output resolution: 30 meters or 90 meters (the latter is default and the standardized GUNW resolution)
- unfiltered coherence layer (True/False)
- Goldstein filtering power - power that phase is raised to in patch FFT - default .5 (can be any number >= 0)
- Dense offsets layers (True/false)
- Codifies (in documentation and in plugin) what is meant by "standard" GUNW with respect to exposed parameters including:
- 90 m resolution
- .5 value in the Goldstein filter for InSAR phase
- No ESD or dense offsets
- Additional layers: ionosophere, SET, and unfiltered coherence.
- uses pydantic to record relevant topsapp parameters for "standard" GUNW
- Records parameters in the product including the CLI command to regenerate said product
- If parameters are not standard uses prefix
S1-GUNW_CUSTOM-...
- Pydantic dependency for parameter accounting
Changed
- The CLI now requires
frame_id
(useframe_id = -1
for old API and what is now considered a "non"-standard product) - Water mask now uses
tile-mate>=0.0.8
to download and merge water mask tiles (Pekel Occurence data >= 95 is the default) - All water masks applied to processing/packaging use Pekel Occurence (>= 95 percent occurence): ionosphere processing, browse imagery, and global attributes associate with mean coherence
- Some function names associated to writing global attributes in the netcdf file were renamed to be more descriptive e.g.
record_stats
becamerecord_stats_as_global_attrs
DockerizedTopsApp v0.3.0
Added
check_esa_credentials
function to__main__.py
to check for the existence of Dataspace credentials before processing begins.
Changed
- Updated
hyp3lib
to v2.0.2+, which uses the new Copernicus Dataspace Ecosystem API to download orbit files. - Calls to
downloadSentinelOrbitFile
now specify theesa_credentials
argument.
DockerizedTopsApp v0.2.5
Fixed
- For SET azimuth time interpolation, overlapping orbits produces errors with prepping state vectors for azimuth time grid. We now ensure state-vecotors are both unique and in order before creating a orbit object in ISCE2.
DockerizedTopsApp v0.2.4
Added
++omp-num-threads
parameter to themain()
entrypoint to limit the number of threads used by ISCE2 during
multiprocessing.
Fixed
- For Solid Earth Tide computation, use azimuth timing to calculate solid earth tide in
science/grids/imagingGeometry
reference frame using ISCE2 rdr2geo. - Include topsapp_iono template.
- Increases DEM buffer to .4 from .1 to ensure the extent of at least two bursts (~40 km) are added when retrieving DEM (because estimated footprint can differ from what ISCE2 generates for a GUNW extent)
- Catch warnings in tests and match messages to ensure package warnings do not fail test suite
- Read low resolution Natural Earth land masses from public url due to removal from geopandas package.
- For ionosphere computation over water, includes masking conncomp zero, phase bridging, and modified adaptive gaussian filtering
- Fix for #135, skip iono computation if there are not land (all zero values) and skip using water mask if the area is outside of SWBD coverage
- Fix for #145 and SET - duplicate orbit xmls for computing azimuth time grid with ISCE2 geo2rdr (duplicate state vectors likely culprit). Ensures orbit object is intialized with unique set of orbit xmls passed. Also, localized metadata appropriately.
Added
- localize_data within main.py added option to use/not use water mask for ionosphere processing
- Added option to estimate burst phase jumps in ionosphere computation
- Added additional attributes for ionosphere computation into GUNW ionosphere layer metadata: processing_steps, water_mask, mask_connected_component_zero (flag) , do_phase_bridging (flag), swath_mode (flag), swath_ramp_removal (flag), swath_mode_description, multilook_az_rg1, multilook_az_rg2, iono_height
- Added packing of additional attributes for ionosphere computation into GUNW
- fsspec is now required in environment due to burst processing.