pgcdemtools v1.3.0

pgcdemtools version 1.3 released 28 Aug 2023

Overview

• Add ability for the indexer to make DEM release-style fields for strips and tiles
• Update strip DEM fields to correct types
• Postgres connection improvements
• Packager improvements

What's Changed

• More complete check of SetsmScene source file existence by @ehusby in #66
• Add new '*_datamask.tif' DEM mosaic tile component raster to scripts by @ehusby in #73
• New toggle for writing "tile release" format index fields by @ehusby in #74
• Support for pg_service.conf postgres connection settings by @ehusby in #75
• Limit rasterproxy creation to relevant tifs in packaging by @clairecporter in #77
• Improve handling of errors in SETSM product packaging scripts by @ehusby in #76
• Fix security issue in logging, change expected Danco service name in PG config by @ehusby in #78
• Add python script with function to read LERC_ZSTD compressed 50cm Scene DEM rasters by @ehusby in #67
• Strip DEM index changes by @clairecporter in #81

Full Changelog: v1.2.1...v1.3.0

pgcdemtools v1.2.1

pgcdemtools version 1.2 released 01 May 2023

Overview

• STAC: Add support for ArcticDEM v3.0 mosaics
• Skip over unique constraint duplicate record errors, adjust error logging in index_setsm.py
• Add --version options to all scripts and update slurm submission scripts
• Change scheduler CLI options with back-compatibility to old style

What's Changed

• STAC: Add support for ArcticDEM v3.0 mosaics by @klassenjs in #57
• Skip over unique constraint duplicate record errors, adjust error logging in index_setsm.py by @ehusby in #68
• New field data type bugfixes by @ehusby in #72
• Add --version options to all scripts and update slurm submission scripts by @clairecporter in #71

Full Changelog: v1.2...v1.2.1

pgcdemtools v1.2

pgcdemtools version 1.2 released 10 Mar 2023

Overview

• Added ability to convert Strip DEMs to COG upon packaging and build raster proxy files
• Added scene DEM index fields and correct improper field types
• Added ability to creat STAC items and catalogs
• Updated packagingot handle s2s 4.x strip DEM items and names
• Converted to Python3, GDAL3, PROJ6
• Added exit codes
• Added --check option to indexer

What's Changed: Detail

• Implemented new osr.SpatialReference() wrapper to make coordinate transformations work with future GDAL/PROJ versions by @ehusby in #1
• index_setsm.py status return, py 2to3 updates by @stevefoga in #2
• Return write response to main() function by @stevefoga in #3
• taskhandler fixes to make compatible with bwpy by @ehusby in #4
• always exit with system-readable status code by @stevefoga in #5
• Incorporate downsampled products; make stripDEM changes by @clairecporter in #6
• Indexer bug fixes by @clairecporter in #8
• Option to verify indexer wrote required records to target layer by @clairecporter in #9
• Fix Python2 integer division issue by @ehusby in #10
• Test changes for Python3/GDAL3 compatibility by @ehusby in #11
• Handle filenames of subtiled scene DEM result files by @ehusby in #13
• Update tests to check subtiles dem scenes by @clairecporter in #14
• Update osgeo import syntax, bugfix by @ehusby in #15
• Properly read scaled int LERC_ZSTD compressed dems by @ehusby in #18
• Enable indexing of edge-masked 50cm scene dems by @ehusby in #19
• Modifications to support geotileplus generation in setsm-utils by @clairecporter in #20
• add nodata (-9999) back for gdal_calc.py by @yghlc in #17
• Modifications to index_setsm.py to support DSP and custom paths by @clairecporter in #21
• Update packaging to handle v4 strips and tiles by @clairecporter in #22
• Correct strip JSON filenames, couple other tweaks by @ehusby in #23
• BW custom path prefix, UTM 60 N/S EPSG index field value fix by @ehusby in #24
• Changes for strip indexing on BW by @ehusby in #25
• Update packaging2 by @clairecporter in #26
• Centralized logger and GDAL exception handler by @ehusby in #27
• Add check/recalculation for valid epsg code in DEMs built from JSON by @clairecporter in #28
• Update Packaging and Strip Metadata by @clairecporter in #29
• Add scenes2strip version to strip DEM metadata handling by @clairecporter in #30
• Couple fixes for strip indexing from JSONs by @ehusby in #31
• Dem package bugfix and consolidate simple strip shelver by @clairecporter in #32
• Add logic to resample_setsm_tiles.py to make downsampled raster the l… by @clairecporter in #34
• Build strip DEM custom path using 's2s_version' attribute by @ehusby in #33
• Strip rename change by @clairecporter in #35
• Fixes around SETSM meta "Group_version" handling by @ehusby in #36
• COG package strips by @clairecporter in #38
• Change standard GDAL GTiff creation option from 'BIGTIFF=IF_SAFER' to… by @ehusby in #37
• Bypass 50cminfo by @clairecporter in #39
• Package and index updates by @clairecporter in #40
• Escape literal periods used in regex patterns by @ehusby in #41
• Change package threshold by @clairecporter in #42
• Hotfix for package_setsm DEM removal bug. by @clairecporter in #43
• Package rasterproxy by @clairecporter in #44
• package_setsm.py: rasterproxy-prefix option further refinements by @clairecporter in #45
• Raster proxy functionality for packaging by @clairecporter in #47
• Update code around downsampling 2m mosaic tiles by @clairecporter in #48
• Add SetsmTile attributes for mosaic tile STAC work by @ehusby in #49
• Set SetsmDem.release_version attribute from s2s version if necessary by @ehusby in #51
• Mosaic tile index fixes by @ehusby in #50
• Further updates for setsm tile name change and indexing by @clairecporter in #52
• SETSM Tile release version bugfix. by @clairecporter in #53
• Build STAC Metadata by @klassenjs in #54
• Add Option to Tile Packager to build COGs by @clairecporter in #55
• Add component_list attrib to SetsmTile object for v3 mosaic metadata … by @clairecporter in #56
• Make sure QB strips are included in mosaic tile component list by @ehusby in #58
• Disable inclusion of countmt rasters in tile tar.gz files by @clairecporter in #61
• (WIP) Round DEM and MAD raster values to 1/128 meters, and add new standard -ovr NONE arg to GDAL calls by @ehusby in #60
• Add OpenFileGDB capability by @clairecporter in #62
• Fix Strip DEM group version ID lookup key. by @clairecporter in #63
• Extend option to specify multiple components for DEM tile resample by @ehusby in #64
• Test if dst GDB already exists, OpenFileGDB driver by @ehusby in #65
• Add gentime, scene, and prod_ver to scene dem records by @clairecporter in #69
• Repair metadata from incomplete scene dem jsons. by @clairecporter in #70

Full Changelog: v1.1...v1.2

pgcdemtools v1.1

pgcdemtools version 1.1 released 04 Jan 2018

pgcdemtools v1.0

pgcdemtools version 1.0 released 10 Oct 2017