Releases: stcorp/muninn
6.4.1
6.4
π 2024-03-14
-
Allow argument to muninn.open() to be a direct url or path to a muninn
configuration file. -
Added 'distance(geometry,geometry)' expression function.
-
Added Geometry.wrap() spherical to 2d geometry wrapping functions.
-
Fixed issue when pulling a product that is a directory using the S3 remote
backend. -
Various fixes when using archive.rebuild_properties() with the S3 storage
backend. -
Several minor fixes.
6.3
π 2023-12-13
-
Added support for extension-specific configuration sections in archive
configuration files. -
Introduced
timeout
andretries
options for the
extension:muninn.remote
section in an archive configuration.
The number of retries now defaults back to 0. -
Added option to muninn-info to show all archives if no archive parameter
is provided. -
Added muninn.list_archives() function.
-
Improved support for using muninn on Windows (e.g. '' in paths are now
translated to '/' when stored as muninn metadata) -
Fixed issue where S3 bucket prefix object was created with one '/' too many.
6.2
π 2023-09-20
-
Added S3 remote backend to allow performing a muninn pull from an object
store. -
A muninn pull will now set core.hash (if it did not yet have a value) similar
to muninn ingest. -
Added support for s3://bucket entries in the credentials authorization file.
These entries can be used by the S3 storage backend and S3 remote backend. -
Added from_geojson() and as_geojson() methods to muninn.geometry data types.
-
Fixed issue where is_defined(<namespace>) did not work for the sqlite
backend when using a table prefix.
6.1.1
π 2023-08-02
- Fixed several issues with the return value of Archive.retrieve().
6.1
π 2023-07-24
-
The S3 bucket prefix is now created as a 'directory object' so its existence
can be explicitly checked. -
muninn-pull for http/https will now retry once in case of a timeout error.
-
muninn-prepare --dry-run now adds a ';' at the end of each line.
-
Added --verify-hash option to muninn-retrieve.
-
Command line tools no longer show a progress bar if there is no tty.
-
Fixed issue where failing to set/unset a tag did not result in an error.
-
Fixed issue with relocating products in an S3 archive when the product
contained an empty subdirectory. -
Fixed issue where muninn-summary could not group by core.physical_name or
core.archive_path. -
Fixed issue where muninn was incorrectly using subdirectories in the
temporary directory if the 'tempdir' archive configuration option was set. -
Fixed issue where Archive.retrieve() and Archive.export() were returning a
list if a single properties Struct was given as parameter and
use_enclosing_directory
was not set. Additionally, each entry for a
product whereuse_enclosing_directory
is set will now always be a list.
6.0.1
π 2022-11-17
- Fixed python 2 issues and updated documentation that python>=2.7 is required.
6.0
π 2022-10-28
-
Introduced a public python API for muninn.
-
muninn-retrieve and muninn-export will now download a product based on the
core.remote_url setting if core.archive_path was not set (i.e. the product
was not stored in the archive).
To disable this and use the old behaviour, make sure to explictly add an
'is_defined(archive_path)' filter when performing a retrieve/export. -
Introduced storage=none option for archives. This works as a pure catalogue:
archive_path/archive_date should never be set, attach/strip/pull won't work,
ingest will set remote_url to a file:// url pointing to the ingested product,
retrieve and export work purely based on remote_url (see previous point). -
S3 backend 'host' configuration parameter can now be a full endpoint url and
'port' parameter is now optional. -
S3/Swift storage credentials can now be taken from auth_file credentials
file and don't have to be included in the archive configuration file itself. -
Added JSON datatype for metadata properties (this uses JSONB storage when
using the postgresql database backend). -
Added --force and --verify-hash-before options to muninn-attach and added
additional improvements to keep hash and size in line with attached product. -
Improved (re)setting metadata state after storage failure for attach, pull,
and ingest. -
Added support for alternative number bases in queries (e.g. '==0xffff').
-
Added --parallel option to all remaining muninn command-line tools.
-
Added --force and --verify-hash-before options to muninn-attach.
-
Allow 'muninn-strip --force' to reactivate a product even if archive_path is
empty. -
Removed muninn-update post_ingest and post_pull commands since these were no
longer working with generic hooks and the S3/Swift storage backends. -
Added built-in remote backend for sftp (requires paramiko package).
-
Fixed issue in zip auto-extraction for muninn-pull.
-
Added support for auto-extraction of tar(/gz) files for muninn-pull.
-
Run hooks after core.active is set to True instead of before (regression
introduced in 5.4). -
Creating a table will now set COLLATE of TEXT properties to 'C' for the
postgres backend to guarantee consistent sorting. Fields of existing tables
can be manually updated using the following sql command template:
ALTER TABLE table ALTER COLUMN property SET DATA TYPE TEXT COLLATE "C" -
Removed support for all deprecated archive configuration options.
5.4
π 2022-02-22
-
Added muninn-attach/Archive.attach() which acts as the inverse of
muninn-strip/Archive.strip(). -
Fixed grand_type -> grant_type keyword typo for oauth2 entries in auth_file.
-
Allow explicit setting of region for S3 backend.
-
Added (optional) 'paths' argument to plugin export methods.
-
Fix pg8000 >= 1.22 compatibility issue with filtering on timestamps.
5.3
π 2021-12-06
-
Added verify-hash-download option to muninn-pull.
-
Use Bi/Ki/Gi/... as unit for human readable sizes instead of K/G/...
-
When using the S3/Swift backend, a post ingest/pull hook will now use a
locally kept temporary version of the product (instead of retrieving it
again from the bucket). The path(s) to the ingested/pulled product files
is passed on using a new 'paths' argument. Old hook functions without this
argument will still work, but will not be able to access the files. -
muninn-pull for http(s) now retrieves data in blocks instead of reading the
whole file in memory. -
Fixed issue when trying to ingest empty files or directories into S3/Swift
storage. -
Fix compatibility issue with pg8000 >= 1.22.