Skip to content

Releases: stcorp/muninn

6.4.1

14 Aug 07:43
Compare
Choose a tag to compare

πŸ“… 2024-08-14

  • Fixed issue where only 'dict' values could be stored as a JSON property.

6.4

15 Mar 08:48
Compare
Choose a tag to compare
6.4

πŸ“… 2024-03-14

  • Allow argument to muninn.open() to be a direct url or path to a muninn
    configuration file.

  • Added 'distance(geometry,geometry)' expression function.

  • Added Geometry.wrap() spherical to 2d geometry wrapping functions.

  • Fixed issue when pulling a product that is a directory using the S3 remote
    backend.

  • Various fixes when using archive.rebuild_properties() with the S3 storage
    backend.

  • Several minor fixes.

6.3

13 Dec 17:32
Compare
Choose a tag to compare
6.3

πŸ“… 2023-12-13

  • Added support for extension-specific configuration sections in archive
    configuration files.

  • Introduced timeout and retries options for the
    extension:muninn.remote section in an archive configuration.
    The number of retries now defaults back to 0.

  • Added option to muninn-info to show all archives if no archive parameter
    is provided.

  • Added muninn.list_archives() function.

  • Improved support for using muninn on Windows (e.g. '' in paths are now
    translated to '/' when stored as muninn metadata)

  • Fixed issue where S3 bucket prefix object was created with one '/' too many.

6.2

20 Sep 16:14
Compare
Choose a tag to compare
6.2

πŸ“… 2023-09-20

  • Added S3 remote backend to allow performing a muninn pull from an object
    store.

  • A muninn pull will now set core.hash (if it did not yet have a value) similar
    to muninn ingest.

  • Added support for s3://bucket entries in the credentials authorization file.
    These entries can be used by the S3 storage backend and S3 remote backend.

  • Added from_geojson() and as_geojson() methods to muninn.geometry data types.

  • Fixed issue where is_defined(<namespace>) did not work for the sqlite
    backend when using a table prefix.

6.1.1

02 Aug 22:03
Compare
Choose a tag to compare

πŸ“… 2023-08-02

  • Fixed several issues with the return value of Archive.retrieve().

6.1

24 Jul 14:40
Compare
Choose a tag to compare
6.1

πŸ“… 2023-07-24

  • The S3 bucket prefix is now created as a 'directory object' so its existence
    can be explicitly checked.

  • muninn-pull for http/https will now retry once in case of a timeout error.

  • muninn-prepare --dry-run now adds a ';' at the end of each line.

  • Added --verify-hash option to muninn-retrieve.

  • Command line tools no longer show a progress bar if there is no tty.

  • Fixed issue where failing to set/unset a tag did not result in an error.

  • Fixed issue with relocating products in an S3 archive when the product
    contained an empty subdirectory.

  • Fixed issue where muninn-summary could not group by core.physical_name or
    core.archive_path.

  • Fixed issue where muninn was incorrectly using subdirectories in the
    temporary directory if the 'tempdir' archive configuration option was set.

  • Fixed issue where Archive.retrieve() and Archive.export() were returning a
    list if a single properties Struct was given as parameter and
    use_enclosing_directory was not set. Additionally, each entry for a
    product where use_enclosing_directory is set will now always be a list.

6.0.1

24 Jul 14:39
Compare
Choose a tag to compare

πŸ“… 2022-11-17

  • Fixed python 2 issues and updated documentation that python>=2.7 is required.

6.0

31 Oct 08:57
Compare
Choose a tag to compare
6.0

πŸ“… 2022-10-28

  • Introduced a public python API for muninn.

  • muninn-retrieve and muninn-export will now download a product based on the
    core.remote_url setting if core.archive_path was not set (i.e. the product
    was not stored in the archive).
    To disable this and use the old behaviour, make sure to explictly add an
    'is_defined(archive_path)' filter when performing a retrieve/export.

  • Introduced storage=none option for archives. This works as a pure catalogue:
    archive_path/archive_date should never be set, attach/strip/pull won't work,
    ingest will set remote_url to a file:// url pointing to the ingested product,
    retrieve and export work purely based on remote_url (see previous point).

  • S3 backend 'host' configuration parameter can now be a full endpoint url and
    'port' parameter is now optional.

  • S3/Swift storage credentials can now be taken from auth_file credentials
    file and don't have to be included in the archive configuration file itself.

  • Added JSON datatype for metadata properties (this uses JSONB storage when
    using the postgresql database backend).

  • Added --force and --verify-hash-before options to muninn-attach and added
    additional improvements to keep hash and size in line with attached product.

  • Improved (re)setting metadata state after storage failure for attach, pull,
    and ingest.

  • Added support for alternative number bases in queries (e.g. '==0xffff').

  • Added --parallel option to all remaining muninn command-line tools.

  • Added --force and --verify-hash-before options to muninn-attach.

  • Allow 'muninn-strip --force' to reactivate a product even if archive_path is
    empty.

  • Removed muninn-update post_ingest and post_pull commands since these were no
    longer working with generic hooks and the S3/Swift storage backends.

  • Added built-in remote backend for sftp (requires paramiko package).

  • Fixed issue in zip auto-extraction for muninn-pull.

  • Added support for auto-extraction of tar(/gz) files for muninn-pull.

  • Run hooks after core.active is set to True instead of before (regression
    introduced in 5.4).

  • Creating a table will now set COLLATE of TEXT properties to 'C' for the
    postgres backend to guarantee consistent sorting. Fields of existing tables
    can be manually updated using the following sql command template:
    ALTER TABLE table ALTER COLUMN property SET DATA TYPE TEXT COLLATE "C"

  • Removed support for all deprecated archive configuration options.

5.4

22 Feb 22:21
Compare
Choose a tag to compare
5.4

πŸ“… 2022-02-22

  • Added muninn-attach/Archive.attach() which acts as the inverse of
    muninn-strip/Archive.strip().

  • Fixed grand_type -> grant_type keyword typo for oauth2 entries in auth_file.

  • Allow explicit setting of region for S3 backend.

  • Added (optional) 'paths' argument to plugin export methods.

  • Fix pg8000 >= 1.22 compatibility issue with filtering on timestamps.

5.3

06 Dec 17:48
Compare
Choose a tag to compare
5.3

πŸ“… 2021-12-06

  • Added verify-hash-download option to muninn-pull.

  • Use Bi/Ki/Gi/... as unit for human readable sizes instead of K/G/...

  • When using the S3/Swift backend, a post ingest/pull hook will now use a
    locally kept temporary version of the product (instead of retrieving it
    again from the bucket). The path(s) to the ingested/pulled product files
    is passed on using a new 'paths' argument. Old hook functions without this
    argument will still work, but will not be able to access the files.

  • muninn-pull for http(s) now retrieves data in blocks instead of reading the
    whole file in memory.

  • Fixed issue when trying to ingest empty files or directories into S3/Swift
    storage.

  • Fix compatibility issue with pg8000 >= 1.22.