REANA-Server 0.9.3

0.9.3 (2024-03-04)

Build

• deps: pin invenio-userprofiles to 1.2.4 (#665) (d6cb168)
• docker: non-editable submodules in "latest" mode (#656) (d16fefb)
• python: bump all required packages as of 2024-03-04 (#674) (f40b82f)
• python: bump shared modules (#676) (47ad3ca)
• python: bump shared REANA packages as of 2024-03-04 (#674) (aa18394)

Code refactoring

• docs: move from reST to Markdown (#671) (b6d1799)

Code style

• black: format with black v24 (#670) (6d2b898)

Continuous integration

• commitlint: addition of commit message linter (#665) (2b43ecc)
• commitlint: allow release commit style (#675) (e0299ef)
• commitlint: check for the presence of concrete PR number (#669) (87c6145)
• pytest: move to PostgreSQL 14.10 (#672) (e888ddd)
• release-please: initial configuration (#665) (1d5e7c5)
• release-please: update version in Dockerfile/OpenAPI specs (#668) (3b3dc41)
• shellcheck: fix exit code propagation (#669) (d7eac6b)

Documentation

• authors: complete list of contributors (#673) (71b3f38)

REANA-Server 0.9.2

• Adds automated multi-platform container image building for amd64 and arm64 architectures.
• Adds metadata labels to Dockerfile.
• Changes workflow scheduler logging behaviour to also report the main reason behind scheduling errors to the users.
• Fixes runtime uWSGI warning by rebuilding uWSGI with the PCRE support.

REANA-Server 0.9.1

• Adds new prune_workspace endpoint to allow users to delete all the files of a workflow, specifying whether to also delete the inputs and/or the outputs.
• Adds new interactive-session-cleanup command that can be used by REANA administrators to close interactive sessions that are inactive for more than the specified number of days.
• Adds logic to support SSO with third-party Keycloak authentication services.
• Adds the timestamp of when the workflow was stopped (run_stopped_at) to the workflow list and the workflow status endpoints.
• Adds the content of the REANA_GITLAB_HOST environment variable to the list of GitLab instances from which it is possible to launch a workflow.
• Adds progress meter to the logs of the periodic quota updater.
• Changes CPU and disk quota calculations to improve the performance of periodic quota updater.
• Changes the system status report to simplify and clarify the disk usage summary.
• Changes check-workflows command to also check the presence of workspaces on the shared volume.
• Changes check-workflows command to not show in-sync runs by default. If needed, they can be shown using the new --show-all option.
• Changes launch endpoint to also include the warnings of the validation of the workflow specification.
• Changes OpenAPI specification of the info endpoint to return the maximum inactivity time before automatic closure of interactive sessions.
• Changes apispec dependency version in order to be compatible with PyYAML v6.
• Changes reana-admin command options to require the passing of --admin-access-token argument more globally.
• Fixes the workflow priority calculation to avoid workflows stuck in the queued status when the number of allowed concurrent workflow is set to zero.
• Fixes GitLab integration to automatically redirect the user to the correct URL when the access request is accepted.
• Fixes quota-set-default-limits command to propagate default quota limits to all users without custom quota limit values.
• Fixes authentication flow to correctly deny access to past revoked tokens in case the same user has also other new active tokens.
• Fixes email templates to show the correct kubectl commands when REANA is deployed inside a non-default namespace or with a custom component name prefix.
• Fixes email sender for system emails to notifications.email_config.sender Helm value.
• Fixes email receiver for token request emails to use notifications.email_config.receiver Helm value.
• Fixes start-scheduler command to gracefully stop when being terminated.
• Fixes container image names to be Podman-compatible.

REANA-Server 0.9.0

• Adds new /api/launch endpoint that allows running workflows from remote sources.
• Adds new get_workflow_retention_rules endpoint that allows to retrieve the workspace file retention rules of a workflow.
• Adds queue-consume command that can be used by REANA administrators to remove specific messages from the queue.
• Adds configuration environment variable to set an API rate limit for slow endpoints (REANA_RATELIMIT_SLOW).
• Adds REANA specification validation utilities.
• Adds retention-rules-apply command that can be used by REANA administrators to apply pending retention rules.
• Adds retention-rules-extend command that can be used by REANA administrators to extend the duration of active retentions rules.
• Adds check-workflows command that can be used by REANA administrators to check for out-of-sync workflows and interactive sessions.
• Changes OpenAPI specification to include missing response schema elements and some other small enhancements.
• Changes /api/info endpoint to also include the kubernetes maximum memory limit, the kubernetes default memory limit and the maximum workspace retention period.
• Changes start_workflow endpoint to validate the REANA specification of the workflow.
• Changes create_workflow endpoint to populate workspace retention rules for the workflow.
• Changes start_workflow endpoint to disallow restarting a workflow when retention rules are pending.
• Changes API rate limiter error messages to be more verbose.
• Changes workflow scheduler to allow defining the checks needed to assess whether the cluster can start new workflows.
• Changes the Invenio dependencies to the latest versions.
• Changes OAuth configuration to enable the new CERN SSO.
• Changes to PostgreSQL 12.13.
• Changes GitLab integration to also retrieve user's projects that are in groups and subgroups.
• Changes the base image of the component to Ubuntu 20.04 LTS and reduces final Docker image size by removing build-time dependencies.
• Fixes issue when irregular number formats are passed to REANA_SCHEDULER_REQUEUE_COUNT configuration environment variable.
• Fixes GitLab integration error reporting in case user exceeds CPU or Disk quota usage limits.
• Fixes CERN OIDC authentication to possibly allow eduGAIN and social login users.

REANA-Server 0.8.3

• Adds Kubernetes job memory limits validation before publishing workflow submission.

REANA-Server 0.8.2

• Adds email validation to the user-create command used by the REANA administrators.
• Adds workflow name validation to the create_workflow endpoint.
• Changes /api/info endpoint to return a list of supported compute backends.
• Changes /api/status endpoint to calculate the cluster health status based on the availability instead of the usage.

REANA-Server 0.8.1

• Changes quota-set command used by the REANA administrators to use the resource type along with a resource name for specifying the resource.
• Changes email validation used in create-admin-user command by the REANA administrators to be more permissive.

REANA-Server 0.8.0

• Adds users quota accounting.
• Adds support for Snakemake workflow engine.
• Adds include_progress and include_workspace_size query args to workflow list endpoint.
• Adds workflow prioritization in the queue by complexity.
• Adds priority and min_job_memory params to workflow submission publisher.
• Adds Yadage workflow specification loading to start_workflow endpoint.
• Adds a check in scheduler if at least one workflow job could be started in Kubernetes.
• Adds configuration environment variable to set workflow scheduling policy (REANA_WORKFLOW_SCHEDULING_POLICY).
• Adds configuration environment variable to set a timeout between consuming workflows (REANA_SCHEDULER_REQUEUE_SLEEP).
• Adds configuration environment variable to set an API rate limiter (REANA_RATELIMIT_AUTHENTICATED_USER, REANA_RATELIMIT_GUEST_USER).
• Adds new info endpoint allowing to retrieve information about cluster capabilities such as available workspaces.
• Changes workflow execution consumer to receive only one message at a time.
• Changes to PostgreSQL 12.8

REANA-Server 0.7.6

• Changes internal dependencies.

REANA-Server 0.7.5

• Adds support for listing files using glob patterns.
• Adds support for glob patterns and directory downloads, packaging the content into a zip file.