Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve support for remote executors #1885

Open
wants to merge 2 commits into
base: develop
Choose a base branch
from
Open

Improve support for remote executors #1885

wants to merge 2 commits into from

Commits on Sep 11, 2024

  1. Improve automatic file transfer strategy selection 

    Handle the following cases:
- Local-Remote (except HTTP destination)
- Remote-Local
- Local-Local

This will be needed for to port remote executors to the
new runner-executor API.
    @cjao
    cjao committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    84660e3 View commit details
    Browse the repository at this point in the history

  2. Add framework for building sublattices inside new-style executors 

    `LocalDispatcher.prepare_manifest()` will attempt to copy the task
artifacts to `COVALENT_STAGING_URI_PREFIX` if that environment
variable is set.
    @cjao
    cjao committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    40cfdb8 View commit details
    Browse the repository at this point in the history