Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

New model spec metadata format with runtime and model resource information #268

Merged
merged 9 commits into from
Aug 27, 2023
Merged

New model spec metadata format with runtime and model resource information #268

merged 9 commits into from
Aug 27, 2023

Commits on Aug 27, 2023

  1. Improved ModelHandle with support for multiple replicas and task ex… 

    …ecution

 - rename `remote()` to `__call__()` to keep API consistent with models
 - added tests for batched execution with new `ModelHandle.submit()` API
 - added tests for `ModelHandle.scale()` with multiple replicas
    @spillai
    spillai committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    8bcbf56 View commit details
    Browse the repository at this point in the history

  2. Updated model manager tests for various image-based tasks

    @spillai
    spillai committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    68fd398 View commit details
    Browse the repository at this point in the history

  3. scale() handles pending futures gracefully, and warns user

    @spillai
    spillai committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    00602d1 View commit details
    Browse the repository at this point in the history

  4. Fix test_model_manager_errors that does not raise error any more wi… 

    …th `num_replicas>1`
    @spillai
    spillai committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    25ce4ff View commit details
    Browse the repository at this point in the history

  5. Load nos model specification from profile

    @spillai
    spillai committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    e334e83 View commit details
    Browse the repository at this point in the history

  6. Improved model spec metadata loading for profiled models

    @spillai
    spillai committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    e2d0785 View commit details
    Browse the repository at this point in the history

  7. New model spec metadata format with runtime and model resource inform… 

    …ation
    @spillai
    spillai committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    a3f0aac View commit details
    Browse the repository at this point in the history

  8. Move to ModelHandle.load(spec) instead with minor reverts

    @spillai
    spillai committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    ed591a2 View commit details
    Browse the repository at this point in the history

  9. Removed task property until we remove task attribute from ModelSpec

    @spillai
    spillai committed Aug 27, 2023
    Configuration menu
    Copy the full SHA
    3f01c66 View commit details
    Browse the repository at this point in the history