Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support Mixtral quantization using INC #188

Closed
wants to merge 9 commits into from
Closed

Support Mixtral quantization using INC #188

wants to merge 9 commits into from

Commits on Aug 14, 2024

  1. Support Mixtral quantization using INC

    @dudilester
    dudilester committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    3e503d0 View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2024

  1. Merge branch 'refs/heads/habana_main' into dev/dlester/mixtral_main_1 

    # Conflicts:
#	vllm/hpu/ops.py
#	vllm/model_executor/layers/quantization/inc.py
    @Tiefen-boop
    Tiefen-boop committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    4028491 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'refs/heads/habana_main' into dev/dlester/mixtral_main_1 

    # Conflicts:
#	vllm/hpu/ops.py
    @Tiefen-boop
    Tiefen-boop committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    be7f696 View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2024

  1. Merge branch 'refs/heads/habana_main' into dev/dlester/mixtral_main_1

    @Tiefen-boop
    Tiefen-boop committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    f2710c9 View commit details
    Browse the repository at this point in the history

  2. Fix formatting errors

    @Tiefen-boop
    Tiefen-boop committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    1a5fd1d View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2024

  1. Fix HabanaExecutorAsync bug when no driver_worker initialized

    @Tiefen-boop
    Tiefen-boop committed Sep 1, 2024
    Configuration menu
    Copy the full SHA
    ca14579 View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2024

  1. Remove HabanaModelRunner D'TOR for mixtral run

    @Tiefen-boop
    Tiefen-boop committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    e7106dc View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2024

  1. Revert Removal of call to finalize_calibration in HabanaModelRunner D… 

    …'TOR
    @Tiefen-boop
    Tiefen-boop committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    c6b132e View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2024

  1. Merge branch 'refs/heads/habana_main' into dev/dlester/mixtral_main_1 

    # Conflicts:
#	vllm/hpu/ops.py
    @Tiefen-boop
    Tiefen-boop committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    83a81dd View commit details
    Browse the repository at this point in the history