Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[model] add support for mixtral moe model #128

Open
wants to merge 14 commits into
base: main
Choose a base branch
from
Open

[model] add support for mixtral moe model #128

wants to merge 14 commits into from

Commits on Apr 16, 2024

  1. [feat]add mixtral.h

    @936187425
    936187425 committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    4342b65 View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2024

  1. [feat] add some classes in mixtral.h

    @936187425
    936187425 committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    4e88395 View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2024

  1. [feat] construct modules from mixtral model except Mixtral moe impl

    @936187425
    936187425 committed Apr 19, 2024
    Configuration menu
    Copy the full SHA
    7172786 View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2024

  1. [feat] add the replicated_linear

    @936187425
    936187425 committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    c13ebd3 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'vectorch-ai:main' into Mixtral

    @936187425
    936187425 authored Apr 26, 2024
    Configuration menu
    Copy the full SHA
    f2ffe46 View commit details
    Browse the repository at this point in the history

  3. [format]

    @936187425
    936187425 committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    13da555 View commit details
    Browse the repository at this point in the history

Commits on May 13, 2024

  1. [refactor] add the wrapper of fused_moe_layer add the fused_moe_kernel

    @936187425
    936187425 committed May 13, 2024
    Configuration menu
    Copy the full SHA
    bdb529c View commit details
    Browse the repository at this point in the history

  2. Merge branch 'vectorch-ai:main' into Mixtral

    @936187425
    936187425 authored May 13, 2024
    Configuration menu
    Copy the full SHA
    1a8d37d View commit details
    Browse the repository at this point in the history

Commits on May 14, 2024

  1. [feat] add the load_state_dict in fused_moe.cpp

    @936187425
    936187425 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    3eb45f0 View commit details
    Browse the repository at this point in the history

Commits on May 22, 2024

  1. Merge branch 'vectorch-ai:main' into Mixtral

    @936187425
    936187425 authored May 22, 2024
    Configuration menu
    Copy the full SHA
    51f3d56 View commit details
    Browse the repository at this point in the history

Commits on May 23, 2024

  1. [feat] add MixtralBlockExpert using torch version

    @936187425
    936187425 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    d649ac9 View commit details
    Browse the repository at this point in the history

  2. [format]

    @936187425
    936187425 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    046cf63 View commit details
    Browse the repository at this point in the history

  3. [bug]Remove third_party/pybind11/ from submodules

    @936187425
    936187425 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    11a4a8a View commit details
    Browse the repository at this point in the history

  4. [fix]remove the third_party/pybind11

    @936187425
    936187425 committed May 23, 2024
    Configuration menu
    Copy the full SHA
    9a5ac5b View commit details
    Browse the repository at this point in the history