Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Adding the new feature of FPDT #441

Open
wants to merge 8 commits into
base: main
Choose a base branch
from
Open

Adding the new feature of FPDT #441

wants to merge 8 commits into from

Commits on Aug 3, 2024

  1. pass batch_dim_idx to deepspeed sequence parallel distributed attenti… 

    …on for supporting batch size larger than 1
    Jinghan Yao committed Aug 3, 2024
    Configuration menu
    Copy the full SHA
    309d3f0 View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2024

  1. Merge branch 'microsoft:main' into main

    @YJHMITWEB
    YJHMITWEB authored Aug 28, 2024
    Configuration menu
    Copy the full SHA
    75a7fb6 View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2024

  1. add FPDT support; add Ulysses rotary position embedding support

    Jinghan Yao committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    79b8e22 View commit details
    Browse the repository at this point in the history

  2. add FPDT support; add Ulysses rotary position embedding support

    Jinghan Yao committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    9500979 View commit details
    Browse the repository at this point in the history

  3. add FPDT support; add Ulysses rotary position embedding support

    Jinghan Yao committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    daa8528 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2024

  1. add FPDT support; add Ulysses rotary position embedding support

    Jinghan Yao committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    f47b094 View commit details
    Browse the repository at this point in the history

Commits on Oct 7, 2024

  1. remove unnecessary files

    Jinghan Yao committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    99950c0 View commit details
    Browse the repository at this point in the history

  2. set the warmup length to be FPDT chunk size if enabled

    Jinghan Yao committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    ec78191 View commit details
    Browse the repository at this point in the history