Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Enable FusedSDPA for prompt attention with VLLM_PROMPT_USE_FUSEDSDPA #168

Merged
merged 14 commits into from
Aug 19, 2024
Merged

Enable FusedSDPA for prompt attention with VLLM_PROMPT_USE_FUSEDSDPA #168

merged 14 commits into from
Aug 19, 2024

Commits on Aug 9, 2024

  1. Enable FusedSDPA for prompt attention with env VLLM_PREFILL_USE_FUSED… 

    …SDPA
    @libinta
    libinta committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    049300a View commit details
    Browse the repository at this point in the history

  2. Remove extra line

    @libinta
    libinta committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    aa93e4e View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2024

  1. Modified based on review comments.

    @libinta
    libinta committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    1cb502c View commit details
    Browse the repository at this point in the history

  2. Merge branch 'habana_main' into libint/enable_fusedsdpa

    @libinta
    libinta authored Aug 14, 2024
    Configuration menu
    Copy the full SHA
    a25257e View commit details
    Browse the repository at this point in the history

  3. Merge branch 'habana_main' into libint/enable_fusedsdpa

    @libinta
    libinta authored Aug 14, 2024
    Configuration menu
    Copy the full SHA
    5887330 View commit details
    Browse the repository at this point in the history

  4. resolve merge conflict

    @libinta
    libinta committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    0369045 View commit details
    Browse the repository at this point in the history

  5. fix missing logic

    @libinta
    libinta committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    3ae2c3f View commit details
    Browse the repository at this point in the history

  6. fix missing logic

    @libinta
    libinta committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    03f1c4a View commit details
    Browse the repository at this point in the history

  7. cleanup

    @libinta
    libinta committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    af7a53d View commit details
    Browse the repository at this point in the history

  8. revert native impl section

    @libinta
    libinta committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    6f7d384 View commit details
    Browse the repository at this point in the history

  9. run format.sh

    @libinta
    libinta committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    8c714d2 View commit details
    Browse the repository at this point in the history

Commits on Aug 15, 2024

  1. run format.sh

    @libinta
    libinta committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    9f6fde7 View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2024

  1. run format.sh

    @libinta
    libinta committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    32910c3 View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2024

  1. remove internal ticket #

    @libinta
    libinta committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    4b669fc View commit details
    Browse the repository at this point in the history