Skip to content

Enable FusedSDPA for prompt attention with VLLM_PROMPT_USE_FUSEDSDPA #72

Enable FusedSDPA for prompt attention with VLLM_PROMPT_USE_FUSEDSDPA

Enable FusedSDPA for prompt attention with VLLM_PROMPT_USE_FUSEDSDPA #72

Annotations

2 warnings

yapf (3.10)

succeeded Aug 19, 2024 in 1m 22s