Skip to content

Enable FusedSDPA for prompt attention with VLLM_PROMPT_USE_FUSEDSDPA #72

Enable FusedSDPA for prompt attention with VLLM_PROMPT_USE_FUSEDSDPA

Enable FusedSDPA for prompt attention with VLLM_PROMPT_USE_FUSEDSDPA #72

Annotations

2 warnings

yapf (3.8)

succeeded Aug 19, 2024 in 1m 28s