Skip to content

Enable FusedSDPA for prompt attention with VLLM_PROMPT_USE_FUSEDSDPA … #73

Enable FusedSDPA for prompt attention with VLLM_PROMPT_USE_FUSEDSDPA …

Enable FusedSDPA for prompt attention with VLLM_PROMPT_USE_FUSEDSDPA … #73

Annotations

2 warnings

yapf (3.8)

succeeded Aug 19, 2024 in 1m 31s